-- Logs begin at Wed 2022-08-24 16:17:46 UTC, end at Wed 2022-08-24 17:31:38 UTC. -- Aug 24 16:49:08.334806 dv-cinder-779578-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 16:49:08.344145 dv-cinder-779578-5-smb devstack@keystone.service[81749]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 16:49:08.346292 dv-cinder-779578-5-smb devstack@keystone.service[81749]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 16:49:08 2022] *** Aug 24 16:49:08.346429 dv-cinder-779578-5-smb devstack@keystone.service[81749]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 16:49:08.346544 dv-cinder-779578-5-smb devstack@keystone.service[81749]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 16:49:08.346649 dv-cinder-779578-5-smb devstack@keystone.service[81749]: nodename: dv-cinder-779578-5-smb Aug 24 16:49:08.346754 dv-cinder-779578-5-smb devstack@keystone.service[81749]: machine: x86_64 Aug 24 16:49:08.346863 dv-cinder-779578-5-smb devstack@keystone.service[81749]: clock source: unix Aug 24 16:49:08.346958 dv-cinder-779578-5-smb devstack@keystone.service[81749]: pcre jit disabled Aug 24 16:49:08.347058 dv-cinder-779578-5-smb devstack@keystone.service[81749]: detected number of CPU cores: 4 Aug 24 16:49:08.348535 dv-cinder-779578-5-smb devstack@keystone.service[81749]: current working directory: / Aug 24 16:49:08.348535 dv-cinder-779578-5-smb devstack@keystone.service[81749]: detected binary path: /usr/bin/uwsgi-core Aug 24 16:49:08.348535 dv-cinder-779578-5-smb devstack@keystone.service[81749]: your processes number limit is 47680 Aug 24 16:49:08.348535 dv-cinder-779578-5-smb devstack@keystone.service[81749]: your memory page size is 4096 bytes Aug 24 16:49:08.348535 dv-cinder-779578-5-smb devstack@keystone.service[81749]: detected max file descriptor number: 2048 Aug 24 16:49:08.348535 dv-cinder-779578-5-smb devstack@keystone.service[81749]: lock engine: pthread robust mutexes Aug 24 16:49:08.348535 dv-cinder-779578-5-smb devstack@keystone.service[81749]: thunder lock: enabled Aug 24 16:49:08.348535 dv-cinder-779578-5-smb devstack@keystone.service[81749]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 16:49:08.348535 dv-cinder-779578-5-smb devstack@keystone.service[81749]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 16:49:08.387157 dv-cinder-779578-5-smb devstack@keystone.service[81749]: Python main interpreter initialized at 0x5633e673b9c0 Aug 24 16:49:08.387157 dv-cinder-779578-5-smb devstack@keystone.service[81749]: python threads support enabled Aug 24 16:49:08.387157 dv-cinder-779578-5-smb devstack@keystone.service[81749]: your server socket listen backlog is limited to 100 connections Aug 24 16:49:08.387157 dv-cinder-779578-5-smb devstack@keystone.service[81749]: your mercy for graceful operations on workers is 90 seconds Aug 24 16:49:08.387529 dv-cinder-779578-5-smb devstack@keystone.service[81749]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 16:49:08.387608 dv-cinder-779578-5-smb devstack@keystone.service[81749]: *** Operational MODE: preforking *** Aug 24 16:49:08.387870 dv-cinder-779578-5-smb devstack@keystone.service[81749]: *** uWSGI is running in multiple interpreter mode *** Aug 24 16:49:08.387870 dv-cinder-779578-5-smb devstack@keystone.service[81749]: spawned uWSGI master process (pid: 81749) Aug 24 16:49:08.388077 dv-cinder-779578-5-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 24 16:49:08.389162 dv-cinder-779578-5-smb devstack@keystone.service[81749]: spawned uWSGI worker 1 (pid: 81760, cores: 1) Aug 24 16:49:08.389162 dv-cinder-779578-5-smb devstack@keystone.service[81749]: spawned uWSGI worker 2 (pid: 81761, cores: 1) Aug 24 16:49:08.389162 dv-cinder-779578-5-smb devstack@keystone.service[81749]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 16:49:12.829196 dv-cinder-779578-5-smb devstack@keystone.service[81760]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:49:12.829196 dv-cinder-779578-5-smb devstack@keystone.service[81760]: from cryptography.utils import int_from_bytes Aug 24 16:49:12.873333 dv-cinder-779578-5-smb devstack@keystone.service[81760]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:49:12.873333 dv-cinder-779578-5-smb devstack@keystone.service[81760]: from cryptography.utils import int_from_bytes Aug 24 16:49:12.874015 dv-cinder-779578-5-smb devstack@keystone.service[81761]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:49:12.874015 dv-cinder-779578-5-smb devstack@keystone.service[81761]: from cryptography.utils import int_from_bytes Aug 24 16:49:12.874015 dv-cinder-779578-5-smb devstack@keystone.service[81761]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 16:49:12.874015 dv-cinder-779578-5-smb devstack@keystone.service[81761]: from cryptography.utils import int_from_bytes Aug 24 16:49:12.884045 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 16:49:12.884239 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 16:49:12.884430 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] command line args: [] {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 16:49:12.884525 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 16:49:12.884682 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 16:49:12.884768 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 16:49:12.884847 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ================================================================================ {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 16:49:12.884925 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] command line args: [] {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 16:49:12.885103 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] admin_token = **** {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.885196 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 16:49:12.885334 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ================================================================================ {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 16:49:12.885417 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] config_dir = [] {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.885523 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.885610 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] admin_token = **** {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.885690 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] config_source = [] {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.885773 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] config_dir = [] {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.885874 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] debug = True {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.885961 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.886071 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.886411 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] config_source = [] {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.886411 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] debug = True {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.886687 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.886826 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.886990 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.887171 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.887171 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.887787 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.887787 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.888157 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.888285 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] list_limit = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.888371 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.888500 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] log_config_append = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.888583 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] list_limit = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.888663 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.888786 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] log_config_append = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.888868 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] log_dir = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.888942 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.889067 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] log_file = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.889150 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] log_dir = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.889224 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.889345 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] log_file = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.889427 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.889501 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.889627 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.889704 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.889825 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.889910 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.889989 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.890170 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.890744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.890872 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.890951 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.891035 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.891183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.891271 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.891397 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.891480 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.891639 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.891768 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.891851 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.891983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.892061 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.892061 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.892253 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.892379 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.892467 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.892585 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.892662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.892662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.892843 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.55/identity {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.892925 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.893006 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] publish_errors = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.893006 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.893006 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.893192 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.55/identity {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.893317 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.893397 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] publish_errors = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.893475 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.893553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.893681 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.893758 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.893758 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.893912 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] standard_threads = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.893985 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.894067 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.894210 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.894296 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.894434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.894516 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] standard_threads = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.894594 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] use_journal = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.894676 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.894750 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] use_json = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.894878 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] use_stderr = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.894957 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.895036 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] use_syslog = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.895140 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.895233 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] use_journal = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.895312 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.895412 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] use_json = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.895535 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.895629 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] use_stderr = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.895800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.896093 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] use_syslog = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.896093 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 16:49:12.896316 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.896316 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.896536 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.896536 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.896763 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.896763 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.896986 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.897106 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.897224 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.897338 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.897462 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.897584 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.897700 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.897819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.897935 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.897935 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.898159 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.898159 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.898376 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.898495 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.898617 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.898744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.898860 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.898974 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.899095 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.899257 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.899378 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.899505 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.899622 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.899742 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.899864 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.899979 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.900099 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.900099 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.900336 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.900336 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.900560 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.900676 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.900800 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.900800 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.901035 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.901150 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.901270 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.901386 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.901501 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.901713 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.901846 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.901846 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.902093 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.902215 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.902331 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.902495 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.902615 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.902736 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.902857 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.902978 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.903100 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.903275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.903392 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.903508 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.903703 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.903841 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.903956 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.904082 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.904198 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.904311 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.904425 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.904545 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.904667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.904790 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.904906 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.905020 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.905132 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.905246 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.905360 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.905482 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.905599 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.905754 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.905942 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.906140 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.906303 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.906424 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.906545 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.906653 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.906797 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.906797 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.906995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.906995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.907220 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.907323 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.907323 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.907501 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.907612 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.907720 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.907818 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.907922 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.908031 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.908150 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.908272 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.908395 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.908511 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.908627 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.908743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.908858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.908973 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.909088 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.909211 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.909334 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.909446 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.909560 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.909681 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.909809 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.909926 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.910037 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.910157 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.910272 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.910387 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.910509 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.910626 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.910741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.910870 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.910993 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.911154 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.911276 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.911401 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.911518 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.911639 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.911761 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.911889 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.912007 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.912131 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.912249 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.912365 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.912479 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.912594 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.912715 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.912840 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.912957 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.913073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.913191 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.913359 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.913477 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.913671 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.913791 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.913907 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.914024 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.914140 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.914256 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.914507 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.914640 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.914748 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.914853 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.914951 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.915049 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.920318 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.920415 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.920498 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.920579 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.920653 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.920732 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.920811 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.920893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.920973 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.921052 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.921127 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.921200 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.921273 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.921425 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.921555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.921636 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.921760 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.921878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.921963 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.922047 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.922121 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.922200 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.922318 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.922396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.922469 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.922554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.922630 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.922702 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.922781 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.922855 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.922928 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.923007 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.923082 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.923220 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.923298 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.923372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.923445 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.923531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.923613 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.923688 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.923761 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.923834 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.923907 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.923987 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.923987 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.924119 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.924191 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.924263 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.924335 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.924415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] auth.external = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.924415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.924546 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.924546 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.924676 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.924748 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.924829 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.924902 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] auth.external = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.925000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] auth.password = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.925000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] auth.token = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.925143 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.925224 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.925298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.925380 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.925462 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.925537 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.925611 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] auth.password = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.925687 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.925760 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] auth.token = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.925843 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.925843 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.925985 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.926059 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.926131 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.926203 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] credential.caching = True {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.926276 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.926359 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.926434 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.926507 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.926586 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.926666 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.926751 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.926825 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.926904 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.926984 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.927059 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] credential.caching = True {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.927183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.927273 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.927350 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.927423 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.927496 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.927569 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.927642 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.927724 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.927814 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.927936 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.928014 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.928088 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.928162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.928246 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.928321 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.928394 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.928468 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.928541 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.928621 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.928772 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.928848 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] federation.caching = True {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.928848 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.928980 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.929054 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.929127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.929208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.929283 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.929356 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.929428 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.929502 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.929575 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.929655 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.929731 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] federation.caching = True {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.929804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.929876 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.929949 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.930022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.930102 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.930197 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.930322 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.930402 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.930477 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.930559 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.930642 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] identity.caching = True {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.930717 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.930791 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.930864 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.930937 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.931010 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.931091 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.931228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.931307 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.931381 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.931453 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.931527 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.931621 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.931775 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] identity.caching = True {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.931854 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.931975 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.932053 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.932122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.932204 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.932285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.932360 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.932433 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.932512 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.932587 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.932672 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.932747 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.932821 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.932894 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.932966 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.933045 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.933129 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.933204 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.933285 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.933364 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.933438 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.933523 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.933523 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.933657 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.933730 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.933803 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.933803 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.933947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.934023 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.934102 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.934176 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.934255 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.934330 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.934414 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.934490 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.934563 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.934636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.934743 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.934869 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.934988 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.935157 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.935260 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.935380 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.935530 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.935651 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.935766 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.935848 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.935963 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.936071 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.936201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.936316 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.936440 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.936562 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.936689 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.936793 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.936919 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.937546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.937755 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.937842 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.938000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.938220 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.938343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.938542 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.938672 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.938791 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.938910 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.939027 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.939169 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.939289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.939420 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.939539 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.939656 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.939773 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.939890 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.940013 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.940140 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.940348 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.940470 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.940470 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.940699 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.940816 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.940941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.941060 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.941177 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.941295 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.941412 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.941528 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.user = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.941652 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.941784 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.941969 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.942070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.942167 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.942263 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.942371 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.942471 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.942568 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.942667 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.942765 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.942862 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.942983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.943083 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.943211 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.943572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.943684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.user = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.943782 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.947882 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.947998 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.948081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.948244 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.948320 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.948394 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.948483 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.948561 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.948634 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.948708 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.948787 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.948862 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.948943 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.949019 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.949093 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.949208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.949290 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.949374 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.949449 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.949529 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.949604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.949677 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.949751 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.949835 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.949911 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.950006 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.950079 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.950152 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.950225 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.950307 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.950388 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.950464 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.950538 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.950611 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.950684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.950765 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.950841 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.950914 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.950987 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.951060 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.951152 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.951235 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.951311 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.951385 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.951458 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.951530 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.951621 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.951778 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.951857 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.951931 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.952004 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.952076 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.952200 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.952288 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.952364 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.952438 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] resource.caching = True {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.952511 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.952583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.953370 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.953462 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.953547 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.953623 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.953697 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.953771 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.953846 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.953964 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.954070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.954181 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.954258 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.954332 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.954406 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.954489 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.954565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] resource.caching = True {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.954638 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.954712 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.954784 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] role.caching = True {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.954858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.954939 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] role.driver = sql {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.955015 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.955089 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.955089 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.955306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.955380 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.955380 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.955529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.955603 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.955676 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.955749 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.955822 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.955904 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.955980 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.956053 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.956126 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.956199 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.956272 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] role.caching = True {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.956353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.956434 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] role.driver = sql {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.956516 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.956590 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.956663 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.956737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.956737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.956878 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.956952 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.957025 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.957098 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.957170 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.957251 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.957326 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.957399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.957472 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.957545 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.957626 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.957701 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.957852 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.957936 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.958097 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.958192 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.958331 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.958413 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.958580 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.958660 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.958828 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.958908 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.959066 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.959304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.959406 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.959525 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.959606 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.959763 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.959851 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.960016 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.960096 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.960264 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.960345 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.960509 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.960601 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.960742 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.960822 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.960976 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.961056 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.961209 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.961299 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.961454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] token.caching = True {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.961535 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.961683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.961762 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.961915 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.962005 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.962148 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.962230 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.962398 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.962480 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.962643 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.962736 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.962881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.962963 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.963179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.963267 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.963371 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.963466 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.963602 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.963683 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.963838 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.963918 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] token.caching = True {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.964071 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.964174 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.964327 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.964406 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.964654 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.964749 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.964825 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.964907 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.965032 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.965114 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.965276 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.965358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.965522 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.965604 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.965764 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.965845 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] database.connection = **** {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.966009 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.966101 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.966245 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.966326 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.966485 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.966567 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.966719 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.966800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.966961 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.967041 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.967223 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.967308 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.967451 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.967531 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.967686 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.967766 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.967931 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.968015 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.968187 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.968508 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] database.connection = **** {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.968661 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.968795 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.968925 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.969128 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.969256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.969382 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.969508 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.969656 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.969785 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.969932 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.970060 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.970186 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.970312 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.970439 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.970602 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.970740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.970904 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81760) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 16:49:12.971030 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.971030 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.971313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.971441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.971668 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.971905 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.972190 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.972385 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.972627 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.972862 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 16:49:12.973032 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81761) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 16:49:13.000347 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81760) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.000571 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81760) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.000812 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81760) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.002711 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81761) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.002943 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81761) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.003193 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81761) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.009528 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81760) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.011701 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81761) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.038808 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81760) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.039028 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81760) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.046793 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81761) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.047225 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81761) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.114056 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81760) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.114535 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81761) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.172398 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81760) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.172622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81760) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.173187 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81761) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.173444 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81761) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.331733 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81760) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.331970 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81760) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.332156 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81760) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.332250 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81761) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.332370 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81760) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.332456 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81761) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.332581 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81760) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.332676 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81761) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.332791 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81760) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.332875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81761) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.333059 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81761) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.333272 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81761) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.357404 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81760) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.357570 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81761) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.357655 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81760) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.357732 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81761) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.357808 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81760) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.357883 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81761) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.358013 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81760) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.358098 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81761) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.358227 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81760) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.358311 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81761) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.358440 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81760) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.358536 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81761) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.358651 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81760) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.358735 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81761) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.370414 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81760) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.370840 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81761) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.383740 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81760) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.383961 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81760) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.384183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81760) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.384298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81761) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.384383 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81760) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.384532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81761) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.384631 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81760) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.384757 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81761) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.384866 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81760) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.384991 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81760) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.385056 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81761) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.385335 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81761) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.385493 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81761) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.385627 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81761) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 16:49:13.412718 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.413052 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 16:49:13.413370 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.413502 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.413631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 16:49:13.413766 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 16:49:13.413988 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.414117 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.414254 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 16:49:13.414381 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.414519 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.414707 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.414833 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.415007 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.415361 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.415789 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.425899 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.426196 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.426447 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.426546 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.426724 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.426809 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.426991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.427296 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.433767 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81760) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.434242 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81761) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.436667 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81760) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.437554 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.437818 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81761) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.437903 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.438196 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.438298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.438485 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.438637 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.438838 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.438935 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.439015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.439223 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.439311 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.439491 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.439651 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.439766 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.439926 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.440041 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.440196 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.440427 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.440706 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.440980 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.464250 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.464780 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.465722 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81761) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.466006 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.466245 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81760) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.466527 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.471238 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81761) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.471378 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81760) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.471522 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.471661 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.471807 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.471938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.478121 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81761) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.478233 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81760) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.478409 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.478519 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.482504 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81761) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.482602 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81760) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.482794 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.482893 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.483079 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.483183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.483385 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.483470 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.483663 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.483747 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.484483 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.484574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.484740 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.484972 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.485063 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.485275 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.503056 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.503360 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.503669 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.503960 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.507218 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81760) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.507831 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81761) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.510404 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.510691 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.511030 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.511349 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.514898 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81760) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.516330 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81761) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.518235 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81760) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.519213 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81761) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.521483 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.521774 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.522057 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.522334 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.522454 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.522606 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.522751 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.522890 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.523033 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.523355 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.523633 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.523920 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.538749 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81760) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.539035 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.539321 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.539582 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.540247 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81761) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.540538 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.540809 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.541087 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.546957 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.548496 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.548764 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.548849 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.550342 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.550612 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.551402 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81760) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.551685 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.551976 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.552267 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.552541 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.553324 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81761) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.553611 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.553903 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.554196 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.554474 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.563928 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81760) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.564211 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.564492 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.564783 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.565042 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.565313 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.565585 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.566108 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81761) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.566397 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.566679 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.566959 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.567265 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.567562 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.567848 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.581666 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81760) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.584461 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81761) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.584702 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81760) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.587514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81761) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.587733 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.589161 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.590398 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.590650 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81760) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.590949 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.591265 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.591935 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.593989 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81761) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.594459 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.594877 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.598344 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.599816 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81760) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.601413 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.602752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.602873 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81761) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.603036 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.603337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.603613 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.605837 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.606128 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.606418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.606711 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.611679 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81760) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.611965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.612238 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.615027 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81761) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.615352 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.615633 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.619390 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81760) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.619570 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.619716 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.619986 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.620252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.620591 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.620803 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.621068 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.621353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.621618 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.621891 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.622148 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.622420 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.622502 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81761) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 16:49:13.622685 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81760) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.622791 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.623076 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.623379 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.623650 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.623922 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.624195 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.625066 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.625495 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.625983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.626329 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.626595 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.626875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.627175 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81761) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 16:49:13.658597 dv-cinder-779578-5-smb devstack@keystone.service[81760]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5633e673b9c0 pid: 81760 (default app) Aug 24 16:49:13.662240 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebe71f-bade-4e73-b16b-f203e61ffc6a None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:13.662522 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebe71f-bade-4e73-b16b-f203e61ffc6a None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:13.662679 dv-cinder-779578-5-smb devstack@keystone.service[81761]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5633e673b9c0 pid: 81761 (default app) Aug 24 16:49:13.662858 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ebe71f-bade-4e73-b16b-f203e61ffc6a None None] PATH_INFO: `/v3` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:13.667011 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1/1] 10.222.0.55 () {50 vars in 791 bytes} [Wed Aug 24 16:49:13 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:21.310694 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11798f-587e-4c07-828c-2ce7b26bf6f4 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:21.311304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11798f-587e-4c07-828c-2ce7b26bf6f4 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:21.311410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11798f-587e-4c07-828c-2ce7b26bf6f4 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:21.316316 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1/2] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:49:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:49:21.323559 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0f7b3-df25-49ca-898a-6a99d2d8c1e9 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:21.324014 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0f7b3-df25-49ca-898a-6a99d2d8c1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:21.324093 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0f7b3-df25-49ca-898a-6a99d2d8c1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:21.398809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: INFO dbcounter [None req-4da0f7b3-df25-49ca-898a-6a99d2d8c1e9 None None] Registered counter for database keystone Aug 24 16:49:21.422363 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG oslo_db.sqlalchemy.engines [None req-4da0f7b3-df25-49ca-898a-6a99d2d8c1e9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81760) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:49:21.429017 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writer thread running {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:49:21.631268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG passlib.handlers.bcrypt [None req-4da0f7b3-df25-49ca-898a-6a99d2d8c1e9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81760) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 16:49:21.631622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG passlib.handlers.bcrypt [None req-4da0f7b3-df25-49ca-898a-6a99d2d8c1e9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81760) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 16:49:21.689570 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-4da0f7b3-df25-49ca-898a-6a99d2d8c1e9 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:21.691324 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-4da0f7b3-df25-49ca-898a-6a99d2d8c1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:21.840927 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 2/3] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:49:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 518 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 16:49:22.318978 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11798f-587e-4c07-828c-2ce7b26bf6f4 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:22.387506 dv-cinder-779578-5-smb devstack@keystone.service[81761]: INFO dbcounter [None req-bf11798f-587e-4c07-828c-2ce7b26bf6f4 None None] Registered counter for database keystone Aug 24 16:49:22.407164 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG oslo_db.sqlalchemy.engines [None req-bf11798f-587e-4c07-828c-2ce7b26bf6f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81761) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 16:49:22.413293 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writer thread running {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 16:49:22.531992 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11798f-587e-4c07-828c-2ce7b26bf6f4 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:22.536270 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4c8ca5-704d-4c2e-85ac-a263ed187f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:22.536885 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c8ca5-704d-4c2e-85ac-a263ed187f29 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:22.537164 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c8ca5-704d-4c2e-85ac-a263ed187f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:22.537435 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4c8ca5-704d-4c2e-85ac-a263ed187f29 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:22.545520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c8ca5-704d-4c2e-85ac-a263ed187f29 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:22.598353 dv-cinder-779578-5-smb devstack@keystone.service[81761]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2f4c8ca5-704d-4c2e-85ac-a263ed187f29 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 16:49:22.598622 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4c8ca5-704d-4c2e-85ac-a263ed187f29 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:22.609304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 2/4] 10.222.0.55 () {58 vars in 1324 bytes} [Wed Aug 24 16:49:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:49:22.615318 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0f7b3-df25-49ca-898a-6a99d2d8c1e9 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:22.629815 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0f7b3-df25-49ca-898a-6a99d2d8c1e9 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:22.634316 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82d751e-a2d6-4ae7-bd46-2e4e0c8c1525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:22.635440 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d751e-a2d6-4ae7-bd46-2e4e0c8c1525 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:22.635723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d751e-a2d6-4ae7-bd46-2e4e0c8c1525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:22.635996 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82d751e-a2d6-4ae7-bd46-2e4e0c8c1525 admin admin] PATH_INFO: `/v3/projects/f322c406251a41cbaa75ad5201783a99` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:22.637679 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d751e-a2d6-4ae7-bd46-2e4e0c8c1525 admin admin] RBAC: Authorizing `identity:get_project(project_id=f322c406251a41cbaa75ad5201783a99)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:22.690713 dv-cinder-779578-5-smb devstack@keystone.service[81760]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d82d751e-a2d6-4ae7-bd46-2e4e0c8c1525 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 16:49:22.691052 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82d751e-a2d6-4ae7-bd46-2e4e0c8c1525 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:22.695825 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 3/5] 10.222.0.55 () {56 vars in 1207 bytes} [Wed Aug 24 16:49:22 2022] GET /identity/v3/projects/f322c406251a41cbaa75ad5201783a99 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:24.597378 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff597f-7d79-4e71-8812-2e6d2f8e3197 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:24.597945 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff597f-7d79-4e71-8812-2e6d2f8e3197 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:24.597945 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff597f-7d79-4e71-8812-2e6d2f8e3197 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:24.602008 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 3/6] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:49:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:49:24.607583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50f22f-a067-4db4-ab5d-85a8ee8d6d4f None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:24.607986 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50f22f-a067-4db4-ab5d-85a8ee8d6d4f None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:24.608763 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f50f22f-a067-4db4-ab5d-85a8ee8d6d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:24.629001 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-7f50f22f-a067-4db4-ab5d-85a8ee8d6d4f None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:24.630537 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-7f50f22f-a067-4db4-ab5d-85a8ee8d6d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:24.638386 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 4/7] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:49:24 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 24 16:49:24.915161 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff597f-7d79-4e71-8812-2e6d2f8e3197 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:24.927889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff597f-7d79-4e71-8812-2e6d2f8e3197 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:24.932096 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61077ed-deaa-48da-8a39-c15bc54669ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:24.932686 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61077ed-deaa-48da-8a39-c15bc54669ba admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:24.932964 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61077ed-deaa-48da-8a39-c15bc54669ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:24.933237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61077ed-deaa-48da-8a39-c15bc54669ba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:24.941834 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61077ed-deaa-48da-8a39-c15bc54669ba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:24.943907 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61077ed-deaa-48da-8a39-c15bc54669ba admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:24.953710 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 4/8] 10.222.0.55 () {58 vars in 1324 bytes} [Wed Aug 24 16:49:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 16:49:24.959172 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50f22f-a067-4db4-ab5d-85a8ee8d6d4f None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:24.968363 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f50f22f-a067-4db4-ab5d-85a8ee8d6d4f None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:24.972644 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb26dcf0-3359-4c8f-b01b-ff49068f6fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:24.973328 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26dcf0-3359-4c8f-b01b-ff49068f6fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:24.973605 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26dcf0-3359-4c8f-b01b-ff49068f6fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:24.973875 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb26dcf0-3359-4c8f-b01b-ff49068f6fc3 admin admin] PATH_INFO: `/v3/users/7d59f8996a11403d9a7359000be8b8ac` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:24.975202 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26dcf0-3359-4c8f-b01b-ff49068f6fc3 admin admin] RBAC: Authorizing `identity:get_user(user_id=7d59f8996a11403d9a7359000be8b8ac)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:24.977016 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb26dcf0-3359-4c8f-b01b-ff49068f6fc3 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:24.978513 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 5/9] 10.222.0.55 () {56 vars in 1198 bytes} [Wed Aug 24 16:49:24 2022] GET /identity/v3/users/7d59f8996a11403d9a7359000be8b8ac => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:26.966032 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322d111-e3bb-4abd-87c8-904719c318be None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:26.966557 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322d111-e3bb-4abd-87c8-904719c318be None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:26.966557 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322d111-e3bb-4abd-87c8-904719c318be None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:26.968166 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 5/10] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:49:26.973315 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e5ffd-5977-4903-a4ba-20fe1a6eeac4 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:26.973785 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e5ffd-5977-4903-a4ba-20fe1a6eeac4 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:26.973871 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e5ffd-5977-4903-a4ba-20fe1a6eeac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:26.991804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-a00e5ffd-5977-4903-a4ba-20fe1a6eeac4 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:26.992985 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-a00e5ffd-5977-4903-a4ba-20fe1a6eeac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:27.073472 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 6/11] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:49:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:49:27.085565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a56489-7d38-4abc-b285-28f0c83528ee None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:27.085851 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a56489-7d38-4abc-b285-28f0c83528ee None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:27.086124 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a56489-7d38-4abc-b285-28f0c83528ee None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:27.087524 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 6/12] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:49:27.092831 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61926f-30c5-40b8-a81a-02499347565d None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:27.093121 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61926f-30c5-40b8-a81a-02499347565d None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:27.093403 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61926f-30c5-40b8-a81a-02499347565d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:27.111343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-7c61926f-30c5-40b8-a81a-02499347565d None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:27.112540 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-7c61926f-30c5-40b8-a81a-02499347565d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:27.130180 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:27.183467 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 7/13] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:49:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:49:27.340057 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a56489-7d38-4abc-b285-28f0c83528ee None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:27.450080 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61926f-30c5-40b8-a81a-02499347565d None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:27.482585 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a56489-7d38-4abc-b285-28f0c83528ee None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:27.518005 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273912c3-dfa7-48cb-ad9e-915b072b3e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:27.518868 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273912c3-dfa7-48cb-ad9e-915b072b3e50 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:27.519177 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273912c3-dfa7-48cb-ad9e-915b072b3e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:27.519452 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273912c3-dfa7-48cb-ad9e-915b072b3e50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:27.535393 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273912c3-dfa7-48cb-ad9e-915b072b3e50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:49:27.544214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-273912c3-dfa7-48cb-ad9e-915b072b3e50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:49:27.544214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:49:27.544214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:49:27.544214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:49:27.544214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:49:27.544214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:49:27.544214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:49:27.544214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:49:27.544214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:49:27.544214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:49:27.544214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:49:27.544214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:49:27.544214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:49:27.544214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:49:27.544214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:49:27.544214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:49:27.545258 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:49:27.545258 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:49:27.545258 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:49:27.545258 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:49:27.545258 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:49:27.545258 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:49:27.545258 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:49:27.545258 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:49:27.545258 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:49:27.545258 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:49:27.545258 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:49:27.545258 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:49:27.545258 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:49:27.545258 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:49:27.545258 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:49:27.545258 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:49:27.546682 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:49:27.546682 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:49:27.546682 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:49:27.546682 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:49:27.546682 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:49:27.546682 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:49:27.546682 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:49:27.546682 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:49:27.546682 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:49:27.546682 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:49:27.546682 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:49:27.546682 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:49:27.546682 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 7/14] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:49:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:49:27.551219 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61926f-30c5-40b8-a81a-02499347565d None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:27.551842 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273912c3-dfa7-48cb-ad9e-915b072b3e50 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:27.586250 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659eb805-3331-41cc-b609-b7bbbb13f4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:27.588034 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659eb805-3331-41cc-b609-b7bbbb13f4c7 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:27.588034 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659eb805-3331-41cc-b609-b7bbbb13f4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:27.588034 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659eb805-3331-41cc-b609-b7bbbb13f4c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:27.588319 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:27.610608 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:27.655262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659eb805-3331-41cc-b609-b7bbbb13f4c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:27.656826 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659eb805-3331-41cc-b609-b7bbbb13f4c7 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:27.657693 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273912c3-dfa7-48cb-ad9e-915b072b3e50 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:27.692430 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c91587-c646-4b69-917e-73acbebbcfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:27.693597 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c91587-c646-4b69-917e-73acbebbcfb1 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:27.693718 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c91587-c646-4b69-917e-73acbebbcfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:27.693896 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c91587-c646-4b69-917e-73acbebbcfb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:27.694563 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c91587-c646-4b69-917e-73acbebbcfb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:27.694874 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c91587-c646-4b69-917e-73acbebbcfb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:27.696334 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c91587-c646-4b69-917e-73acbebbcfb1 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:27.708146 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 8/15] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:49:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:49:27.713712 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c91587-c646-4b69-917e-73acbebbcfb1 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:27.758512 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 8/16] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:49:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 16:49:27.764401 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659eb805-3331-41cc-b609-b7bbbb13f4c7 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:27.808903 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:27.815065 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c91587-c646-4b69-917e-73acbebbcfb1 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:27.816450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:27.850070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3e0c1-d874-40e8-9728-b50291f36324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:27.850703 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3e0c1-d874-40e8-9728-b50291f36324 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:27.850984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3e0c1-d874-40e8-9728-b50291f36324 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:27.851296 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3e0c1-d874-40e8-9728-b50291f36324 None admin] PATH_INFO: `/v3/users/7d59f8996a11403d9a7359000be8b8ac` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:27.852865 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c3e0c1-d874-40e8-9728-b50291f36324 None admin] RBAC: Authorizing `identity:get_user(user_id=7d59f8996a11403d9a7359000be8b8ac)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:27.856797 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c3e0c1-d874-40e8-9728-b50291f36324 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:27.856797 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 9/17] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:49:27 2022] GET /identity/v3/users/7d59f8996a11403d9a7359000be8b8ac => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:49:27.862683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3e0c1-d874-40e8-9728-b50291f36324 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:27.866223 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659eb805-3331-41cc-b609-b7bbbb13f4c7 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:27.900276 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d38cd-4b81-49f9-bc14-17c4c3eab439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:27.900980 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d38cd-4b81-49f9-bc14-17c4c3eab439 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:27.901270 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d38cd-4b81-49f9-bc14-17c4c3eab439 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:27.901542 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d38cd-4b81-49f9-bc14-17c4c3eab439 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:27.912760 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d38cd-4b81-49f9-bc14-17c4c3eab439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:27.914238 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d38cd-4b81-49f9-bc14-17c4c3eab439 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:27.932814 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-799d38cd-4b81-49f9-bc14-17c4c3eab439 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:49:27.932814 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:49:27.932814 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:49:27.932814 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:49:27.932814 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:49:27.932814 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:49:27.932814 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:49:27.932814 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:49:27.932814 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:49:27.932814 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:49:27.932814 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:49:27.932814 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:49:27.932814 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:49:27.932814 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:49:27.932814 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:49:27.932814 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:49:27.933728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:49:27.933728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:49:27.933728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:49:27.933728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:49:27.933728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:49:27.933728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:49:27.933728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:49:27.933728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:49:27.933728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:49:27.933728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:49:27.933728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:49:27.933728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:49:27.933728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:49:27.933728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:49:27.933728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:49:27.933728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:49:27.933728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:49:27.934515 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:49:27.934515 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:49:27.934515 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:49:27.934515 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 9/18] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:49:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:49:27.939997 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d38cd-4b81-49f9-bc14-17c4c3eab439 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:27.964501 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3e0c1-d874-40e8-9728-b50291f36324 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:27.998704 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be5786-603c-4f14-91d0-2fba47dde0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:27.999438 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be5786-603c-4f14-91d0-2fba47dde0d4 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:27.999544 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be5786-603c-4f14-91d0-2fba47dde0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:27.999791 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be5786-603c-4f14-91d0-2fba47dde0d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:28.001034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be5786-603c-4f14-91d0-2fba47dde0d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:28.002487 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be5786-603c-4f14-91d0-2fba47dde0d4 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:28.004302 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 10/19] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:49:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:49:28.009954 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be5786-603c-4f14-91d0-2fba47dde0d4 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:28.043131 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:28.045657 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d38cd-4b81-49f9-bc14-17c4c3eab439 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:28.048766 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:28.081995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3b441-f0af-46a0-bf8a-aa847fbc141b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:28.082622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3b441-f0af-46a0-bf8a-aa847fbc141b None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:28.082936 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3b441-f0af-46a0-bf8a-aa847fbc141b None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:28.083171 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3b441-f0af-46a0-bf8a-aa847fbc141b None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:28.083827 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3b441-f0af-46a0-bf8a-aa847fbc141b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:28.084126 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3b441-f0af-46a0-bf8a-aa847fbc141b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:28.085540 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f3b441-f0af-46a0-bf8a-aa847fbc141b None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:28.103362 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 10/20] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:49:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:49:28.122225 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be5786-603c-4f14-91d0-2fba47dde0d4 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:28.162960 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e787ca-5600-4fc9-9e39-ba2c4b573bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:28.163619 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e787ca-5600-4fc9-9e39-ba2c4b573bf4 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:28.163905 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e787ca-5600-4fc9-9e39-ba2c4b573bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:28.164176 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e787ca-5600-4fc9-9e39-ba2c4b573bf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:28.164920 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e787ca-5600-4fc9-9e39-ba2c4b573bf4 None admin] RBAC: Adding query filter params (role.id=99f0ace9fc4d4d028ca52fa9730cab4b, scope.domain.id=default, user.id=7d59f8996a11403d9a7359000be8b8ac) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:28.165229 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e787ca-5600-4fc9-9e39-ba2c4b573bf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:28.166721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e787ca-5600-4fc9-9e39-ba2c4b573bf4 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:28.176562 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 11/21] 10.222.0.55 () {56 vars in 1322 bytes} [Wed Aug 24 16:49:28 2022] GET /identity/v3/role_assignments?user.id=7d59f8996a11403d9a7359000be8b8ac&scope.domain.id=default&role.id=99f0ace9fc4d4d028ca52fa9730cab4b => generated 233 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:49:30.406872 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb567c-fa38-46c9-87c4-8e920ccbf6bb None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:30.407841 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb567c-fa38-46c9-87c4-8e920ccbf6bb None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:30.408290 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb567c-fa38-46c9-87c4-8e920ccbf6bb None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:30.410111 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 11/22] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:49:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:49:30.416902 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04194af-70eb-49e5-b76e-f100494a21cb None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:30.417320 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04194af-70eb-49e5-b76e-f100494a21cb None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:30.417460 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04194af-70eb-49e5-b76e-f100494a21cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:30.447020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG passlib.handlers.bcrypt [None req-b04194af-70eb-49e5-b76e-f100494a21cb None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81761) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 16:49:30.447456 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG passlib.handlers.bcrypt [None req-b04194af-70eb-49e5-b76e-f100494a21cb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81761) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 16:49:30.509734 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-b04194af-70eb-49e5-b76e-f100494a21cb None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:30.511344 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-b04194af-70eb-49e5-b76e-f100494a21cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:30.621060 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 12/23] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:49:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:49:30.653037 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4914e-8fef-453b-b1b3-c1d142abae1b None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:30.653664 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4914e-8fef-453b-b1b3-c1d142abae1b None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:30.654153 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4914e-8fef-453b-b1b3-c1d142abae1b None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:30.658207 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 12/24] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:49:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:49:30.663340 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a0cac-f88e-4251-892b-4c70166bd0bd None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:30.663629 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a0cac-f88e-4251-892b-4c70166bd0bd None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:30.663902 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8a0cac-f88e-4251-892b-4c70166bd0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:30.692189 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-1c8a0cac-f88e-4251-892b-4c70166bd0bd None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:30.693687 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-1c8a0cac-f88e-4251-892b-4c70166bd0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:30.723547 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:30.791190 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 13/25] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:49:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:49:30.851929 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edeffc-2352-4d6b-b079-162b23e01545 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:30.852241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edeffc-2352-4d6b-b079-162b23e01545 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:30.852481 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7edeffc-2352-4d6b-b079-162b23e01545 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:30.854110 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 13/26] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:49:30.861360 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4eb7d0-e426-4af3-82d8-6a4023547dc7 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:30.861640 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4eb7d0-e426-4af3-82d8-6a4023547dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:30.861943 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4eb7d0-e426-4af3-82d8-6a4023547dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:30.896237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-dd4eb7d0-e426-4af3-82d8-6a4023547dc7 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:30.897462 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-dd4eb7d0-e426-4af3-82d8-6a4023547dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:30.923909 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466faf31-1d45-4bbd-b6ab-9e79d2a585f3 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:30.924189 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466faf31-1d45-4bbd-b6ab-9e79d2a585f3 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:30.924374 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466faf31-1d45-4bbd-b6ab-9e79d2a585f3 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:30.925911 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 14/27] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:49:30.933824 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a36d7-d169-4203-99ff-de8d4e8830e6 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:30.934104 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a36d7-d169-4203-99ff-de8d4e8830e6 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:30.934377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7a36d7-d169-4203-99ff-de8d4e8830e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:30.969574 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-8d7a36d7-d169-4203-99ff-de8d4e8830e6 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:30.970795 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-8d7a36d7-d169-4203-99ff-de8d4e8830e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:31.046923 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 14/28] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:49:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:49:31.048687 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4eb7d0-e426-4af3-82d8-6a4023547dc7 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:31.120730 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 15/29] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:49:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:49:31.152202 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a36d7-d169-4203-99ff-de8d4e8830e6 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:31.204632 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:31.250450 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4eb7d0-e426-4af3-82d8-6a4023547dc7 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:31.320383 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1c478-9f5d-476a-83ce-f2ab0a1ec6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:31.321975 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1c478-9f5d-476a-83ce-f2ab0a1ec6bc None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:31.322682 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1c478-9f5d-476a-83ce-f2ab0a1ec6bc None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:31.323274 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1c478-9f5d-476a-83ce-f2ab0a1ec6bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:31.344508 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:31.352571 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1c478-9f5d-476a-83ce-f2ab0a1ec6bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:31.354096 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab1c478-9f5d-476a-83ce-f2ab0a1ec6bc None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:31.355471 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7a36d7-d169-4203-99ff-de8d4e8830e6 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:31.382127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-5ab1c478-9f5d-476a-83ce-f2ab0a1ec6bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:49:31.382127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:49:31.382127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:49:31.382127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:49:31.382127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:49:31.382127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:49:31.382127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:49:31.382127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:49:31.382127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:49:31.382127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:49:31.382127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:49:31.382127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:49:31.382127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:49:31.382127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:49:31.382127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:49:31.382127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:49:31.383035 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:49:31.383035 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:49:31.383035 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:49:31.383035 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:49:31.383035 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:49:31.383035 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:49:31.383035 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:49:31.383035 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:49:31.383035 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:49:31.383035 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:49:31.383035 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:49:31.383035 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:49:31.383035 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:49:31.383035 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:49:31.383035 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:49:31.383035 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:49:31.383035 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:49:31.384221 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:49:31.384221 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:49:31.384221 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:49:31.391417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 15/30] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:49:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:49:31.403716 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1c478-9f5d-476a-83ce-f2ab0a1ec6bc None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:31.431891 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6e5c9-32d2-4e16-ac9a-e8ac6d8d7808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:31.433107 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6e5c9-32d2-4e16-ac9a-e8ac6d8d7808 None admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:31.433529 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6e5c9-32d2-4e16-ac9a-e8ac6d8d7808 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:31.433936 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6e5c9-32d2-4e16-ac9a-e8ac6d8d7808 None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:31.434773 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6e5c9-32d2-4e16-ac9a-e8ac6d8d7808 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:31.436448 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6e5c9-32d2-4e16-ac9a-e8ac6d8d7808 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:31.544512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1c478-9f5d-476a-83ce-f2ab0a1ec6bc None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:31.595270 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073257c-f140-4407-b019-0b1fbc3a89df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:31.596507 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073257c-f140-4407-b019-0b1fbc3a89df None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:31.597054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073257c-f140-4407-b019-0b1fbc3a89df None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:31.597531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5073257c-f140-4407-b019-0b1fbc3a89df None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:31.598493 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073257c-f140-4407-b019-0b1fbc3a89df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:31.599010 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073257c-f140-4407-b019-0b1fbc3a89df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:31.600779 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5073257c-f140-4407-b019-0b1fbc3a89df None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:31.615201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:31.624786 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 16/31] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:49:31.626052 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073257c-f140-4407-b019-0b1fbc3a89df None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:31.699167 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 16/32] 10.222.0.55 () {60 vars in 1131 bytes} [Wed Aug 24 16:49:31 2022] POST /identity/v3/roles => generated 219 bytes in 543 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:49:31.699167 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6e5c9-32d2-4e16-ac9a-e8ac6d8d7808 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:31.807665 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5073257c-f140-4407-b019-0b1fbc3a89df None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:31.874250 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078f0f9-b90b-42a1-ae2c-b5bf7327d66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:31.874877 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078f0f9-b90b-42a1-ae2c-b5bf7327d66d None admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:31.876474 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078f0f9-b90b-42a1-ae2c-b5bf7327d66d None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:31.876779 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078f0f9-b90b-42a1-ae2c-b5bf7327d66d None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:31.877486 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078f0f9-b90b-42a1-ae2c-b5bf7327d66d None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:31.878924 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078f0f9-b90b-42a1-ae2c-b5bf7327d66d None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:31.930605 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6e5c9-32d2-4e16-ac9a-e8ac6d8d7808 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:31.982395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474c190-ed6f-43e0-b496-6f51e3e55d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:31.983646 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474c190-ed6f-43e0-b496-6f51e3e55d2a None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:31.983929 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474c190-ed6f-43e0-b496-6f51e3e55d2a None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:31.984204 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1474c190-ed6f-43e0-b496-6f51e3e55d2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:32.000429 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1474c190-ed6f-43e0-b496-6f51e3e55d2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:49:32.006266 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-1474c190-ed6f-43e0-b496-6f51e3e55d2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:49:32.006266 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:49:32.006266 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:49:32.006266 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:49:32.006266 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:49:32.006266 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:49:32.006266 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:49:32.006266 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:49:32.006266 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:49:32.006266 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:49:32.006266 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:49:32.006266 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:49:32.006266 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:49:32.006266 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:49:32.006266 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:49:32.006266 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:49:32.007504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:49:32.007504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:49:32.007504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:49:32.007504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:49:32.007504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:49:32.007504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:49:32.007504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:49:32.007504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:49:32.007504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:49:32.007504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:49:32.007504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:49:32.007504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:49:32.007504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:49:32.007504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:49:32.007504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:49:32.007504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:49:32.008562 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:49:32.008562 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:49:32.008562 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:49:32.008562 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:49:32.008562 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:49:32.008562 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:49:32.008562 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:49:32.008562 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:49:32.008562 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:49:32.008562 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:49:32.008562 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:49:32.008562 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:49:32.008562 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 17/33] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:49:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:49:32.009189 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474c190-ed6f-43e0-b496-6f51e3e55d2a None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:32.026995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:32.104879 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 17/34] 10.222.0.55 () {60 vars in 1131 bytes} [Wed Aug 24 16:49:31 2022] POST /identity/v3/roles => generated 225 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:49:32.106420 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6a23d-82be-4a5b-9f4c-d3a32c37e3b0 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:32.106719 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6a23d-82be-4a5b-9f4c-d3a32c37e3b0 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:32.107045 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6a23d-82be-4a5b-9f4c-d3a32c37e3b0 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:32.114676 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 18/35] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:49:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:49:32.114676 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6a23d-82be-4a5b-9f4c-d3a32c37e3b0 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:32.138969 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1474c190-ed6f-43e0-b496-6f51e3e55d2a None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:32.196013 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb3d47-256f-4489-bd54-3f8eadb44cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:32.196708 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb3d47-256f-4489-bd54-3f8eadb44cd9 None admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:32.198262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb3d47-256f-4489-bd54-3f8eadb44cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:32.198564 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb3d47-256f-4489-bd54-3f8eadb44cd9 None admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:32.199278 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb3d47-256f-4489-bd54-3f8eadb44cd9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:32.202220 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb3d47-256f-4489-bd54-3f8eadb44cd9 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:32.207339 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:32.278666 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6a23d-82be-4a5b-9f4c-d3a32c37e3b0 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:32.323849 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa6294-1776-459f-a6d6-6a634255e80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:32.324537 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa6294-1776-459f-a6d6-6a634255e80e None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:32.324825 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa6294-1776-459f-a6d6-6a634255e80e None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:32.325159 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa6294-1776-459f-a6d6-6a634255e80e None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:32.326419 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa6294-1776-459f-a6d6-6a634255e80e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:32.327259 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa6294-1776-459f-a6d6-6a634255e80e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:32.328836 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa6294-1776-459f-a6d6-6a634255e80e None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:32.341838 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 19/36] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:49:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:32.345529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6590a0c-05aa-4af3-beb0-4ba04a5a6395 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:32.345529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6590a0c-05aa-4af3-beb0-4ba04a5a6395 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:32.345529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6590a0c-05aa-4af3-beb0-4ba04a5a6395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:32.354618 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 18/37] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Aug 24 16:49:32 2022] POST /identity/v3/projects => generated 301 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:49:32.357198 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb3d47-256f-4489-bd54-3f8eadb44cd9 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:32.374474 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-a6590a0c-05aa-4af3-beb0-4ba04a5a6395 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:32.377510 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-a6590a0c-05aa-4af3-beb0-4ba04a5a6395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:32.468151 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:32.470640 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 20/38] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:49:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:49:32.503657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3424fe-5348-45c0-9986-875052ca0624 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:32.504271 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3424fe-5348-45c0-9986-875052ca0624 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:32.504764 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3424fe-5348-45c0-9986-875052ca0624 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:32.506509 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 21/39] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:49:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:49:32.513537 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71219fc-fd09-4b16-8032-4ff622414be5 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:32.514419 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71219fc-fd09-4b16-8032-4ff622414be5 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:32.516781 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71219fc-fd09-4b16-8032-4ff622414be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:32.517657 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb3d47-256f-4489-bd54-3f8eadb44cd9 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:32.534133 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-e71219fc-fd09-4b16-8032-4ff622414be5 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:32.535573 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-e71219fc-fd09-4b16-8032-4ff622414be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:32.557569 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855dc5ec-1ea6-49c8-bc61-02bb066e0132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:32.558339 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855dc5ec-1ea6-49c8-bc61-02bb066e0132 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:32.558623 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855dc5ec-1ea6-49c8-bc61-02bb066e0132 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:32.558901 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855dc5ec-1ea6-49c8-bc61-02bb066e0132 None admin] PATH_INFO: `/v3/users/7d59f8996a11403d9a7359000be8b8ac` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:32.561232 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855dc5ec-1ea6-49c8-bc61-02bb066e0132 None admin] RBAC: Authorizing `identity:get_user(user_id=7d59f8996a11403d9a7359000be8b8ac)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:32.563198 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855dc5ec-1ea6-49c8-bc61-02bb066e0132 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:32.565317 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 19/40] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:49:32 2022] GET /identity/v3/users/7d59f8996a11403d9a7359000be8b8ac => generated 247 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:49:32.571530 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855dc5ec-1ea6-49c8-bc61-02bb066e0132 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:32.601528 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:32.640172 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 22/41] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:49:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:49:32.702630 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855dc5ec-1ea6-49c8-bc61-02bb066e0132 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:32.742894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774e54b-6402-43d3-800e-d21c2c81d296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:32.743616 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774e54b-6402-43d3-800e-d21c2c81d296 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:32.743897 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774e54b-6402-43d3-800e-d21c2c81d296 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:32.744218 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774e54b-6402-43d3-800e-d21c2c81d296 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:32.745363 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774e54b-6402-43d3-800e-d21c2c81d296 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:32.746775 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71219fc-fd09-4b16-8032-4ff622414be5 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:32.746985 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2774e54b-6402-43d3-800e-d21c2c81d296 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:32.748850 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 20/42] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:49:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:49:32.754561 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774e54b-6402-43d3-800e-d21c2c81d296 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:32.757594 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:32.866221 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71219fc-fd09-4b16-8032-4ff622414be5 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:32.875085 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2774e54b-6402-43d3-800e-d21c2c81d296 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:32.905319 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a6af8-b07b-493e-b5a3-d5e3cd419316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:32.905897 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a6af8-b07b-493e-b5a3-d5e3cd419316 None admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:32.906181 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a6af8-b07b-493e-b5a3-d5e3cd419316 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:32.906451 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a6af8-b07b-493e-b5a3-d5e3cd419316 None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:32.907148 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a6af8-b07b-493e-b5a3-d5e3cd419316 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:32.908562 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a6af8-b07b-493e-b5a3-d5e3cd419316 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:32.913065 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f721c-9539-459b-bb4b-f5e1f1c33000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:32.914045 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f721c-9539-459b-bb4b-f5e1f1c33000 None admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:32.914336 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f721c-9539-459b-bb4b-f5e1f1c33000 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:32.914616 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f721c-9539-459b-bb4b-f5e1f1c33000 None admin] PATH_INFO: `/v3/domains/default/users/7d59f8996a11403d9a7359000be8b8ac/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:32.916607 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f721c-9539-459b-bb4b-f5e1f1c33000 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7d59f8996a11403d9a7359000be8b8ac, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:32.918065 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f721c-9539-459b-bb4b-f5e1f1c33000 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:32.988381 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 23/43] 10.222.0.55 () {60 vars in 1131 bytes} [Wed Aug 24 16:49:32 2022] POST /identity/v3/roles => generated 223 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:49:32.989307 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a6af8-b07b-493e-b5a3-d5e3cd419316 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:33.022116 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 21/44] 10.222.0.55 () {58 vars in 1361 bytes} [Wed Aug 24 16:49:32 2022] PUT /identity/v3/domains/default/users/7d59f8996a11403d9a7359000be8b8ac/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:49:33.039969 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:33.118497 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a6af8-b07b-493e-b5a3-d5e3cd419316 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:33.161092 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bccc5-524e-4dde-9f47-6b93e8375186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:33.161820 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bccc5-524e-4dde-9f47-6b93e8375186 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:33.162104 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bccc5-524e-4dde-9f47-6b93e8375186 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:33.162377 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bccc5-524e-4dde-9f47-6b93e8375186 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:33.163965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bccc5-524e-4dde-9f47-6b93e8375186 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:33.165516 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785bccc5-524e-4dde-9f47-6b93e8375186 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:33.167235 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 24/45] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:49:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:33.173639 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f721c-9539-459b-bb4b-f5e1f1c33000 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:33.244729 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:33.285842 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f721c-9539-459b-bb4b-f5e1f1c33000 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:33.320888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48cb00-ac7a-45d0-bdf4-07d6a6f67518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:33.321499 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48cb00-ac7a-45d0-bdf4-07d6a6f67518 None admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:33.321776 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48cb00-ac7a-45d0-bdf4-07d6a6f67518 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:33.322048 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48cb00-ac7a-45d0-bdf4-07d6a6f67518 None admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:33.322706 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48cb00-ac7a-45d0-bdf4-07d6a6f67518 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:33.324210 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c48cb00-ac7a-45d0-bdf4-07d6a6f67518 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:33.409794 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 22/46] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Aug 24 16:49:33 2022] POST /identity/v3/projects => generated 312 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:49:34.962529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6168d48-420f-431e-8a05-b8133378fc03 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:34.963045 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6168d48-420f-431e-8a05-b8133378fc03 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:34.963317 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6168d48-420f-431e-8a05-b8133378fc03 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:34.964471 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 25/47] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:49:34.970809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacabce-98e1-455c-84a7-32acafb961f9 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:34.971241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacabce-98e1-455c-84a7-32acafb961f9 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:34.971588 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efacabce-98e1-455c-84a7-32acafb961f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:35.098237 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-efacabce-98e1-455c-84a7-32acafb961f9 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:35.099815 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-efacabce-98e1-455c-84a7-32acafb961f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:35.169049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 23/48] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:49:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:49:35.331271 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bc813-cc30-4c1d-9b00-f16f3c55e4e4 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:35.331559 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bc813-cc30-4c1d-9b00-f16f3c55e4e4 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:35.331838 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7bc813-cc30-4c1d-9b00-f16f3c55e4e4 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:35.333176 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 26/49] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:49:35.338407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d30b7-7213-45d1-8ac2-05f2c530f68f None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:35.338701 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d30b7-7213-45d1-8ac2-05f2c530f68f None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:35.338980 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d30b7-7213-45d1-8ac2-05f2c530f68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:35.356917 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-4c1d30b7-7213-45d1-8ac2-05f2c530f68f None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:35.358150 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-4c1d30b7-7213-45d1-8ac2-05f2c530f68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:35.399793 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:35.427217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 24/50] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:49:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:49:35.444114 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bc813-cc30-4c1d-9b00-f16f3c55e4e4 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:35.549413 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7bc813-cc30-4c1d-9b00-f16f3c55e4e4 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:35.558390 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:35.584241 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f86271-1764-468a-ad19-fd4a2a4accde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:35.584885 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f86271-1764-468a-ad19-fd4a2a4accde None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:35.585167 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f86271-1764-468a-ad19-fd4a2a4accde None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:35.585524 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f86271-1764-468a-ad19-fd4a2a4accde None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:35.601754 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f86271-1764-468a-ad19-fd4a2a4accde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:49:35.606514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-f2f86271-1764-468a-ad19-fd4a2a4accde None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:49:35.606514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:49:35.606514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:49:35.606514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:49:35.606514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:49:35.606514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:49:35.606514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:49:35.606514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:49:35.606514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:49:35.606514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:49:35.606514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:49:35.606514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:49:35.606514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:49:35.606514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:49:35.606514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:49:35.606514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:49:35.607674 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:49:35.607674 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:49:35.607674 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:49:35.607674 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:49:35.607674 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:49:35.607674 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:49:35.607674 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:49:35.607674 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:49:35.607674 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:49:35.607674 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:49:35.607674 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:49:35.607674 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:49:35.607674 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:49:35.607674 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:49:35.607674 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:49:35.607674 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:49:35.608591 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:49:35.608591 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:49:35.608591 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:49:35.608591 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:49:35.608591 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:49:35.608591 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:49:35.608591 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:49:35.608591 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:49:35.608591 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:49:35.608591 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:49:35.608591 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:49:35.608591 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:49:35.608591 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 27/51] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:49:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:49:35.615383 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d30b7-7213-45d1-8ac2-05f2c530f68f None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:35.698876 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f86271-1764-468a-ad19-fd4a2a4accde None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:35.719788 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d30b7-7213-45d1-8ac2-05f2c530f68f None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:35.758452 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e362e5-2d16-4c41-b6b2-0e2d5f1c034d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:35.759089 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e362e5-2d16-4c41-b6b2-0e2d5f1c034d None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:35.759402 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e362e5-2d16-4c41-b6b2-0e2d5f1c034d None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:35.759676 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e362e5-2d16-4c41-b6b2-0e2d5f1c034d None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:35.760370 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e362e5-2d16-4c41-b6b2-0e2d5f1c034d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:35.760677 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e362e5-2d16-4c41-b6b2-0e2d5f1c034d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:35.762107 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e362e5-2d16-4c41-b6b2-0e2d5f1c034d None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:35.776520 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 25/52] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:49:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:35.783137 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e362e5-2d16-4c41-b6b2-0e2d5f1c034d None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:35.822285 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:35.891220 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e362e5-2d16-4c41-b6b2-0e2d5f1c034d None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:35.914373 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f86271-1764-468a-ad19-fd4a2a4accde None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:35.925109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06689f22-686b-4711-b81e-37465a801d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:35.925755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06689f22-686b-4711-b81e-37465a801d13 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:35.926042 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06689f22-686b-4711-b81e-37465a801d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:35.926323 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06689f22-686b-4711-b81e-37465a801d13 None admin] PATH_INFO: `/v3/users/7d59f8996a11403d9a7359000be8b8ac` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:35.927533 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06689f22-686b-4711-b81e-37465a801d13 None admin] RBAC: Authorizing `identity:get_user(user_id=7d59f8996a11403d9a7359000be8b8ac)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:35.929001 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06689f22-686b-4711-b81e-37465a801d13 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:35.930617 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 26/53] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:49:35 2022] GET /identity/v3/users/7d59f8996a11403d9a7359000be8b8ac => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:49:35.937072 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06689f22-686b-4711-b81e-37465a801d13 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:35.952379 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e955d9-0a78-46d1-9dc7-1b2c2b358223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:35.952948 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e955d9-0a78-46d1-9dc7-1b2c2b358223 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:35.953224 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e955d9-0a78-46d1-9dc7-1b2c2b358223 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:35.953496 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e955d9-0a78-46d1-9dc7-1b2c2b358223 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:35.954612 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e955d9-0a78-46d1-9dc7-1b2c2b358223 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:35.956091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e955d9-0a78-46d1-9dc7-1b2c2b358223 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:35.957677 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 28/54] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:49:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:49:35.963137 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e955d9-0a78-46d1-9dc7-1b2c2b358223 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:35.997595 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:36.039640 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06689f22-686b-4711-b81e-37465a801d13 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:36.041999 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:36.064925 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e955d9-0a78-46d1-9dc7-1b2c2b358223 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:36.079680 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93aeac5-46ff-4973-b1b2-170a367de875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:36.080371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93aeac5-46ff-4973-b1b2-170a367de875 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:36.080659 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93aeac5-46ff-4973-b1b2-170a367de875 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:36.080981 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93aeac5-46ff-4973-b1b2-170a367de875 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:36.082137 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93aeac5-46ff-4973-b1b2-170a367de875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:36.083658 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93aeac5-46ff-4973-b1b2-170a367de875 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:36.085255 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 27/55] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:49:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:49:36.093142 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93aeac5-46ff-4973-b1b2-170a367de875 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:36.100471 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b8127-2040-44e8-99f5-ac44fd5e0eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:36.101099 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b8127-2040-44e8-99f5-ac44fd5e0eb4 None admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:36.101381 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b8127-2040-44e8-99f5-ac44fd5e0eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:36.102094 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b8127-2040-44e8-99f5-ac44fd5e0eb4 None admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:36.102750 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b8127-2040-44e8-99f5-ac44fd5e0eb4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:36.104275 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b8127-2040-44e8-99f5-ac44fd5e0eb4 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:36.191886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93aeac5-46ff-4973-b1b2-170a367de875 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:36.228569 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076ba6fa-15be-4b2a-b7a8-2c0a4d5cab80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:36.229248 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ba6fa-15be-4b2a-b7a8-2c0a4d5cab80 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:36.229547 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ba6fa-15be-4b2a-b7a8-2c0a4d5cab80 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:36.229807 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076ba6fa-15be-4b2a-b7a8-2c0a4d5cab80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:36.230542 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ba6fa-15be-4b2a-b7a8-2c0a4d5cab80 None admin] RBAC: Adding query filter params (role.id=99f0ace9fc4d4d028ca52fa9730cab4b, scope.domain.id=default, user.id=7d59f8996a11403d9a7359000be8b8ac) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:36.230852 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ba6fa-15be-4b2a-b7a8-2c0a4d5cab80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:36.232345 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076ba6fa-15be-4b2a-b7a8-2c0a4d5cab80 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:36.240084 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 28/56] 10.222.0.55 () {56 vars in 1322 bytes} [Wed Aug 24 16:49:36 2022] GET /identity/v3/role_assignments?user.id=7d59f8996a11403d9a7359000be8b8ac&scope.domain.id=default&role.id=99f0ace9fc4d4d028ca52fa9730cab4b => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:49:36.257775 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 29/57] 10.222.0.55 () {60 vars in 1140 bytes} [Wed Aug 24 16:49:35 2022] POST /identity/v3/projects => generated 298 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:49:38.225247 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615709b9-d617-44d8-8a2c-399e1d3bfd26 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:38.225755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615709b9-d617-44d8-8a2c-399e1d3bfd26 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:38.225755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615709b9-d617-44d8-8a2c-399e1d3bfd26 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:38.227044 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 29/58] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:49:38.233047 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a68e07-6997-4a9f-a895-c3985a56bc9b None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:38.233569 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a68e07-6997-4a9f-a895-c3985a56bc9b None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:38.233918 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a68e07-6997-4a9f-a895-c3985a56bc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:38.251901 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-38a68e07-6997-4a9f-a895-c3985a56bc9b None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:38.253120 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-38a68e07-6997-4a9f-a895-c3985a56bc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:38.322897 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 30/59] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:49:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:49:38.597055 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615709b9-d617-44d8-8a2c-399e1d3bfd26 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:38.633670 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:38.700511 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615709b9-d617-44d8-8a2c-399e1d3bfd26 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:38.734387 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89589f-1383-4da9-82ce-aceb4135327b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:38.735010 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89589f-1383-4da9-82ce-aceb4135327b None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:38.735314 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89589f-1383-4da9-82ce-aceb4135327b None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:38.735586 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89589f-1383-4da9-82ce-aceb4135327b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:38.736695 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89589f-1383-4da9-82ce-aceb4135327b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:38.738129 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89589f-1383-4da9-82ce-aceb4135327b None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:38.739713 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 30/60] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:49:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:38.745264 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a68e07-6997-4a9f-a895-c3985a56bc9b None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:38.763963 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:38.845745 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a68e07-6997-4a9f-a895-c3985a56bc9b None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:38.880938 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb43c11-7941-4c1d-9473-ddb9aac93703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:38.881561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb43c11-7941-4c1d-9473-ddb9aac93703 None admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:38.881842 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb43c11-7941-4c1d-9473-ddb9aac93703 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:38.882116 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb43c11-7941-4c1d-9473-ddb9aac93703 None admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:38.882820 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb43c11-7941-4c1d-9473-ddb9aac93703 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:38.884291 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb43c11-7941-4c1d-9473-ddb9aac93703 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:38.981041 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 31/61] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Aug 24 16:49:38 2022] POST /identity/v3/users => generated 275 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:49:42.096353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcc5ff-9651-4eef-9a6a-88afd74fdedc None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:42.097372 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcc5ff-9651-4eef-9a6a-88afd74fdedc None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:42.097858 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bcc5ff-9651-4eef-9a6a-88afd74fdedc None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:42.099462 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 31/62] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:49:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:49:42.105137 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe950807-4898-49a9-9a4f-e99b81d5ba9e None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:42.105985 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe950807-4898-49a9-9a4f-e99b81d5ba9e None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:42.106453 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe950807-4898-49a9-9a4f-e99b81d5ba9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:42.134282 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-fe950807-4898-49a9-9a4f-e99b81d5ba9e None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:42.135833 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-fe950807-4898-49a9-9a4f-e99b81d5ba9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:42.216529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 32/63] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:49:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:49:42.307697 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e1ed3-4373-4439-99f4-220ac77289ea None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:42.308313 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e1ed3-4373-4439-99f4-220ac77289ea None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:42.308782 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e1ed3-4373-4439-99f4-220ac77289ea None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:42.310638 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 32/64] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:49:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:49:42.313692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e96bc5-a49f-4197-bafa-83782f640288 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:42.313985 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e96bc5-a49f-4197-bafa-83782f640288 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:42.314338 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e96bc5-a49f-4197-bafa-83782f640288 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:42.315728 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 33/65] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:49:42.316046 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea48f3-1f6a-44f1-8255-5263b2169d51 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:42.316553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea48f3-1f6a-44f1-8255-5263b2169d51 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:42.317282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea48f3-1f6a-44f1-8255-5263b2169d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:42.321294 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2477a-0734-4e2a-8043-8b4052d64eb8 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:42.321792 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2477a-0734-4e2a-8043-8b4052d64eb8 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:42.322235 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2477a-0734-4e2a-8043-8b4052d64eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:42.332538 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:42.350989 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-9aea48f3-1f6a-44f1-8255-5263b2169d51 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:42.355052 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-e4b2477a-0734-4e2a-8043-8b4052d64eb8 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:42.356401 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-9aea48f3-1f6a-44f1-8255-5263b2169d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:42.360244 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-e4b2477a-0734-4e2a-8043-8b4052d64eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:42.487665 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 33/66] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:49:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:49:42.502420 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 34/67] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:49:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:49:42.546273 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea48f3-1f6a-44f1-8255-5263b2169d51 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:42.599321 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:42.692163 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6be2b-7f06-4c3a-a0f1-1a95189df79f None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:42.692777 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6be2b-7f06-4c3a-a0f1-1a95189df79f None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:42.693130 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea48f3-1f6a-44f1-8255-5263b2169d51 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:42.693511 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6be2b-7f06-4c3a-a0f1-1a95189df79f None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:42.695190 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 35/68] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:49:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:49:42.712731 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af6f6f-cad1-4968-b690-8b07a1c83ad5 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:42.713374 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af6f6f-cad1-4968-b690-8b07a1c83ad5 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:42.713846 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af6f6f-cad1-4968-b690-8b07a1c83ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:42.740928 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-75af6f6f-cad1-4968-b690-8b07a1c83ad5 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:42.743304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-75af6f6f-cad1-4968-b690-8b07a1c83ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:42.767262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466b376-f617-4a26-9b6f-9ee02ef799eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:42.768319 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466b376-f617-4a26-9b6f-9ee02ef799eb None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:42.768608 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466b376-f617-4a26-9b6f-9ee02ef799eb None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:42.768887 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2466b376-f617-4a26-9b6f-9ee02ef799eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:42.783953 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2466b376-f617-4a26-9b6f-9ee02ef799eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:49:42.789977 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-2466b376-f617-4a26-9b6f-9ee02ef799eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:49:42.789977 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:49:42.789977 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:49:42.789977 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:49:42.789977 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:49:42.789977 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:49:42.789977 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:49:42.789977 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:49:42.789977 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:49:42.789977 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:49:42.789977 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:49:42.789977 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:49:42.789977 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:49:42.789977 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:49:42.789977 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:49:42.789977 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:49:42.790836 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:49:42.790836 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:49:42.790836 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:49:42.790836 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:49:42.790836 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:49:42.790836 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:49:42.790836 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:49:42.790836 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:49:42.790836 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:49:42.790836 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:49:42.790836 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:49:42.790836 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:49:42.790836 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:49:42.790836 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:49:42.790836 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:49:42.790836 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:49:42.791621 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:49:42.791621 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:49:42.791621 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:49:42.791621 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:49:42.791621 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:49:42.791621 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:49:42.791621 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:49:42.791621 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:49:42.791621 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:49:42.791621 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:49:42.791621 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:49:42.791621 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:49:42.791621 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 34/69] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:49:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:49:42.792255 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466b376-f617-4a26-9b6f-9ee02ef799eb None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:42.822661 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 36/70] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:49:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:49:42.832170 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af6f6f-cad1-4968-b690-8b07a1c83ad5 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:42.907532 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:42.908112 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:42.915094 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2466b376-f617-4a26-9b6f-9ee02ef799eb None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:42.948094 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af6f6f-cad1-4968-b690-8b07a1c83ad5 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:42.953764 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f687f-2f8f-4885-af0d-4cd2b9f4a270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:42.954406 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f687f-2f8f-4885-af0d-4cd2b9f4a270 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:42.954694 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f687f-2f8f-4885-af0d-4cd2b9f4a270 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:42.954970 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f687f-2f8f-4885-af0d-4cd2b9f4a270 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:42.965321 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f687f-2f8f-4885-af0d-4cd2b9f4a270 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:49:42.970474 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-f11f687f-2f8f-4885-af0d-4cd2b9f4a270 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:49:42.970474 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:49:42.970474 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:49:42.970474 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:49:42.970474 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:49:42.970474 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:49:42.970474 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:49:42.970474 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:49:42.970474 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:49:42.970474 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:49:42.970474 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:49:42.970474 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:49:42.970474 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:49:42.970474 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:49:42.970474 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:49:42.970474 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:49:42.971444 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:49:42.971444 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:49:42.971444 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:49:42.971444 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:49:42.971444 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:49:42.971444 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:49:42.971444 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:49:42.971444 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:49:42.971444 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:49:42.971444 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:49:42.971444 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:49:42.971444 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:49:42.971444 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:49:42.971444 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:49:42.971444 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:49:42.971444 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:49:42.972693 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:49:42.972693 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:49:42.972693 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:49:42.972693 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:49:42.972693 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:49:42.972693 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:49:42.972693 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:49:42.972693 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:49:42.972693 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:49:42.972693 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:49:42.972693 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:49:42.972693 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:49:42.972693 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 35/71] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Aug 24 16:49:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:49:42.972693 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f687f-2f8f-4885-af0d-4cd2b9f4a270 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:42.990644 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060e182-8d40-4998-afad-3b375c72da96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:42.991422 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060e182-8d40-4998-afad-3b375c72da96 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:42.991653 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060e182-8d40-4998-afad-3b375c72da96 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:42.991933 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060e182-8d40-4998-afad-3b375c72da96 None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:42.992606 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2060e182-8d40-4998-afad-3b375c72da96 None admin] RBAC: Adding query filter params (name=member) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:42.992917 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2060e182-8d40-4998-afad-3b375c72da96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:42.994307 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2060e182-8d40-4998-afad-3b375c72da96 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:43.003853 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 37/72] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Aug 24 16:49:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:43.005146 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6925228-8f6f-4b7d-a466-2ab84e1e006a None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:43.005435 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6925228-8f6f-4b7d-a466-2ab84e1e006a None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:43.005710 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6925228-8f6f-4b7d-a466-2ab84e1e006a None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:43.011067 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 38/73] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:49:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:49:43.011067 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6925228-8f6f-4b7d-a466-2ab84e1e006a None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:43.092945 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f687f-2f8f-4885-af0d-4cd2b9f4a270 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:43.116625 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6925228-8f6f-4b7d-a466-2ab84e1e006a None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:43.128400 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada336bb-b941-460e-8be2-081beabe3e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:43.129037 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada336bb-b941-460e-8be2-081beabe3e10 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:43.129321 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada336bb-b941-460e-8be2-081beabe3e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:43.129595 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada336bb-b941-460e-8be2-081beabe3e10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:43.140157 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada336bb-b941-460e-8be2-081beabe3e10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:49:43.143731 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:43.145367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-ada336bb-b941-460e-8be2-081beabe3e10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:49:43.145367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:49:43.145367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:49:43.145367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:49:43.145367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:49:43.145367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:49:43.145367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:49:43.145367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:49:43.145367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:49:43.145367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:49:43.145367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:49:43.145367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:49:43.145367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:49:43.145367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:49:43.145367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:49:43.145367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:49:43.146366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:49:43.146366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:49:43.146366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:49:43.146366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:49:43.146366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:49:43.146366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:49:43.146366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:49:43.146366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:49:43.146366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:49:43.146366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:49:43.146366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:49:43.146366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:49:43.146366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:49:43.146366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:49:43.146366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:49:43.146366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:49:43.147468 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:49:43.147468 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:49:43.147468 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:49:43.147468 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:49:43.147468 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:49:43.147468 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:49:43.147468 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:49:43.147468 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:49:43.147468 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:49:43.147468 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:49:43.147468 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:49:43.147468 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:49:43.147468 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 36/74] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:49:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:49:43.147468 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada336bb-b941-460e-8be2-081beabe3e10 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:43.155884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76373f35-5ad1-4774-82e9-53a813108e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:43.156507 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76373f35-5ad1-4774-82e9-53a813108e3e None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:43.156791 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76373f35-5ad1-4774-82e9-53a813108e3e None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:43.157070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76373f35-5ad1-4774-82e9-53a813108e3e None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:43.157735 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76373f35-5ad1-4774-82e9-53a813108e3e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:43.158042 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76373f35-5ad1-4774-82e9-53a813108e3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:43.159460 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76373f35-5ad1-4774-82e9-53a813108e3e None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:43.163225 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:43.167870 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 39/75] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:49:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:43.170831 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4addde-e93b-47e6-bcf7-cbee2b5dae0a None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:43.171069 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4addde-e93b-47e6-bcf7-cbee2b5dae0a None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:43.171382 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4addde-e93b-47e6-bcf7-cbee2b5dae0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:43.189883 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-ee4addde-e93b-47e6-bcf7-cbee2b5dae0a None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:43.191103 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-ee4addde-e93b-47e6-bcf7-cbee2b5dae0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:43.249758 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada336bb-b941-460e-8be2-081beabe3e10 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:43.269287 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 40/76] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:49:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:49:43.269287 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4addde-e93b-47e6-bcf7-cbee2b5dae0a None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:43.287440 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f611b-077e-4667-b052-b515b4d7423a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:43.288074 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f611b-077e-4667-b052-b515b4d7423a None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:43.288626 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f611b-077e-4667-b052-b515b4d7423a None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:43.288626 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f611b-077e-4667-b052-b515b4d7423a None admin] PATH_INFO: `/v3/users/62ccc5c8c0c14b0588bb574681eadcf6` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:43.302855 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f611b-077e-4667-b052-b515b4d7423a None admin] RBAC: Authorizing `identity:get_user(user_id=62ccc5c8c0c14b0588bb574681eadcf6)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:43.304366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0f611b-077e-4667-b052-b515b4d7423a None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:43.305995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 37/77] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:49:43 2022] GET /identity/v3/users/62ccc5c8c0c14b0588bb574681eadcf6 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:43.306751 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f611b-077e-4667-b052-b515b4d7423a None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:43.375804 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4addde-e93b-47e6-bcf7-cbee2b5dae0a None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:43.386186 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:43.400066 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:43.417369 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05918633-e094-4934-8c4a-e7a42b3fc92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:43.418015 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05918633-e094-4934-8c4a-e7a42b3fc92d None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:43.418298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05918633-e094-4934-8c4a-e7a42b3fc92d None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:43.419005 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05918633-e094-4934-8c4a-e7a42b3fc92d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:43.420363 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05918633-e094-4934-8c4a-e7a42b3fc92d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:43.420553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f611b-077e-4667-b052-b515b4d7423a None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:43.421841 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05918633-e094-4934-8c4a-e7a42b3fc92d None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:43.423503 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 41/78] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:49:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:43.428039 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05918633-e094-4934-8c4a-e7a42b3fc92d None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:43.461563 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdccda33-847c-4ba8-aaf7-4909108c1d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:43.462177 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccda33-847c-4ba8-aaf7-4909108c1d3e None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:43.462450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccda33-847c-4ba8-aaf7-4909108c1d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:43.462719 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdccda33-847c-4ba8-aaf7-4909108c1d3e None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:43.463422 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdccda33-847c-4ba8-aaf7-4909108c1d3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:43.463722 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdccda33-847c-4ba8-aaf7-4909108c1d3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:43.465100 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdccda33-847c-4ba8-aaf7-4909108c1d3e None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:43.474135 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 38/79] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:49:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:43.479437 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdccda33-847c-4ba8-aaf7-4909108c1d3e None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:43.533281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05918633-e094-4934-8c4a-e7a42b3fc92d None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:43.566588 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ecb2f-994a-492a-b11e-04731a0a9939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:43.567494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ecb2f-994a-492a-b11e-04731a0a9939 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:43.567784 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ecb2f-994a-492a-b11e-04731a0a9939 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:43.568058 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78ecb2f-994a-492a-b11e-04731a0a9939 None admin] PATH_INFO: `/v3/users/62ccc5c8c0c14b0588bb574681eadcf6` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:43.569430 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ecb2f-994a-492a-b11e-04731a0a9939 None admin] RBAC: Authorizing `identity:get_user(user_id=62ccc5c8c0c14b0588bb574681eadcf6)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:43.570871 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78ecb2f-994a-492a-b11e-04731a0a9939 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:43.572502 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 42/80] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:49:43 2022] GET /identity/v3/users/62ccc5c8c0c14b0588bb574681eadcf6 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:43.573244 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ecb2f-994a-492a-b11e-04731a0a9939 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:43.595079 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdccda33-847c-4ba8-aaf7-4909108c1d3e None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:43.628892 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4e187-9fc8-46b9-8fbf-32525385e8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:43.629499 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4e187-9fc8-46b9-8fbf-32525385e8e7 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:43.629609 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:43.629775 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4e187-9fc8-46b9-8fbf-32525385e8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:43.630282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4e187-9fc8-46b9-8fbf-32525385e8e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:43.632708 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:43.678150 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78ecb2f-994a-492a-b11e-04731a0a9939 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:43.698873 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4e187-9fc8-46b9-8fbf-32525385e8e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:43.700464 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4e187-9fc8-46b9-8fbf-32525385e8e7 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:43.712163 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903b5f0-9cdd-4261-80c4-c3e083fb6581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:43.712772 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903b5f0-9cdd-4261-80c4-c3e083fb6581 None admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:43.713060 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903b5f0-9cdd-4261-80c4-c3e083fb6581 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:43.713332 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903b5f0-9cdd-4261-80c4-c3e083fb6581 None admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:43.713970 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903b5f0-9cdd-4261-80c4-c3e083fb6581 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:43.715437 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903b5f0-9cdd-4261-80c4-c3e083fb6581 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:43.800100 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 43/81] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Aug 24 16:49:43 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:49:43.801145 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903b5f0-9cdd-4261-80c4-c3e083fb6581 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:43.810191 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 39/82] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:49:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:43.810191 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4e187-9fc8-46b9-8fbf-32525385e8e7 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:43.876561 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:43.942549 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903b5f0-9cdd-4261-80c4-c3e083fb6581 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:43.956025 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:43.970701 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4e187-9fc8-46b9-8fbf-32525385e8e7 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:43.992135 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0b4b8-f73a-4275-b3aa-c8d5faa27d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:43.992135 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0b4b8-f73a-4275-b3aa-c8d5faa27d1d None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:43.992556 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0b4b8-f73a-4275-b3aa-c8d5faa27d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:43.992695 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0b4b8-f73a-4275-b3aa-c8d5faa27d1d None admin] PATH_INFO: `/v3/users/7d59f8996a11403d9a7359000be8b8ac` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:43.995885 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a0b4b8-f73a-4275-b3aa-c8d5faa27d1d None admin] RBAC: Authorizing `identity:get_user(user_id=7d59f8996a11403d9a7359000be8b8ac)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:43.996800 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a0b4b8-f73a-4275-b3aa-c8d5faa27d1d None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:43.999407 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 44/83] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:49:43 2022] GET /identity/v3/users/7d59f8996a11403d9a7359000be8b8ac => generated 247 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:43.999877 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0b4b8-f73a-4275-b3aa-c8d5faa27d1d None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:44.025390 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15315544-21f4-4458-a2e4-78f1ff683928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:44.026043 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15315544-21f4-4458-a2e4-78f1ff683928 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:44.026802 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15315544-21f4-4458-a2e4-78f1ff683928 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:44.026802 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15315544-21f4-4458-a2e4-78f1ff683928 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:44.040242 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15315544-21f4-4458-a2e4-78f1ff683928 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:49:44.045477 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-15315544-21f4-4458-a2e4-78f1ff683928 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:49:44.045477 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:49:44.045477 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:49:44.045477 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:49:44.045477 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:49:44.045477 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:49:44.045477 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:49:44.045477 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:49:44.045477 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:49:44.045477 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:49:44.045477 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:49:44.045477 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:49:44.045477 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:49:44.045477 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:49:44.045477 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:49:44.045477 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:49:44.046407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:49:44.046407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:49:44.046407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:49:44.046407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:49:44.046407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:49:44.046407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:49:44.046407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:49:44.046407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:49:44.046407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:49:44.046407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:49:44.046407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:49:44.046407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:49:44.046407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:49:44.046407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:49:44.046407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:49:44.046407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:49:44.047366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:49:44.047366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:49:44.047366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:49:44.047366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:49:44.047366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:49:44.047366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:49:44.047366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:49:44.047366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:49:44.047366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:49:44.047366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:49:44.047366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:49:44.047366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:49:44.047366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 40/84] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:49:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:49:44.048093 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15315544-21f4-4458-a2e4-78f1ff683928 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:44.136056 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0b4b8-f73a-4275-b3aa-c8d5faa27d1d None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:44.174518 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:44.179655 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c490608-8ff7-414d-a85e-64fe017139e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:44.180278 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c490608-8ff7-414d-a85e-64fe017139e9 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:44.180555 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c490608-8ff7-414d-a85e-64fe017139e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:44.180832 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c490608-8ff7-414d-a85e-64fe017139e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:44.182848 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15315544-21f4-4458-a2e4-78f1ff683928 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:44.229640 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724439f8-4a61-4250-afc9-e46b02974c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:44.230453 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724439f8-4a61-4250-afc9-e46b02974c27 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:44.230849 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724439f8-4a61-4250-afc9-e46b02974c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:44.231248 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724439f8-4a61-4250-afc9-e46b02974c27 None admin] PATH_INFO: `/v3/projects/bdf2d550302d4cafb7d454c50b6794c7` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:44.233258 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724439f8-4a61-4250-afc9-e46b02974c27 None admin] RBAC: Authorizing `identity:get_project(project_id=bdf2d550302d4cafb7d454c50b6794c7)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:44.234810 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724439f8-4a61-4250-afc9-e46b02974c27 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:44.236588 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 41/85] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:49:44 2022] GET /identity/v3/projects/bdf2d550302d4cafb7d454c50b6794c7 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:44.237198 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:44.237501 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724439f8-4a61-4250-afc9-e46b02974c27 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:44.260149 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c490608-8ff7-414d-a85e-64fe017139e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:44.261630 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c490608-8ff7-414d-a85e-64fe017139e9 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:44.345721 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724439f8-4a61-4250-afc9-e46b02974c27 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:44.378758 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 45/86] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:49:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:44.379654 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c490608-8ff7-414d-a85e-64fe017139e9 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:44.382705 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae321c0f-ec45-4bc7-9a20-4962696b8aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:44.383716 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae321c0f-ec45-4bc7-9a20-4962696b8aad None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:44.383996 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae321c0f-ec45-4bc7-9a20-4962696b8aad None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:44.384271 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae321c0f-ec45-4bc7-9a20-4962696b8aad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:44.417900 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:44.459867 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae321c0f-ec45-4bc7-9a20-4962696b8aad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:44.461359 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae321c0f-ec45-4bc7-9a20-4962696b8aad None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:44.477235 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:44.501676 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c490608-8ff7-414d-a85e-64fe017139e9 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:44.540408 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f2389-2020-4672-bb9d-1a8705303082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:44.541263 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f2389-2020-4672-bb9d-1a8705303082 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:44.541682 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f2389-2020-4672-bb9d-1a8705303082 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:44.542090 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f2389-2020-4672-bb9d-1a8705303082 None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:44.542894 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f2389-2020-4672-bb9d-1a8705303082 None admin] RBAC: Adding query filter params (name=member) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:44.543387 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f2389-2020-4672-bb9d-1a8705303082 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:44.544964 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f2389-2020-4672-bb9d-1a8705303082 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:44.554077 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 46/87] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Aug 24 16:49:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:44.555087 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f2389-2020-4672-bb9d-1a8705303082 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:44.572032 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 42/88] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:49:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:44.577740 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae321c0f-ec45-4bc7-9a20-4962696b8aad None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:44.648624 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:44.664876 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f2389-2020-4672-bb9d-1a8705303082 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:44.689906 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae321c0f-ec45-4bc7-9a20-4962696b8aad None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:44.704093 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0372c52-5fd2-475f-ac6a-a4afe8f6eb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:44.704967 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0372c52-5fd2-475f-ac6a-a4afe8f6eb63 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:44.705409 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0372c52-5fd2-475f-ac6a-a4afe8f6eb63 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:44.705822 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0372c52-5fd2-475f-ac6a-a4afe8f6eb63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:44.706713 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0372c52-5fd2-475f-ac6a-a4afe8f6eb63 None admin] RBAC: Adding query filter params (role.id=d886d117c82147e6a6488228fee2ac8b, scope.project.id=bdf2d550302d4cafb7d454c50b6794c7, user.id=62ccc5c8c0c14b0588bb574681eadcf6) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:44.707200 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0372c52-5fd2-475f-ac6a-a4afe8f6eb63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:44.708824 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0372c52-5fd2-475f-ac6a-a4afe8f6eb63 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:44.715396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 47/89] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:49:44 2022] GET /identity/v3/role_assignments?user.id=62ccc5c8c0c14b0588bb574681eadcf6&scope.project.id=bdf2d550302d4cafb7d454c50b6794c7&role.id=d886d117c82147e6a6488228fee2ac8b => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:44.717031 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0372c52-5fd2-475f-ac6a-a4afe8f6eb63 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:44.730625 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:44.747142 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecdcbc-5828-40ea-9c53-925634954aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:44.747142 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecdcbc-5828-40ea-9c53-925634954aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:44.747142 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecdcbc-5828-40ea-9c53-925634954aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:44.747142 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecdcbc-5828-40ea-9c53-925634954aa3 None admin] PATH_INFO: `/v3/projects/bdf2d550302d4cafb7d454c50b6794c7` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:44.748022 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecdcbc-5828-40ea-9c53-925634954aa3 None admin] RBAC: Authorizing `identity:get_project(project_id=bdf2d550302d4cafb7d454c50b6794c7)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:44.748022 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecdcbc-5828-40ea-9c53-925634954aa3 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:44.748717 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 43/90] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:49:44 2022] GET /identity/v3/projects/bdf2d550302d4cafb7d454c50b6794c7 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:44.749613 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecdcbc-5828-40ea-9c53-925634954aa3 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:44.878166 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecdcbc-5828-40ea-9c53-925634954aa3 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:44.935450 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0372c52-5fd2-475f-ac6a-a4afe8f6eb63 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:44.949052 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:44.957192 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facd07a-7868-4ee6-b471-5124c598b97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:44.958006 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facd07a-7868-4ee6-b471-5124c598b97d None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:44.958221 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facd07a-7868-4ee6-b471-5124c598b97d None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:44.958495 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facd07a-7868-4ee6-b471-5124c598b97d None admin] PATH_INFO: `/v3/projects/bdf2d550302d4cafb7d454c50b6794c7` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:44.959824 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facd07a-7868-4ee6-b471-5124c598b97d None admin] RBAC: Authorizing `identity:get_project(project_id=bdf2d550302d4cafb7d454c50b6794c7)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:44.969670 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facd07a-7868-4ee6-b471-5124c598b97d None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:44.969670 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 44/91] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:49:44 2022] GET /identity/v3/projects/bdf2d550302d4cafb7d454c50b6794c7 => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:44.969670 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facd07a-7868-4ee6-b471-5124c598b97d None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:44.996196 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab6ff5-7d11-4aba-b336-00a0f0c422ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:44.996991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab6ff5-7d11-4aba-b336-00a0f0c422ff None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:44.997339 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab6ff5-7d11-4aba-b336-00a0f0c422ff None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:44.997755 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab6ff5-7d11-4aba-b336-00a0f0c422ff None admin] PATH_INFO: `/v3/users/62ccc5c8c0c14b0588bb574681eadcf6` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:45.000124 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab6ff5-7d11-4aba-b336-00a0f0c422ff None admin] RBAC: Authorizing `identity:get_user(user_id=62ccc5c8c0c14b0588bb574681eadcf6)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:45.001410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab6ff5-7d11-4aba-b336-00a0f0c422ff None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:45.003485 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 48/92] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:49:44 2022] GET /identity/v3/users/62ccc5c8c0c14b0588bb574681eadcf6 => generated 275 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:45.004807 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab6ff5-7d11-4aba-b336-00a0f0c422ff None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:45.099599 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:45.119527 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab6ff5-7d11-4aba-b336-00a0f0c422ff None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:45.158736 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae4783-13bb-479b-b6b5-52e12d15f5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:45.160325 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae4783-13bb-479b-b6b5-52e12d15f5d6 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:45.160609 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae4783-13bb-479b-b6b5-52e12d15f5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:45.160887 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ae4783-13bb-479b-b6b5-52e12d15f5d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:45.161631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae4783-13bb-479b-b6b5-52e12d15f5d6 None admin] RBAC: Adding query filter params (role.id=99f0ace9fc4d4d028ca52fa9730cab4b, scope.project.id=bdf2d550302d4cafb7d454c50b6794c7, user.id=7d59f8996a11403d9a7359000be8b8ac) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:45.161945 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae4783-13bb-479b-b6b5-52e12d15f5d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:45.163594 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ae4783-13bb-479b-b6b5-52e12d15f5d6 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:45.170349 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 49/93] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:49:45 2022] GET /identity/v3/role_assignments?user.id=7d59f8996a11403d9a7359000be8b8ac&scope.project.id=bdf2d550302d4cafb7d454c50b6794c7&role.id=99f0ace9fc4d4d028ca52fa9730cab4b => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:45.171336 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae4783-13bb-479b-b6b5-52e12d15f5d6 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:45.269291 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facd07a-7868-4ee6-b471-5124c598b97d None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:45.299924 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ae4783-13bb-479b-b6b5-52e12d15f5d6 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:45.339715 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a7a83-41ff-4adb-8b43-e57ad58d6cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:45.340981 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a7a83-41ff-4adb-8b43-e57ad58d6cdd None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:45.341836 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a7a83-41ff-4adb-8b43-e57ad58d6cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:45.342149 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a7a83-41ff-4adb-8b43-e57ad58d6cdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:45.347470 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:45.388844 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c28ea-8652-43c8-b7e8-9db3bc428e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:45.389636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c28ea-8652-43c8-b7e8-9db3bc428e11 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:45.389924 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c28ea-8652-43c8-b7e8-9db3bc428e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:45.390202 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c28ea-8652-43c8-b7e8-9db3bc428e11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:45.391542 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c28ea-8652-43c8-b7e8-9db3bc428e11 None admin] RBAC: Adding query filter params (role.id=1c6cc7bf29b146b0a9aaf6a07607258a, scope.project.id=bdf2d550302d4cafb7d454c50b6794c7, user.id=62ccc5c8c0c14b0588bb574681eadcf6) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:45.391865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c28ea-8652-43c8-b7e8-9db3bc428e11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:45.393380 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1c28ea-8652-43c8-b7e8-9db3bc428e11 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:45.406197 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 45/94] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:49:44 2022] GET /identity/v3/role_assignments?user.id=62ccc5c8c0c14b0588bb574681eadcf6&scope.project.id=bdf2d550302d4cafb7d454c50b6794c7&role.id=1c6cc7bf29b146b0a9aaf6a07607258a => generated 259 bytes in 441 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:45.445140 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a7a83-41ff-4adb-8b43-e57ad58d6cdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:45.446641 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5a7a83-41ff-4adb-8b43-e57ad58d6cdd None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:45.576163 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 50/95] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:49:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:45.583135 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c28ea-8652-43c8-b7e8-9db3bc428e11 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:45.667552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:45.724857 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c28ea-8652-43c8-b7e8-9db3bc428e11 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:45.769837 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a1afc2-2eff-4bd7-9707-2b5e1de5333c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:45.770506 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1afc2-2eff-4bd7-9707-2b5e1de5333c None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:45.770791 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1afc2-2eff-4bd7-9707-2b5e1de5333c None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:45.771074 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a1afc2-2eff-4bd7-9707-2b5e1de5333c None admin] PATH_INFO: `/v3/projects/4d008c89fba44ef892f4209f4db58053` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:45.772302 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1afc2-2eff-4bd7-9707-2b5e1de5333c None admin] RBAC: Authorizing `identity:get_project(project_id=4d008c89fba44ef892f4209f4db58053)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:45.773802 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a1afc2-2eff-4bd7-9707-2b5e1de5333c None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:45.775826 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 46/96] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:49:45 2022] GET /identity/v3/projects/4d008c89fba44ef892f4209f4db58053 => generated 312 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:45.781866 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a7a83-41ff-4adb-8b43-e57ad58d6cdd None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:45.822562 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:45.914575 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a7a83-41ff-4adb-8b43-e57ad58d6cdd None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:45.962693 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610caa6-40ef-43af-9a33-8d2b3f96c0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:45.963356 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610caa6-40ef-43af-9a33-8d2b3f96c0bb None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:45.963644 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610caa6-40ef-43af-9a33-8d2b3f96c0bb None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:45.963923 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610caa6-40ef-43af-9a33-8d2b3f96c0bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:45.964673 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610caa6-40ef-43af-9a33-8d2b3f96c0bb None admin] RBAC: Adding query filter params (role.id=d886d117c82147e6a6488228fee2ac8b, scope.project.id=4d008c89fba44ef892f4209f4db58053, user.id=62ccc5c8c0c14b0588bb574681eadcf6) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:45.964989 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610caa6-40ef-43af-9a33-8d2b3f96c0bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:45.967278 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610caa6-40ef-43af-9a33-8d2b3f96c0bb None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:45.973853 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 51/97] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:49:45 2022] GET /identity/v3/role_assignments?user.id=62ccc5c8c0c14b0588bb574681eadcf6&scope.project.id=4d008c89fba44ef892f4209f4db58053&role.id=d886d117c82147e6a6488228fee2ac8b => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:46.429825 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6b2f7-2c9e-4f1e-8bf6-b8153263819b None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:46.430331 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6b2f7-2c9e-4f1e-8bf6-b8153263819b None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:46.430405 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e6b2f7-2c9e-4f1e-8bf6-b8153263819b None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:46.431776 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 47/98] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:49:46.445093 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d62ee8-e0e0-4d8b-a609-89c3b0fc3c1d None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:46.445570 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d62ee8-e0e0-4d8b-a609-89c3b0fc3c1d None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:46.445643 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d62ee8-e0e0-4d8b-a609-89c3b0fc3c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:46.464326 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-b7d62ee8-e0e0-4d8b-a609-89c3b0fc3c1d None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:46.465544 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-b7d62ee8-e0e0-4d8b-a609-89c3b0fc3c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:46.543221 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 52/99] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:49:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:49:46.834364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6b2f7-2c9e-4f1e-8bf6-b8153263819b None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:46.846236 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dc2fb-12dd-4f9b-867e-826e9f8bdda2 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:46.846633 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dc2fb-12dd-4f9b-867e-826e9f8bdda2 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:46.846913 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83dc2fb-12dd-4f9b-867e-826e9f8bdda2 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:46.848306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 53/100] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:49:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:49:46.857286 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f869c98-6669-4069-8212-c1d6bb88e731 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:46.857286 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f869c98-6669-4069-8212-c1d6bb88e731 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:46.857860 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f869c98-6669-4069-8212-c1d6bb88e731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:46.901821 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-3f869c98-6669-4069-8212-c1d6bb88e731 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:46.903075 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-3f869c98-6669-4069-8212-c1d6bb88e731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:46.962617 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:47.048812 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e6b2f7-2c9e-4f1e-8bf6-b8153263819b None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:47.074441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 54/101] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:49:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:49:47.109245 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:47.113348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac412d-01ac-476f-b28e-148d436b6be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:47.114054 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac412d-01ac-476f-b28e-148d436b6be8 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:47.114344 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac412d-01ac-476f-b28e-148d436b6be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:47.114620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac412d-01ac-476f-b28e-148d436b6be8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:47.115816 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac412d-01ac-476f-b28e-148d436b6be8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:47.117346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac412d-01ac-476f-b28e-148d436b6be8 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:47.119253 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 48/102] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:49:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:47.125269 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f869c98-6669-4069-8212-c1d6bb88e731 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:47.284062 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f869c98-6669-4069-8212-c1d6bb88e731 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:47.336081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7beca-11e0-4d38-92d4-3a745b74b7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:47.336989 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7beca-11e0-4d38-92d4-3a745b74b7f5 None admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:47.337416 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7beca-11e0-4d38-92d4-3a745b74b7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:47.337832 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7beca-11e0-4d38-92d4-3a745b74b7f5 None admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:47.338638 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7beca-11e0-4d38-92d4-3a745b74b7f5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:47.340295 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7beca-11e0-4d38-92d4-3a745b74b7f5 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:47.434077 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 55/103] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Aug 24 16:49:47 2022] POST /identity/v3/projects => generated 302 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:49:47.468448 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac412d-01ac-476f-b28e-148d436b6be8 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:47.622882 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac412d-01ac-476f-b28e-148d436b6be8 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:47.667624 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fb985-f51a-4ec5-9e39-3633b141e59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:47.668667 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fb985-f51a-4ec5-9e39-3633b141e59e None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:47.669191 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fb985-f51a-4ec5-9e39-3633b141e59e None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:47.669671 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fb985-f51a-4ec5-9e39-3633b141e59e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:47.687492 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fb985-f51a-4ec5-9e39-3633b141e59e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:49:47.697458 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-452fb985-f51a-4ec5-9e39-3633b141e59e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:49:47.697458 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:49:47.697458 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:49:47.697458 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:49:47.697458 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:49:47.697458 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:49:47.697458 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:49:47.697458 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:49:47.697458 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:49:47.697458 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:49:47.697458 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:49:47.697458 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:49:47.697458 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:49:47.697458 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:49:47.697458 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:49:47.697458 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:49:47.698346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:49:47.698346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:49:47.698346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:49:47.698346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:49:47.698346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:49:47.698346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:49:47.698346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:49:47.698346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:49:47.698346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:49:47.698346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:49:47.698346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:49:47.698346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:49:47.698346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:49:47.698346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:49:47.698346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:49:47.698346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:49:47.699140 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:49:47.699140 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:49:47.699140 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:49:47.699140 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:49:47.699140 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:49:47.699140 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:49:47.699140 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:49:47.699140 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:49:47.699140 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:49:47.699140 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:49:47.699140 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:49:47.699140 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:49:47.702547 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 49/104] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:49:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:49:47.708732 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7beca-11e0-4d38-92d4-3a745b74b7f5 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:47.736122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:47.816359 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db564708-4165-4138-98ba-d3758e10a33a None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:47.817271 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db564708-4165-4138-98ba-d3758e10a33a None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:47.817772 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db564708-4165-4138-98ba-d3758e10a33a None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:47.819351 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 50/105] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:49:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:49:47.826177 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0462ea8-8197-47ac-8add-44c2ed12a33c None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:47.826765 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0462ea8-8197-47ac-8add-44c2ed12a33c None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:47.827399 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0462ea8-8197-47ac-8add-44c2ed12a33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:47.849357 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-c0462ea8-8197-47ac-8add-44c2ed12a33c None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:47.850906 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-c0462ea8-8197-47ac-8add-44c2ed12a33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:47.857882 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7beca-11e0-4d38-92d4-3a745b74b7f5 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:47.924304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa7a13-4dcd-4379-99ec-0cca20b1d78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:47.924936 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa7a13-4dcd-4379-99ec-0cca20b1d78f None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:47.925219 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa7a13-4dcd-4379-99ec-0cca20b1d78f None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:47.925494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aa7a13-4dcd-4379-99ec-0cca20b1d78f None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:47.926179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa7a13-4dcd-4379-99ec-0cca20b1d78f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:47.926484 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa7a13-4dcd-4379-99ec-0cca20b1d78f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:47.928221 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aa7a13-4dcd-4379-99ec-0cca20b1d78f None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:47.948494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 56/106] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Aug 24 16:49:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:47.955343 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa7a13-4dcd-4379-99ec-0cca20b1d78f None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:47.961198 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:47.985851 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 51/107] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:49:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:49:48.073973 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:48.102082 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aa7a13-4dcd-4379-99ec-0cca20b1d78f None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:48.152411 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116263fe-130f-44dd-aee4-1a3964cf0f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:48.153346 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116263fe-130f-44dd-aee4-1a3964cf0f2e None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:48.153796 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116263fe-130f-44dd-aee4-1a3964cf0f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:48.154214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116263fe-130f-44dd-aee4-1a3964cf0f2e None admin] PATH_INFO: `/v3/users/296a6390ecae4d6abc858d96c9445c32` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:48.186820 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116263fe-130f-44dd-aee4-1a3964cf0f2e None admin] RBAC: Authorizing `identity:get_user(user_id=296a6390ecae4d6abc858d96c9445c32)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:48.188538 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116263fe-130f-44dd-aee4-1a3964cf0f2e None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:48.190762 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 57/108] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:49:47 2022] GET /identity/v3/users/296a6390ecae4d6abc858d96c9445c32 => generated 289 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:49:48.196537 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0462ea8-8197-47ac-8add-44c2ed12a33c None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:48.334837 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0462ea8-8197-47ac-8add-44c2ed12a33c None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:48.344928 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62793d-36ce-4f21-ac6b-06f46b335f97 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:48.345221 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62793d-36ce-4f21-ac6b-06f46b335f97 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:48.345505 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62793d-36ce-4f21-ac6b-06f46b335f97 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:48.347010 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 58/109] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:49:48.352335 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb84640-d53c-42dc-87cb-e5b27f8c9d08 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:48.355139 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb84640-d53c-42dc-87cb-e5b27f8c9d08 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:48.355139 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb84640-d53c-42dc-87cb-e5b27f8c9d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:48.392488 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-3bb84640-d53c-42dc-87cb-e5b27f8c9d08 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:48.394712 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-3bb84640-d53c-42dc-87cb-e5b27f8c9d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:48.431863 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b5e7a-c5dd-41eb-8cee-03cb50c66a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:48.432599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b5e7a-c5dd-41eb-8cee-03cb50c66a39 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:48.432961 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b5e7a-c5dd-41eb-8cee-03cb50c66a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:48.433333 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b5e7a-c5dd-41eb-8cee-03cb50c66a39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:48.500111 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 59/110] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:49:48.501665 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1beb5-646f-41d8-a314-bc96adc52369 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:48.502254 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1beb5-646f-41d8-a314-bc96adc52369 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:48.502713 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1beb5-646f-41d8-a314-bc96adc52369 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:48.504196 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 60/111] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:49:48.505108 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1beb5-646f-41d8-a314-bc96adc52369 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:48.534140 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:48.557777 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b5e7a-c5dd-41eb-8cee-03cb50c66a39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:48.559403 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b5e7a-c5dd-41eb-8cee-03cb50c66a39 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:48.584052 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:48.618482 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1beb5-646f-41d8-a314-bc96adc52369 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:48.657083 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6477de60-b5e5-4757-bfae-07e05e908853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:48.658026 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477de60-b5e5-4757-bfae-07e05e908853 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:48.658516 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477de60-b5e5-4757-bfae-07e05e908853 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:48.658969 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6477de60-b5e5-4757-bfae-07e05e908853 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:48.670836 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6477de60-b5e5-4757-bfae-07e05e908853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:49:48.676424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-6477de60-b5e5-4757-bfae-07e05e908853 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:49:48.676424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:49:48.676424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:49:48.676424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:49:48.676424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:49:48.676424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:49:48.676424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:49:48.676424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:49:48.676424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:49:48.676424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:49:48.676424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:49:48.676424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:49:48.676424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:49:48.676424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:49:48.676424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:49:48.676424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:49:48.677289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:49:48.677289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:49:48.677289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:49:48.677289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:49:48.677289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:49:48.677289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:49:48.677289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:49:48.677289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:49:48.677289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:49:48.677289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:49:48.677289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:49:48.677289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:49:48.677289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:49:48.677289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:49:48.677289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:49:48.677289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:49:48.678071 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:49:48.678071 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:49:48.678071 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:49:48.678071 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:49:48.678071 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:49:48.678071 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:49:48.678071 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:49:48.678071 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:49:48.678071 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:49:48.678071 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:49:48.678071 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:49:48.678071 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:49:48.680176 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 61/112] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:49:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:49:48.681524 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad01603-e87f-4d2a-9733-dd42920b43f9 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:48.682049 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad01603-e87f-4d2a-9733-dd42920b43f9 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:48.682467 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad01603-e87f-4d2a-9733-dd42920b43f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:48.702813 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-bad01603-e87f-4d2a-9733-dd42920b43f9 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:48.704265 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-bad01603-e87f-4d2a-9733-dd42920b43f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:48.705832 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 52/113] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:49:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:48.711660 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbf7ee-f620-42cb-ace0-4bc0ab971e65 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:48.712010 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbf7ee-f620-42cb-ace0-4bc0ab971e65 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:48.712303 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dbf7ee-f620-42cb-ace0-4bc0ab971e65 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:48.713878 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 53/114] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:49:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:49:48.714465 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbf7ee-f620-42cb-ace0-4bc0ab971e65 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:48.778158 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 62/115] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:49:48.779947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad01603-e87f-4d2a-9733-dd42920b43f9 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:48.813534 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:48.828431 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dbf7ee-f620-42cb-ace0-4bc0ab971e65 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:48.838022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:48.867617 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fc8af-68f9-4e39-a07b-940eea6b8328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:48.868598 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fc8af-68f9-4e39-a07b-940eea6b8328 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:48.869065 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fc8af-68f9-4e39-a07b-940eea6b8328 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:48.869630 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fc8af-68f9-4e39-a07b-940eea6b8328 None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:48.870552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64fc8af-68f9-4e39-a07b-940eea6b8328 None admin] RBAC: Adding query filter params (name=member) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:48.871105 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64fc8af-68f9-4e39-a07b-940eea6b8328 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:48.873364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64fc8af-68f9-4e39-a07b-940eea6b8328 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:48.883901 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 54/116] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Aug 24 16:49:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:48.891634 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576dc13-94f3-4113-b02d-5438cbe9ac43 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:48.892265 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576dc13-94f3-4113-b02d-5438cbe9ac43 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:48.892694 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576dc13-94f3-4113-b02d-5438cbe9ac43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:48.895751 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad01603-e87f-4d2a-9733-dd42920b43f9 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:48.911981 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-f576dc13-94f3-4113-b02d-5438cbe9ac43 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:48.913490 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-f576dc13-94f3-4113-b02d-5438cbe9ac43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:48.932653 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c93802-87aa-435e-b6b1-52a93298f707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:48.933321 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c93802-87aa-435e-b6b1-52a93298f707 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:48.933607 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c93802-87aa-435e-b6b1-52a93298f707 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:48.933884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c93802-87aa-435e-b6b1-52a93298f707 None admin] PATH_INFO: `/v3/projects/bdf2d550302d4cafb7d454c50b6794c7` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:48.935655 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c93802-87aa-435e-b6b1-52a93298f707 None admin] RBAC: Authorizing `identity:get_project(project_id=bdf2d550302d4cafb7d454c50b6794c7)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:48.937263 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c93802-87aa-435e-b6b1-52a93298f707 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:48.939025 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 63/117] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:49:48 2022] GET /identity/v3/projects/bdf2d550302d4cafb7d454c50b6794c7 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:48.944214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c93802-87aa-435e-b6b1-52a93298f707 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:48.998026 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 55/118] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:49:48.999344 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576dc13-94f3-4113-b02d-5438cbe9ac43 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:49.073988 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c93802-87aa-435e-b6b1-52a93298f707 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:49.107980 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:49.109938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:49.115803 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576dc13-94f3-4113-b02d-5438cbe9ac43 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:49.122792 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175f2c0-794b-4051-bef9-6cc4287614f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:49.123397 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175f2c0-794b-4051-bef9-6cc4287614f0 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:49.123682 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175f2c0-794b-4051-bef9-6cc4287614f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:49.123962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175f2c0-794b-4051-bef9-6cc4287614f0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:49.134711 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d175f2c0-794b-4051-bef9-6cc4287614f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:49:49.140353 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-d175f2c0-794b-4051-bef9-6cc4287614f0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:49:49.140353 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:49:49.140353 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:49:49.140353 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:49:49.140353 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:49:49.140353 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:49:49.140353 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:49:49.140353 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:49:49.140353 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:49:49.140353 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:49:49.140353 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:49:49.140353 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:49:49.140353 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:49:49.140353 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:49:49.140353 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:49:49.140353 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:49:49.145123 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:49:49.145123 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:49:49.145123 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:49:49.145123 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:49:49.145123 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:49:49.145123 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:49:49.145123 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:49:49.145123 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:49:49.145123 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:49:49.145123 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:49:49.145123 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:49:49.145123 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:49:49.145123 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:49:49.145123 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:49:49.145123 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:49:49.145123 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:49:49.145892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:49:49.145892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:49:49.145892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:49:49.145892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:49:49.145892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:49:49.145892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:49:49.145892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:49:49.145892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:49:49.145892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:49:49.145892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:49:49.145892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:49:49.145892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:49:49.145892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 64/119] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Aug 24 16:49:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:49:49.145892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175f2c0-794b-4051-bef9-6cc4287614f0 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:49.159325 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275166ad-7a13-4064-9fac-9245ab5ff724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:49.160334 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275166ad-7a13-4064-9fac-9245ab5ff724 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:49.160818 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275166ad-7a13-4064-9fac-9245ab5ff724 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:49.161317 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275166ad-7a13-4064-9fac-9245ab5ff724 None admin] PATH_INFO: `/v3/users/62ccc5c8c0c14b0588bb574681eadcf6` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:49.162769 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275166ad-7a13-4064-9fac-9245ab5ff724 None admin] RBAC: Authorizing `identity:get_user(user_id=62ccc5c8c0c14b0588bb574681eadcf6)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:49.164548 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275166ad-7a13-4064-9fac-9245ab5ff724 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:49.166398 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 56/120] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:49:48 2022] GET /identity/v3/users/62ccc5c8c0c14b0588bb574681eadcf6 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:49.171455 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275166ad-7a13-4064-9fac-9245ab5ff724 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:49.255042 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d175f2c0-794b-4051-bef9-6cc4287614f0 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:49.282583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275166ad-7a13-4064-9fac-9245ab5ff724 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:49.295224 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f6472-da58-4a31-80d0-6126063f5325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:49.295224 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f6472-da58-4a31-80d0-6126063f5325 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:49.295224 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f6472-da58-4a31-80d0-6126063f5325 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:49.295224 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f6472-da58-4a31-80d0-6126063f5325 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:49.295781 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f6472-da58-4a31-80d0-6126063f5325 None admin] RBAC: Adding query filter params (role.id=6eade9c7eb83430aa3d5076986bfe477, scope.project.id=bdf2d550302d4cafb7d454c50b6794c7, user.id=296a6390ecae4d6abc858d96c9445c32) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:49.295781 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f6472-da58-4a31-80d0-6126063f5325 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:49.296327 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f6472-da58-4a31-80d0-6126063f5325 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:49.302218 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 65/121] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:49:49 2022] GET /identity/v3/role_assignments?user.id=296a6390ecae4d6abc858d96c9445c32&scope.project.id=bdf2d550302d4cafb7d454c50b6794c7&role.id=6eade9c7eb83430aa3d5076986bfe477 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:49.302850 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f6472-da58-4a31-80d0-6126063f5325 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:49.336290 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1dfda-eed3-4d4d-b8be-2ef0e00c2a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:49.337706 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1dfda-eed3-4d4d-b8be-2ef0e00c2a26 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:49.338002 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1dfda-eed3-4d4d-b8be-2ef0e00c2a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:49.338282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1dfda-eed3-4d4d-b8be-2ef0e00c2a26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:49.355624 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1dfda-eed3-4d4d-b8be-2ef0e00c2a26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:49:49.362822 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-85e1dfda-eed3-4d4d-b8be-2ef0e00c2a26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:49:49.362822 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:49:49.362822 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:49:49.362822 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:49:49.362822 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:49:49.362822 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:49:49.362822 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:49:49.362822 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:49:49.362822 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:49:49.362822 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:49:49.362822 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:49:49.362822 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:49:49.362822 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:49:49.362822 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:49:49.362822 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:49:49.362822 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:49:49.363817 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:49:49.363817 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:49:49.363817 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:49:49.363817 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:49:49.363817 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:49:49.363817 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:49:49.363817 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:49:49.363817 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:49:49.363817 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:49:49.363817 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:49:49.363817 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:49:49.363817 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:49:49.363817 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:49:49.363817 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:49:49.363817 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:49:49.363817 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:49:49.364576 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:49:49.364576 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:49:49.364576 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:49:49.364576 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:49:49.364576 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:49:49.364576 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:49:49.364576 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:49:49.364576 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:49:49.364576 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:49:49.364576 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:49:49.364576 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:49:49.364576 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:49:49.364576 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 57/122] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:49:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:49:49.365211 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1dfda-eed3-4d4d-b8be-2ef0e00c2a26 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:49.376026 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:49.379361 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:49.439469 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f6472-da58-4a31-80d0-6126063f5325 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:49.486700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1dfda-eed3-4d4d-b8be-2ef0e00c2a26 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:49.488834 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce77217-849b-4897-ac3d-cd2928aaec44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:49.490639 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce77217-849b-4897-ac3d-cd2928aaec44 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:49.491172 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce77217-849b-4897-ac3d-cd2928aaec44 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:49.491650 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce77217-849b-4897-ac3d-cd2928aaec44 None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:49.492524 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce77217-849b-4897-ac3d-cd2928aaec44 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:49.493026 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce77217-849b-4897-ac3d-cd2928aaec44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:49.495184 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce77217-849b-4897-ac3d-cd2928aaec44 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:49.508004 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 66/123] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:49:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:49.509216 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce77217-849b-4897-ac3d-cd2928aaec44 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:49.525336 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e5ec7-cccf-4478-ad27-e31e60ae1043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:49.526090 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e5ec7-cccf-4478-ad27-e31e60ae1043 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:49.526381 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e5ec7-cccf-4478-ad27-e31e60ae1043 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:49.526660 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75e5ec7-cccf-4478-ad27-e31e60ae1043 None admin] PATH_INFO: `/v3/projects/bdf2d550302d4cafb7d454c50b6794c7` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:49.530121 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e5ec7-cccf-4478-ad27-e31e60ae1043 None admin] RBAC: Authorizing `identity:get_project(project_id=bdf2d550302d4cafb7d454c50b6794c7)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:49.531629 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75e5ec7-cccf-4478-ad27-e31e60ae1043 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:49.533781 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 58/124] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:49:49 2022] GET /identity/v3/projects/bdf2d550302d4cafb7d454c50b6794c7 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:49.534611 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e5ec7-cccf-4478-ad27-e31e60ae1043 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:49.634667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce77217-849b-4897-ac3d-cd2928aaec44 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:49.642826 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:49.649176 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:49.672660 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722ce16-25f5-438e-a231-41054d09d30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:49.673544 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722ce16-25f5-438e-a231-41054d09d30f None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:49.673999 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722ce16-25f5-438e-a231-41054d09d30f None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:49.674420 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a722ce16-25f5-438e-a231-41054d09d30f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:49.678691 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75e5ec7-cccf-4478-ad27-e31e60ae1043 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:49.689325 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a722ce16-25f5-438e-a231-41054d09d30f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:49:49.694823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-a722ce16-25f5-438e-a231-41054d09d30f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:49:49.694823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:49:49.694823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:49:49.694823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:49:49.694823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:49:49.694823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:49:49.694823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:49:49.694823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:49:49.694823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:49:49.694823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:49:49.694823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:49:49.694823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:49:49.694823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:49:49.694823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:49:49.694823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:49:49.694823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:49:49.695893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:49:49.695893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:49:49.695893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:49:49.695893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:49:49.695893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:49:49.695893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:49:49.695893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:49:49.695893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:49:49.695893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:49:49.695893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:49:49.695893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:49:49.695893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:49:49.695893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:49:49.695893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:49:49.695893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:49:49.695893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:49:49.696798 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:49:49.696798 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:49:49.696798 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:49:49.696798 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:49:49.696798 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:49:49.696798 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:49:49.696798 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:49:49.696798 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:49:49.696798 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:49:49.696798 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:49:49.696798 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:49:49.696798 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:49:49.698679 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 67/125] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:49:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:49:49.699698 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722ce16-25f5-438e-a231-41054d09d30f None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:49.721694 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8a4e8-cf16-48bf-a9e6-7286fc3ce063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:49.722596 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8a4e8-cf16-48bf-a9e6-7286fc3ce063 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:49.722894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8a4e8-cf16-48bf-a9e6-7286fc3ce063 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:49.723203 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8a4e8-cf16-48bf-a9e6-7286fc3ce063 None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:49.723885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8a4e8-cf16-48bf-a9e6-7286fc3ce063 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:49.724192 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8a4e8-cf16-48bf-a9e6-7286fc3ce063 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:49.725819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8a4e8-cf16-48bf-a9e6-7286fc3ce063 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:49.740785 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 59/126] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:49:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:49.741950 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8a4e8-cf16-48bf-a9e6-7286fc3ce063 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:49.844886 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a722ce16-25f5-438e-a231-41054d09d30f None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:49.887160 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8a4e8-cf16-48bf-a9e6-7286fc3ce063 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:49.897420 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177edc3-8783-418a-86f3-356bae04d5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:49.898607 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177edc3-8783-418a-86f3-356bae04d5b8 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:49.899147 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177edc3-8783-418a-86f3-356bae04d5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:49.899568 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177edc3-8783-418a-86f3-356bae04d5b8 None admin] PATH_INFO: `/v3/users/62ccc5c8c0c14b0588bb574681eadcf6` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:49.900972 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177edc3-8783-418a-86f3-356bae04d5b8 None admin] RBAC: Authorizing `identity:get_user(user_id=62ccc5c8c0c14b0588bb574681eadcf6)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:49.902658 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177edc3-8783-418a-86f3-356bae04d5b8 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:49.905117 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 68/127] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:49:49 2022] GET /identity/v3/users/62ccc5c8c0c14b0588bb574681eadcf6 => generated 275 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:49.906086 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177edc3-8783-418a-86f3-356bae04d5b8 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:49.939064 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf8417-bd95-48f3-b00b-c7c58402be4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:49.939900 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf8417-bd95-48f3-b00b-c7c58402be4b None admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:49.940090 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf8417-bd95-48f3-b00b-c7c58402be4b None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:49.940386 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf8417-bd95-48f3-b00b-c7c58402be4b None admin] PATH_INFO: `/v3/projects/bdf2d550302d4cafb7d454c50b6794c7/users/62ccc5c8c0c14b0588bb574681eadcf6/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:49.942823 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf8417-bd95-48f3-b00b-c7c58402be4b None admin] RBAC: Authorizing `identity:create_grant(project_id=bdf2d550302d4cafb7d454c50b6794c7, user_id=62ccc5c8c0c14b0588bb574681eadcf6, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:49.944949 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf8417-bd95-48f3-b00b-c7c58402be4b None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:49.953185 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:50.021000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:50.039145 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 60/128] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Aug 24 16:49:49 2022] PUT /identity/v3/projects/bdf2d550302d4cafb7d454c50b6794c7/users/62ccc5c8c0c14b0588bb574681eadcf6/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:49:50.039145 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf8417-bd95-48f3-b00b-c7c58402be4b None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:50.042678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177edc3-8783-418a-86f3-356bae04d5b8 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:50.125290 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde71ffc-01ff-4c55-93a6-be778d5c62ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:50.125932 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde71ffc-01ff-4c55-93a6-be778d5c62ab None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:50.126214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde71ffc-01ff-4c55-93a6-be778d5c62ab None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:50.126483 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde71ffc-01ff-4c55-93a6-be778d5c62ab None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:50.127256 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde71ffc-01ff-4c55-93a6-be778d5c62ab None admin] RBAC: Adding query filter params (name=member) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:50.127643 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde71ffc-01ff-4c55-93a6-be778d5c62ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:50.129106 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde71ffc-01ff-4c55-93a6-be778d5c62ab None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:50.148871 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 69/129] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Aug 24 16:49:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:50.150914 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde71ffc-01ff-4c55-93a6-be778d5c62ab None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:50.210742 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf8417-bd95-48f3-b00b-c7c58402be4b None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:50.249803 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f3e55-f08e-4fb3-ae51-4c43c728d3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:50.250745 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f3e55-f08e-4fb3-ae51-4c43c728d3f9 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:50.251226 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f3e55-f08e-4fb3-ae51-4c43c728d3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:50.251702 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6f3e55-f08e-4fb3-ae51-4c43c728d3f9 None admin] PATH_INFO: `/v3/users/7d59f8996a11403d9a7359000be8b8ac` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:50.253047 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f3e55-f08e-4fb3-ae51-4c43c728d3f9 None admin] RBAC: Authorizing `identity:get_user(user_id=7d59f8996a11403d9a7359000be8b8ac)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:50.254740 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6f3e55-f08e-4fb3-ae51-4c43c728d3f9 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:50.256600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 61/130] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:49:50 2022] GET /identity/v3/users/7d59f8996a11403d9a7359000be8b8ac => generated 247 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:50.257796 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f3e55-f08e-4fb3-ae51-4c43c728d3f9 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:50.279230 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:50.285944 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde71ffc-01ff-4c55-93a6-be778d5c62ab None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:50.326473 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4593cea-ed40-40db-a8f8-3cb70bef95b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:50.327139 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4593cea-ed40-40db-a8f8-3cb70bef95b8 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:50.327423 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4593cea-ed40-40db-a8f8-3cb70bef95b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:50.327700 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4593cea-ed40-40db-a8f8-3cb70bef95b8 None admin] PATH_INFO: `/v3/projects/bdf2d550302d4cafb7d454c50b6794c7` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:50.328848 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4593cea-ed40-40db-a8f8-3cb70bef95b8 None admin] RBAC: Authorizing `identity:get_project(project_id=bdf2d550302d4cafb7d454c50b6794c7)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:50.330313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4593cea-ed40-40db-a8f8-3cb70bef95b8 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:50.331993 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 70/131] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:49:50 2022] GET /identity/v3/projects/bdf2d550302d4cafb7d454c50b6794c7 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:50.332757 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4593cea-ed40-40db-a8f8-3cb70bef95b8 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:50.338511 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:50.386105 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6f3e55-f08e-4fb3-ae51-4c43c728d3f9 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:50.431228 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f13c23e-e904-4ace-aec4-64dfaf24545f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:50.431940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13c23e-e904-4ace-aec4-64dfaf24545f None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:50.432231 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13c23e-e904-4ace-aec4-64dfaf24545f None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:50.432800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f13c23e-e904-4ace-aec4-64dfaf24545f None admin] PATH_INFO: `/v3/users/62ccc5c8c0c14b0588bb574681eadcf6` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:50.433961 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13c23e-e904-4ace-aec4-64dfaf24545f None admin] RBAC: Authorizing `identity:get_user(user_id=62ccc5c8c0c14b0588bb574681eadcf6)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:50.435978 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f13c23e-e904-4ace-aec4-64dfaf24545f None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:50.438672 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 62/132] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:49:50 2022] GET /identity/v3/users/62ccc5c8c0c14b0588bb574681eadcf6 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:50.440483 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74122ce1-9d0f-40f9-8359-5b0e58806478 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:50.440770 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74122ce1-9d0f-40f9-8359-5b0e58806478 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:50.441573 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74122ce1-9d0f-40f9-8359-5b0e58806478 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:50.443292 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 63/133] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:49:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:49:50.444532 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74122ce1-9d0f-40f9-8359-5b0e58806478 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:50.449905 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4593cea-ed40-40db-a8f8-3cb70bef95b8 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:50.491001 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e3cd0-08fd-4d02-b259-b45b74bba87b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:50.491844 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e3cd0-08fd-4d02-b259-b45b74bba87b None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:50.492226 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e3cd0-08fd-4d02-b259-b45b74bba87b None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:50.492603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27e3cd0-08fd-4d02-b259-b45b74bba87b None admin] PATH_INFO: `/v3/projects/bdf2d550302d4cafb7d454c50b6794c7` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:50.493850 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e3cd0-08fd-4d02-b259-b45b74bba87b None admin] RBAC: Authorizing `identity:get_project(project_id=bdf2d550302d4cafb7d454c50b6794c7)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:50.495528 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27e3cd0-08fd-4d02-b259-b45b74bba87b None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:50.498131 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 71/134] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:49:50 2022] GET /identity/v3/projects/bdf2d550302d4cafb7d454c50b6794c7 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:50.503799 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e3cd0-08fd-4d02-b259-b45b74bba87b None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:50.538664 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:50.574710 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74122ce1-9d0f-40f9-8359-5b0e58806478 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:50.618139 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5fd7d9-4f88-42ac-a460-2601d429acf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:50.619083 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fd7d9-4f88-42ac-a460-2601d429acf0 None admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:50.619565 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fd7d9-4f88-42ac-a460-2601d429acf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:50.620040 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fd7d9-4f88-42ac-a460-2601d429acf0 None admin] PATH_INFO: `/v3/projects/bdf2d550302d4cafb7d454c50b6794c7/users/62ccc5c8c0c14b0588bb574681eadcf6/roles/1c6cc7bf29b146b0a9aaf6a07607258a` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:50.620947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27e3cd0-08fd-4d02-b259-b45b74bba87b None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:50.622776 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5fd7d9-4f88-42ac-a460-2601d429acf0 None admin] RBAC: Authorizing `identity:create_grant(project_id=bdf2d550302d4cafb7d454c50b6794c7, user_id=62ccc5c8c0c14b0588bb574681eadcf6, role_id=1c6cc7bf29b146b0a9aaf6a07607258a)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:50.624565 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5fd7d9-4f88-42ac-a460-2601d429acf0 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:50.626983 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:50.658012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade056d2-68b8-4b79-b296-ad15b323d310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:50.658695 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade056d2-68b8-4b79-b296-ad15b323d310 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:50.659051 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade056d2-68b8-4b79-b296-ad15b323d310 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:50.659336 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade056d2-68b8-4b79-b296-ad15b323d310 None admin] PATH_INFO: `/v3/projects/4d008c89fba44ef892f4209f4db58053` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:50.660463 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade056d2-68b8-4b79-b296-ad15b323d310 None admin] RBAC: Authorizing `identity:get_project(project_id=4d008c89fba44ef892f4209f4db58053)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:50.661912 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade056d2-68b8-4b79-b296-ad15b323d310 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:50.664647 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 72/135] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:49:50 2022] GET /identity/v3/projects/4d008c89fba44ef892f4209f4db58053 => generated 312 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:50.665198 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988eda82-7dcf-4e32-aa80-0e2aad7ae177 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:50.668721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988eda82-7dcf-4e32-aa80-0e2aad7ae177 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:50.668721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988eda82-7dcf-4e32-aa80-0e2aad7ae177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:50.685793 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-988eda82-7dcf-4e32-aa80-0e2aad7ae177 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:50.687199 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-988eda82-7dcf-4e32-aa80-0e2aad7ae177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:50.725923 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 64/136] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Aug 24 16:49:50 2022] PUT /identity/v3/projects/bdf2d550302d4cafb7d454c50b6794c7/users/62ccc5c8c0c14b0588bb574681eadcf6/roles/1c6cc7bf29b146b0a9aaf6a07607258a => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:49:50.727487 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5fd7d9-4f88-42ac-a460-2601d429acf0 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:50.794881 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 73/137] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:49:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:49:50.795699 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988eda82-7dcf-4e32-aa80-0e2aad7ae177 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:50.868787 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:50.874997 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5fd7d9-4f88-42ac-a460-2601d429acf0 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:50.924049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c0752-7bef-4336-aa09-ff3304d9532d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:50.924835 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c0752-7bef-4336-aa09-ff3304d9532d None admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:50.925100 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c0752-7bef-4336-aa09-ff3304d9532d None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:50.925373 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c0752-7bef-4336-aa09-ff3304d9532d None admin] PATH_INFO: `/v3/projects/bdf2d550302d4cafb7d454c50b6794c7/users/7d59f8996a11403d9a7359000be8b8ac/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:50.927803 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c0752-7bef-4336-aa09-ff3304d9532d None admin] RBAC: Authorizing `identity:create_grant(project_id=bdf2d550302d4cafb7d454c50b6794c7, user_id=7d59f8996a11403d9a7359000be8b8ac, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:50.929181 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c0752-7bef-4336-aa09-ff3304d9532d None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:50.978242 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988eda82-7dcf-4e32-aa80-0e2aad7ae177 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:51.014926 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648bc93-e4c2-4db3-9c2c-ac4ec954b6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:51.015629 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648bc93-e4c2-4db3-9c2c-ac4ec954b6ee None admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:51.015910 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648bc93-e4c2-4db3-9c2c-ac4ec954b6ee None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:51.016232 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f648bc93-e4c2-4db3-9c2c-ac4ec954b6ee None admin] PATH_INFO: `/v3/projects/4d008c89fba44ef892f4209f4db58053/users/62ccc5c8c0c14b0588bb574681eadcf6/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:51.018171 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648bc93-e4c2-4db3-9c2c-ac4ec954b6ee None admin] RBAC: Authorizing `identity:create_grant(project_id=4d008c89fba44ef892f4209f4db58053, user_id=62ccc5c8c0c14b0588bb574681eadcf6, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:51.019744 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f648bc93-e4c2-4db3-9c2c-ac4ec954b6ee None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:51.060895 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 65/138] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Aug 24 16:49:50 2022] PUT /identity/v3/projects/bdf2d550302d4cafb7d454c50b6794c7/users/7d59f8996a11403d9a7359000be8b8ac/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:49:51.123808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 74/139] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Aug 24 16:49:50 2022] PUT /identity/v3/projects/4d008c89fba44ef892f4209f4db58053/users/62ccc5c8c0c14b0588bb574681eadcf6/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:49:51.153112 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c0752-7bef-4336-aa09-ff3304d9532d None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:51.238581 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:51.303317 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c0752-7bef-4336-aa09-ff3304d9532d None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:51.364090 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814499c-84d6-4464-8052-f13ba6476cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:51.364776 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814499c-84d6-4464-8052-f13ba6476cfa None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:51.365060 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814499c-84d6-4464-8052-f13ba6476cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:51.365336 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814499c-84d6-4464-8052-f13ba6476cfa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:51.366686 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814499c-84d6-4464-8052-f13ba6476cfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:51.368392 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814499c-84d6-4464-8052-f13ba6476cfa None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:51.370138 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 66/140] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:49:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:51.376774 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648bc93-e4c2-4db3-9c2c-ac4ec954b6ee None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:51.488766 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:51.499296 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f648bc93-e4c2-4db3-9c2c-ac4ec954b6ee None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:51.537107 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebdc84-2a22-477f-89a3-dd332feba7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:51.537723 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebdc84-2a22-477f-89a3-dd332feba7c4 None admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:51.537999 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebdc84-2a22-477f-89a3-dd332feba7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:51.538270 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebdc84-2a22-477f-89a3-dd332feba7c4 None admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:51.538920 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebdc84-2a22-477f-89a3-dd332feba7c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:51.540483 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebdc84-2a22-477f-89a3-dd332feba7c4 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:51.592013 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f78339-5a36-4018-878c-e5be3758a906 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:51.592620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f78339-5a36-4018-878c-e5be3758a906 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:51.592620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f78339-5a36-4018-878c-e5be3758a906 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:51.594139 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 67/141] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:49:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:49:51.599729 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9461895-935c-4356-bf35-d92e1184d2b9 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:51.600033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9461895-935c-4356-bf35-d92e1184d2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:51.600341 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9461895-935c-4356-bf35-d92e1184d2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:51.620049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-b9461895-935c-4356-bf35-d92e1184d2b9 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:51.621268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-b9461895-935c-4356-bf35-d92e1184d2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:51.646337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 75/142] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Aug 24 16:49:51 2022] POST /identity/v3/users => generated 283 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:49:51.701767 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 68/143] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:49:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:49:52.062436 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebdc84-2a22-477f-89a3-dd332feba7c4 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:52.184150 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebdc84-2a22-477f-89a3-dd332feba7c4 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:52.223853 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf829f-cb4f-43b3-b5f5-69347c4530a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:52.224495 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf829f-cb4f-43b3-b5f5-69347c4530a3 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:52.224788 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf829f-cb4f-43b3-b5f5-69347c4530a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:52.225094 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf829f-cb4f-43b3-b5f5-69347c4530a3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:52.239149 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf829f-cb4f-43b3-b5f5-69347c4530a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:49:52.244351 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-76bf829f-cb4f-43b3-b5f5-69347c4530a3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:49:52.244351 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:49:52.244351 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:49:52.244351 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:49:52.244351 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:49:52.244351 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:49:52.244351 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:49:52.244351 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:49:52.244351 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:49:52.244351 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:49:52.244351 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:49:52.244351 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:49:52.244351 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:49:52.244351 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:49:52.244351 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:49:52.244351 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:49:52.245193 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:49:52.245193 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:49:52.245193 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:49:52.245193 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:49:52.245193 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:49:52.245193 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:49:52.245193 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:49:52.245193 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:49:52.245193 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:49:52.245193 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:49:52.245193 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:49:52.245193 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:49:52.245193 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:49:52.245193 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:49:52.245193 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:49:52.245193 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:49:52.246344 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:49:52.246344 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:49:52.246344 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:49:52.246344 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:49:52.246344 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:49:52.246344 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:49:52.246344 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:49:52.246344 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:49:52.246344 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:49:52.246344 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:49:52.246344 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:49:52.246344 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:49:52.246344 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 76/144] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:49:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:49:52.251664 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9461895-935c-4356-bf35-d92e1184d2b9 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:52.318037 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:52.380299 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9461895-935c-4356-bf35-d92e1184d2b9 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:52.436131 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39720cdb-09b1-4dd3-b5ab-89251edcc213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:52.436733 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39720cdb-09b1-4dd3-b5ab-89251edcc213 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:52.437018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39720cdb-09b1-4dd3-b5ab-89251edcc213 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:52.437288 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39720cdb-09b1-4dd3-b5ab-89251edcc213 None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:52.437962 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39720cdb-09b1-4dd3-b5ab-89251edcc213 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:52.438372 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39720cdb-09b1-4dd3-b5ab-89251edcc213 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:52.439790 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39720cdb-09b1-4dd3-b5ab-89251edcc213 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:52.455103 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 69/145] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Aug 24 16:49:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:52.460682 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf829f-cb4f-43b3-b5f5-69347c4530a3 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:52.471052 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:52.592811 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf829f-cb4f-43b3-b5f5-69347c4530a3 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:52.630254 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b418a-84f9-4c91-9ae0-465ec2982cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:52.630892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b418a-84f9-4c91-9ae0-465ec2982cd2 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:52.631229 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b418a-84f9-4c91-9ae0-465ec2982cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:52.631504 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2b418a-84f9-4c91-9ae0-465ec2982cd2 None admin] PATH_INFO: `/v3/users/296a6390ecae4d6abc858d96c9445c32` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:52.632650 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b418a-84f9-4c91-9ae0-465ec2982cd2 None admin] RBAC: Authorizing `identity:get_user(user_id=296a6390ecae4d6abc858d96c9445c32)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:52.634169 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2b418a-84f9-4c91-9ae0-465ec2982cd2 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:52.635804 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 77/146] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:49:52 2022] GET /identity/v3/users/296a6390ecae4d6abc858d96c9445c32 => generated 289 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:52.642080 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39720cdb-09b1-4dd3-b5ab-89251edcc213 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:52.754972 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39720cdb-09b1-4dd3-b5ab-89251edcc213 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:52.770324 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:52.792241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb843634-bc3e-48e7-95ff-e6a0a4a4cf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:52.792881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb843634-bc3e-48e7-95ff-e6a0a4a4cf17 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:52.793158 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb843634-bc3e-48e7-95ff-e6a0a4a4cf17 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:52.793431 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb843634-bc3e-48e7-95ff-e6a0a4a4cf17 None admin] PATH_INFO: `/v3/projects/bdf2d550302d4cafb7d454c50b6794c7` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:52.794827 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb843634-bc3e-48e7-95ff-e6a0a4a4cf17 None admin] RBAC: Authorizing `identity:get_project(project_id=bdf2d550302d4cafb7d454c50b6794c7)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:52.796362 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb843634-bc3e-48e7-95ff-e6a0a4a4cf17 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:52.798289 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 70/147] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:49:52 2022] GET /identity/v3/projects/bdf2d550302d4cafb7d454c50b6794c7 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:52.804047 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b418a-84f9-4c91-9ae0-465ec2982cd2 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:52.896006 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e75b3-661d-47bd-a8f8-9aec06643960 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:52.896518 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e75b3-661d-47bd-a8f8-9aec06643960 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:52.896932 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e75b3-661d-47bd-a8f8-9aec06643960 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:52.898520 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 71/148] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:49:52.902288 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:52.910287 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2a057-111b-47c7-bf04-c7d854c5a734 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:52.910832 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2a057-111b-47c7-bf04-c7d854c5a734 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:52.911304 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e2a057-111b-47c7-bf04-c7d854c5a734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:52.932719 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-03e2a057-111b-47c7-bf04-c7d854c5a734 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:52.934298 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-03e2a057-111b-47c7-bf04-c7d854c5a734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:52.947708 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2b418a-84f9-4c91-9ae0-465ec2982cd2 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:52.987895 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14d1be-6bcd-4f99-8e95-b30e66a8e316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:52.988606 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14d1be-6bcd-4f99-8e95-b30e66a8e316 None admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:52.988889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14d1be-6bcd-4f99-8e95-b30e66a8e316 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:52.989317 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f14d1be-6bcd-4f99-8e95-b30e66a8e316 None admin] PATH_INFO: `/v3/projects/bdf2d550302d4cafb7d454c50b6794c7/users/296a6390ecae4d6abc858d96c9445c32/roles/6eade9c7eb83430aa3d5076986bfe477` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:52.991362 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14d1be-6bcd-4f99-8e95-b30e66a8e316 None admin] RBAC: Authorizing `identity:create_grant(project_id=bdf2d550302d4cafb7d454c50b6794c7, user_id=296a6390ecae4d6abc858d96c9445c32, role_id=6eade9c7eb83430aa3d5076986bfe477)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:52.993015 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f14d1be-6bcd-4f99-8e95-b30e66a8e316 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:53.021336 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 72/149] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:49:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:49:53.112609 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 78/150] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Aug 24 16:49:52 2022] PUT /identity/v3/projects/bdf2d550302d4cafb7d454c50b6794c7/users/296a6390ecae4d6abc858d96c9445c32/roles/6eade9c7eb83430aa3d5076986bfe477 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:49:53.440940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2a057-111b-47c7-bf04-c7d854c5a734 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:53.554642 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e2a057-111b-47c7-bf04-c7d854c5a734 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:53.569514 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:53.593441 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311446a-b75e-4d6c-aa5f-410bee0c54ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:53.594092 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311446a-b75e-4d6c-aa5f-410bee0c54ba None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:53.594367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311446a-b75e-4d6c-aa5f-410bee0c54ba None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:53.594640 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311446a-b75e-4d6c-aa5f-410bee0c54ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:53.607205 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311446a-b75e-4d6c-aa5f-410bee0c54ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:49:53.612422 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-1311446a-b75e-4d6c-aa5f-410bee0c54ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:49:53.612422 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:49:53.612422 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:49:53.612422 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:49:53.612422 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:49:53.612422 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:49:53.612422 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:49:53.612422 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:49:53.612422 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:49:53.612422 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:49:53.612422 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:49:53.612422 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:49:53.612422 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:49:53.612422 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:49:53.612422 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:49:53.612422 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:49:53.613294 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:49:53.613294 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:49:53.613294 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:49:53.613294 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:49:53.613294 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:49:53.613294 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:49:53.613294 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:49:53.613294 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:49:53.613294 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:49:53.613294 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:49:53.613294 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:49:53.613294 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:49:53.613294 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:49:53.613294 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:49:53.613294 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:49:53.613294 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:49:53.614076 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:49:53.614076 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:49:53.614076 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:49:53.614076 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:49:53.614076 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:49:53.614076 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:49:53.614076 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:49:53.614076 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:49:53.614076 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:49:53.614076 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:49:53.614076 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:49:53.614076 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:49:53.616739 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 73/151] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:49:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:49:53.623573 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14d1be-6bcd-4f99-8e95-b30e66a8e316 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:53.735522 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f14d1be-6bcd-4f99-8e95-b30e66a8e316 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:53.771073 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c3fb3-c04b-45b6-a345-04e5952941db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:53.771710 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c3fb3-c04b-45b6-a345-04e5952941db None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:53.771986 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c3fb3-c04b-45b6-a345-04e5952941db None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:53.772253 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787c3fb3-c04b-45b6-a345-04e5952941db None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:53.772923 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c3fb3-c04b-45b6-a345-04e5952941db None admin] RBAC: Adding query filter params (name=member) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:53.773220 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c3fb3-c04b-45b6-a345-04e5952941db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:53.774582 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787c3fb3-c04b-45b6-a345-04e5952941db None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:53.776027 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:53.785174 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 79/152] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Aug 24 16:49:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:53.790868 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311446a-b75e-4d6c-aa5f-410bee0c54ba None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:53.911902 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311446a-b75e-4d6c-aa5f-410bee0c54ba None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:53.962592 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80727142-9c00-476f-a48d-779812646599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:53.963260 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80727142-9c00-476f-a48d-779812646599 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:53.963538 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80727142-9c00-476f-a48d-779812646599 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:53.963809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80727142-9c00-476f-a48d-779812646599 None admin] PATH_INFO: `/v3/users/62ccc5c8c0c14b0588bb574681eadcf6` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:53.964977 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80727142-9c00-476f-a48d-779812646599 None admin] RBAC: Authorizing `identity:get_user(user_id=62ccc5c8c0c14b0588bb574681eadcf6)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:53.967043 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80727142-9c00-476f-a48d-779812646599 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:53.968790 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 74/153] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:49:53 2022] GET /identity/v3/users/62ccc5c8c0c14b0588bb574681eadcf6 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:49:53.974523 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c3fb3-c04b-45b6-a345-04e5952941db None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:54.124425 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787c3fb3-c04b-45b6-a345-04e5952941db None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:54.178438 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b6088e-53b6-43c4-900a-2f7c58cdc02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:54.179126 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6088e-53b6-43c4-900a-2f7c58cdc02c None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:54.179419 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6088e-53b6-43c4-900a-2f7c58cdc02c None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:54.179692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b6088e-53b6-43c4-900a-2f7c58cdc02c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:54.260081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:54.267477 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6088e-53b6-43c4-900a-2f7c58cdc02c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:54.269023 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b6088e-53b6-43c4-900a-2f7c58cdc02c None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:54.394053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 80/154] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:49:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:54.399860 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80727142-9c00-476f-a48d-779812646599 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:54.424109 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09f2d6-bcae-49d6-8bf5-30afc9b815e8 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:54.424424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09f2d6-bcae-49d6-8bf5-30afc9b815e8 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:54.424663 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09f2d6-bcae-49d6-8bf5-30afc9b815e8 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:54.426098 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 81/155] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:49:54.431434 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b1120-c44f-4165-b35a-898c6b699e57 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:54.431710 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b1120-c44f-4165-b35a-898c6b699e57 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:54.431994 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b1120-c44f-4165-b35a-898c6b699e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:54.463993 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-ea2b1120-c44f-4165-b35a-898c6b699e57 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:54.465223 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-ea2b1120-c44f-4165-b35a-898c6b699e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:54.482733 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:54.573813 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80727142-9c00-476f-a48d-779812646599 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:54.612185 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf94ce4-1556-4623-a960-640d098c08b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:54.612837 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf94ce4-1556-4623-a960-640d098c08b4 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:54.613119 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf94ce4-1556-4623-a960-640d098c08b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:54.613395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf94ce4-1556-4623-a960-640d098c08b4 None admin] PATH_INFO: `/v3/projects/bdf2d550302d4cafb7d454c50b6794c7` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:54.614550 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf94ce4-1556-4623-a960-640d098c08b4 None admin] RBAC: Authorizing `identity:get_project(project_id=bdf2d550302d4cafb7d454c50b6794c7)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:54.616064 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf94ce4-1556-4623-a960-640d098c08b4 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:54.617862 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 75/156] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:49:54 2022] GET /identity/v3/projects/bdf2d550302d4cafb7d454c50b6794c7 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:54.619127 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b31ab4-0fea-41f5-b0a4-6ce095250207 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:54.619419 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b31ab4-0fea-41f5-b0a4-6ce095250207 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:54.619695 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b31ab4-0fea-41f5-b0a4-6ce095250207 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:54.620909 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 76/157] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:49:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:49:54.627594 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15122683-9e97-4ef1-a368-d99b159dae19 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:54.627594 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15122683-9e97-4ef1-a368-d99b159dae19 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:54.627815 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15122683-9e97-4ef1-a368-d99b159dae19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:54.683202 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 82/158] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:49:54.683202 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b1120-c44f-4165-b35a-898c6b699e57 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:54.683586 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-15122683-9e97-4ef1-a368-d99b159dae19 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:54.683586 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-15122683-9e97-4ef1-a368-d99b159dae19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:54.698855 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:54.820480 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 77/159] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:49:54.822494 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b246f-bf9c-4803-ae60-e6fd5de3c176 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:54.824414 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b246f-bf9c-4803-ae60-e6fd5de3c176 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:54.824990 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178b246f-bf9c-4803-ae60-e6fd5de3c176 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:54.828017 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 78/160] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:49:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:49:54.835672 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ad833-60a0-4e1a-824b-53c36dfd37a9 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:54.836276 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ad833-60a0-4e1a-824b-53c36dfd37a9 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:54.836756 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72ad833-60a0-4e1a-824b-53c36dfd37a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:54.876414 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b1120-c44f-4165-b35a-898c6b699e57 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:54.878896 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-e72ad833-60a0-4e1a-824b-53c36dfd37a9 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:54.880125 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-e72ad833-60a0-4e1a-824b-53c36dfd37a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:54.945015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:54.966117 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fead8c5-ab67-4e25-80d6-7041a5ceff8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:54.967829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fead8c5-ab67-4e25-80d6-7041a5ceff8d None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:54.968112 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fead8c5-ab67-4e25-80d6-7041a5ceff8d None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:54.968722 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fead8c5-ab67-4e25-80d6-7041a5ceff8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:54.969470 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fead8c5-ab67-4e25-80d6-7041a5ceff8d None admin] RBAC: Adding query filter params (role.id=d886d117c82147e6a6488228fee2ac8b, scope.project.id=bdf2d550302d4cafb7d454c50b6794c7, user.id=62ccc5c8c0c14b0588bb574681eadcf6) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:54.969779 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fead8c5-ab67-4e25-80d6-7041a5ceff8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:54.971465 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fead8c5-ab67-4e25-80d6-7041a5ceff8d None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:54.985960 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 83/161] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:49:54 2022] GET /identity/v3/role_assignments?user.id=62ccc5c8c0c14b0588bb574681eadcf6&scope.project.id=bdf2d550302d4cafb7d454c50b6794c7&role.id=d886d117c82147e6a6488228fee2ac8b => generated 608 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:55.003543 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 79/162] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:49:55.219480 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fead8c5-ab67-4e25-80d6-7041a5ceff8d None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:55.308620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ad833-60a0-4e1a-824b-53c36dfd37a9 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:55.322357 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:55.336377 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fead8c5-ab67-4e25-80d6-7041a5ceff8d None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:55.415770 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4caea7-fc68-47cc-89bb-bb2206d4b125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:55.416750 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4caea7-fc68-47cc-89bb-bb2206d4b125 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:55.417232 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4caea7-fc68-47cc-89bb-bb2206d4b125 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:55.417691 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4caea7-fc68-47cc-89bb-bb2206d4b125 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:55.441848 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4caea7-fc68-47cc-89bb-bb2206d4b125 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:49:55.447362 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-4d4caea7-fc68-47cc-89bb-bb2206d4b125 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:49:55.447362 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:49:55.447362 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:49:55.447362 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:49:55.447362 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:49:55.447362 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:49:55.447362 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:49:55.447362 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:49:55.447362 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:49:55.447362 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:49:55.447362 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:49:55.447362 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:49:55.447362 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:49:55.447362 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:49:55.447362 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:49:55.447362 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:49:55.448439 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:49:55.448439 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:49:55.448439 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:49:55.448439 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:49:55.448439 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:49:55.448439 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:49:55.448439 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:49:55.448439 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:49:55.448439 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:49:55.448439 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:49:55.448439 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:49:55.448439 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:49:55.448439 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:49:55.448439 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:49:55.448439 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:49:55.448439 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:49:55.449285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:49:55.449285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:49:55.449285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:49:55.449285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:49:55.449285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:49:55.449285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:49:55.449285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:49:55.449285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:49:55.449285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:49:55.449285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:49:55.449285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:49:55.449285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:49:55.451786 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 84/163] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Aug 24 16:49:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:49:55.458190 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4caea7-fc68-47cc-89bb-bb2206d4b125 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:55.494412 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72ad833-60a0-4e1a-824b-53c36dfd37a9 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:55.547748 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7b435-f44e-4d7f-b1fc-34464ade227d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:55.548323 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7b435-f44e-4d7f-b1fc-34464ade227d None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:55.548604 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7b435-f44e-4d7f-b1fc-34464ade227d None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:55.548881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa7b435-f44e-4d7f-b1fc-34464ade227d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:55.563934 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa7b435-f44e-4d7f-b1fc-34464ade227d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:49:55.568997 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-9fa7b435-f44e-4d7f-b1fc-34464ade227d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:49:55.568997 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:49:55.568997 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:49:55.568997 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:49:55.568997 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:49:55.568997 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:49:55.568997 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:49:55.568997 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:49:55.568997 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:49:55.568997 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:49:55.568997 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:49:55.568997 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:49:55.568997 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:49:55.568997 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:49:55.568997 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:49:55.568997 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:49:55.569894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:49:55.569894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:49:55.569894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:49:55.569894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:49:55.569894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:49:55.569894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:49:55.569894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:49:55.569894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:49:55.569894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:49:55.569894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:49:55.569894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:49:55.569894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:49:55.569894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:49:55.569894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:49:55.569894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:49:55.569894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:49:55.570672 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:49:55.570672 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:49:55.570672 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:49:55.570672 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:49:55.570672 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:49:55.570672 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:49:55.570672 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:49:55.570672 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:49:55.570672 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:49:55.570672 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:49:55.570672 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:49:55.570672 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:49:55.570672 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 80/164] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:49:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:49:55.577774 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7b435-f44e-4d7f-b1fc-34464ade227d None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:55.582137 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4caea7-fc68-47cc-89bb-bb2206d4b125 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:55.626064 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:55.626972 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae598e6b-2f15-48f6-afe6-bdc397c2d8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:55.627846 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae598e6b-2f15-48f6-afe6-bdc397c2d8cf None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:55.628268 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae598e6b-2f15-48f6-afe6-bdc397c2d8cf None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:55.628712 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae598e6b-2f15-48f6-afe6-bdc397c2d8cf None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:55.629541 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae598e6b-2f15-48f6-afe6-bdc397c2d8cf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:55.629999 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae598e6b-2f15-48f6-afe6-bdc397c2d8cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:55.631649 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae598e6b-2f15-48f6-afe6-bdc397c2d8cf None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:55.645114 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 85/165] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:49:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:49:55.651512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae598e6b-2f15-48f6-afe6-bdc397c2d8cf None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:55.677034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:55.711824 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa7b435-f44e-4d7f-b1fc-34464ade227d None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:55.748492 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20927781-c3af-4734-a385-1f0bdb215230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:55.749031 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20927781-c3af-4734-a385-1f0bdb215230 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:55.749310 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20927781-c3af-4734-a385-1f0bdb215230 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:55.749581 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20927781-c3af-4734-a385-1f0bdb215230 None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:55.750254 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20927781-c3af-4734-a385-1f0bdb215230 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:55.750557 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20927781-c3af-4734-a385-1f0bdb215230 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:55.751969 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20927781-c3af-4734-a385-1f0bdb215230 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:55.760820 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 81/166] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:49:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:49:55.766882 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20927781-c3af-4734-a385-1f0bdb215230 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:55.833298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae598e6b-2f15-48f6-afe6-bdc397c2d8cf None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:55.879994 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:55.889851 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20927781-c3af-4734-a385-1f0bdb215230 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:55.928503 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86c322-2a13-42dd-b62f-4a010ac6e513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:55.929402 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86c322-2a13-42dd-b62f-4a010ac6e513 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:55.929828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86c322-2a13-42dd-b62f-4a010ac6e513 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:55.930024 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471add0-4810-4575-bdeb-6f896f83083b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:55.930446 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86c322-2a13-42dd-b62f-4a010ac6e513 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:55.930591 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471add0-4810-4575-bdeb-6f896f83083b None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:55.930885 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471add0-4810-4575-bdeb-6f896f83083b None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:55.931186 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471add0-4810-4575-bdeb-6f896f83083b None admin] PATH_INFO: `/v3/users/62ccc5c8c0c14b0588bb574681eadcf6` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:55.935897 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471add0-4810-4575-bdeb-6f896f83083b None admin] RBAC: Authorizing `identity:get_user(user_id=62ccc5c8c0c14b0588bb574681eadcf6)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:55.937370 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471add0-4810-4575-bdeb-6f896f83083b None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:55.939079 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 86/167] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:49:55 2022] GET /identity/v3/users/62ccc5c8c0c14b0588bb574681eadcf6 => generated 275 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:49:55.939936 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471add0-4810-4575-bdeb-6f896f83083b None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:55.946153 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f86c322-2a13-42dd-b62f-4a010ac6e513 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:49:55.952196 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-1f86c322-2a13-42dd-b62f-4a010ac6e513 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:49:55.952196 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:49:55.952196 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:49:55.952196 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:49:55.952196 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:49:55.952196 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:49:55.952196 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:49:55.952196 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:49:55.952196 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:49:55.952196 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:49:55.952196 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:49:55.952196 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:49:55.952196 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:49:55.952196 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:49:55.952196 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:49:55.952196 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:49:55.953256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:49:55.953256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:49:55.953256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:49:55.953256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:49:55.953256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:49:55.953256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:49:55.953256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:49:55.953256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:49:55.953256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:49:55.953256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:49:55.953256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:49:55.953256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:49:55.953256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:49:55.953256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:49:55.953256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:49:55.953256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:49:55.954237 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:49:55.954237 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:49:55.954237 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:49:55.954237 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:49:55.954237 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:49:55.954237 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:49:55.954237 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:49:55.954237 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:49:55.954237 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:49:55.954237 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:49:55.954237 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:49:55.954237 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:49:55.956168 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 82/168] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:49:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:49:55.962345 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86c322-2a13-42dd-b62f-4a010ac6e513 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:56.142259 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86c322-2a13-42dd-b62f-4a010ac6e513 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:56.170189 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:56.205261 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471add0-4810-4575-bdeb-6f896f83083b None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:56.219860 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536d974-d3fb-4ebc-abcd-52d7b0b83bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:56.220495 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536d974-d3fb-4ebc-abcd-52d7b0b83bc5 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:56.220776 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536d974-d3fb-4ebc-abcd-52d7b0b83bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:56.221036 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536d974-d3fb-4ebc-abcd-52d7b0b83bc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:56.264582 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:56.293305 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684fa3d8-a84d-457e-95fa-1037c7e9185d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:56.294226 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fa3d8-a84d-457e-95fa-1037c7e9185d None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:56.294548 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fa3d8-a84d-457e-95fa-1037c7e9185d None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:56.294834 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fa3d8-a84d-457e-95fa-1037c7e9185d None admin] PATH_INFO: `/v3/users/7d59f8996a11403d9a7359000be8b8ac` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:56.297577 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684fa3d8-a84d-457e-95fa-1037c7e9185d None admin] RBAC: Authorizing `identity:get_user(user_id=7d59f8996a11403d9a7359000be8b8ac)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:56.299060 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684fa3d8-a84d-457e-95fa-1037c7e9185d None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:56.300712 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 87/169] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:49:55 2022] GET /identity/v3/users/7d59f8996a11403d9a7359000be8b8ac => generated 247 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:56.301661 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684fa3d8-a84d-457e-95fa-1037c7e9185d None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:56.389148 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536d974-d3fb-4ebc-abcd-52d7b0b83bc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:56.390647 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3536d974-d3fb-4ebc-abcd-52d7b0b83bc5 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:56.483637 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684fa3d8-a84d-457e-95fa-1037c7e9185d None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:56.519577 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186c325-0520-4e7f-95be-537c9806c23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:56.520201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186c325-0520-4e7f-95be-537c9806c23c None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:56.520476 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186c325-0520-4e7f-95be-537c9806c23c None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:56.520919 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1186c325-0520-4e7f-95be-537c9806c23c None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:56.521577 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186c325-0520-4e7f-95be-537c9806c23c None admin] RBAC: Adding query filter params (name=member) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:56.521925 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186c325-0520-4e7f-95be-537c9806c23c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:56.523320 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1186c325-0520-4e7f-95be-537c9806c23c None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:56.533376 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 88/170] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Aug 24 16:49:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:56.534216 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186c325-0520-4e7f-95be-537c9806c23c None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:56.559562 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:56.620613 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 83/171] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:49:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:56.622066 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f489c9-8a11-46e6-9e4d-0681b48e2d4b None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:56.622354 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f489c9-8a11-46e6-9e4d-0681b48e2d4b None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:56.623162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f489c9-8a11-46e6-9e4d-0681b48e2d4b None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:56.624734 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 84/172] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:49:56.625575 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f489c9-8a11-46e6-9e4d-0681b48e2d4b None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:56.689689 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:56.717472 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1186c325-0520-4e7f-95be-537c9806c23c None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:56.754284 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f489c9-8a11-46e6-9e4d-0681b48e2d4b None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:56.758044 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace92cb7-6c4d-4a7e-9071-821a14bf7da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:56.758668 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace92cb7-6c4d-4a7e-9071-821a14bf7da0 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:56.758948 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace92cb7-6c4d-4a7e-9071-821a14bf7da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:56.759244 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace92cb7-6c4d-4a7e-9071-821a14bf7da0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:56.791987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4b735-039d-4141-88a3-5c96729a9627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:56.792949 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4b735-039d-4141-88a3-5c96729a9627 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:56.793407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4b735-039d-4141-88a3-5c96729a9627 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:56.794500 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4b735-039d-4141-88a3-5c96729a9627 None admin] PATH_INFO: `/v3/users/62ccc5c8c0c14b0588bb574681eadcf6` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:56.796015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4b735-039d-4141-88a3-5c96729a9627 None admin] RBAC: Authorizing `identity:get_user(user_id=62ccc5c8c0c14b0588bb574681eadcf6)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:56.797780 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4b735-039d-4141-88a3-5c96729a9627 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:56.799649 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 85/173] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:49:56 2022] GET /identity/v3/users/62ccc5c8c0c14b0588bb574681eadcf6 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:56.800641 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4b735-039d-4141-88a3-5c96729a9627 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:56.852563 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace92cb7-6c4d-4a7e-9071-821a14bf7da0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:56.854360 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace92cb7-6c4d-4a7e-9071-821a14bf7da0 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:56.868570 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:56.935027 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4b735-039d-4141-88a3-5c96729a9627 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:56.953590 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:56.968252 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 89/174] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:49:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:56.969801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8d571-82d9-43bb-8ea5-a3f819f8ea28 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:56.970125 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8d571-82d9-43bb-8ea5-a3f819f8ea28 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:56.970435 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8d571-82d9-43bb-8ea5-a3f819f8ea28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:56.971692 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b85ee0-cb80-4ddd-ab41-970e57ca8b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:56.972552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b85ee0-cb80-4ddd-ab41-970e57ca8b35 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:56.973034 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b85ee0-cb80-4ddd-ab41-970e57ca8b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:56.973485 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b85ee0-cb80-4ddd-ab41-970e57ca8b35 None admin] PATH_INFO: `/v3/projects/bdf2d550302d4cafb7d454c50b6794c7` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:56.974623 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b85ee0-cb80-4ddd-ab41-970e57ca8b35 None admin] RBAC: Authorizing `identity:get_project(project_id=bdf2d550302d4cafb7d454c50b6794c7)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:56.976128 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b85ee0-cb80-4ddd-ab41-970e57ca8b35 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:56.977790 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 86/175] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:49:56 2022] GET /identity/v3/projects/bdf2d550302d4cafb7d454c50b6794c7 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:56.983301 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efe6fa-625b-422f-ab1b-e38b313c1388 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:56.983301 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efe6fa-625b-422f-ab1b-e38b313c1388 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:56.983301 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13efe6fa-625b-422f-ab1b-e38b313c1388 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:56.983301 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 87/176] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:49:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:49:56.983301 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13efe6fa-625b-422f-ab1b-e38b313c1388 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:56.999577 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-55d8d571-82d9-43bb-8ea5-a3f819f8ea28 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:57.000817 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-55d8d571-82d9-43bb-8ea5-a3f819f8ea28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:57.073936 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 90/177] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:49:57.075699 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf97bb-ab2d-4659-9dff-64c34f7f3898 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:57.075985 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf97bb-ab2d-4659-9dff-64c34f7f3898 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:57.076253 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacf97bb-ab2d-4659-9dff-64c34f7f3898 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:57.077515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 91/178] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:49:57.082507 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf97bb-ab2d-4659-9dff-64c34f7f3898 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:57.095174 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13efe6fa-625b-422f-ab1b-e38b313c1388 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:57.130542 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:57.132610 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0025ce-672f-4ff9-8c48-a1219fedeb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:57.133496 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0025ce-672f-4ff9-8c48-a1219fedeb8e None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:57.133776 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0025ce-672f-4ff9-8c48-a1219fedeb8e None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:57.134046 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0025ce-672f-4ff9-8c48-a1219fedeb8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:57.192057 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacf97bb-ab2d-4659-9dff-64c34f7f3898 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:57.229711 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:57.230265 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb90b03-8ab6-4a26-8d4b-5ad1f87c1ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:57.230899 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb90b03-8ab6-4a26-8d4b-5ad1f87c1ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:57.231725 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb90b03-8ab6-4a26-8d4b-5ad1f87c1ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:57.231989 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb90b03-8ab6-4a26-8d4b-5ad1f87c1ca3 None admin] PATH_INFO: `/v3/projects/bdf2d550302d4cafb7d454c50b6794c7` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:57.233128 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb90b03-8ab6-4a26-8d4b-5ad1f87c1ca3 None admin] RBAC: Authorizing `identity:get_project(project_id=bdf2d550302d4cafb7d454c50b6794c7)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:57.234562 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb90b03-8ab6-4a26-8d4b-5ad1f87c1ca3 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:57.241495 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 92/179] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:49:57 2022] GET /identity/v3/projects/bdf2d550302d4cafb7d454c50b6794c7 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:57.241495 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb90b03-8ab6-4a26-8d4b-5ad1f87c1ca3 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:57.255690 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0025ce-672f-4ff9-8c48-a1219fedeb8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:57.257793 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0025ce-672f-4ff9-8c48-a1219fedeb8e None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:57.362742 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb90b03-8ab6-4a26-8d4b-5ad1f87c1ca3 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:57.363324 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 88/180] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:49:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:57.364088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e004d-8944-4ca0-bf64-cf86c417e00f None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:57.364379 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e004d-8944-4ca0-bf64-cf86c417e00f None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:57.364655 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e004d-8944-4ca0-bf64-cf86c417e00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:57.375137 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:57.383764 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-1b3e004d-8944-4ca0-bf64-cf86c417e00f None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:57.388028 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-1b3e004d-8944-4ca0-bf64-cf86c417e00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:57.401267 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df52edd-305f-41ec-9ef5-0e971c8860e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:57.401879 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df52edd-305f-41ec-9ef5-0e971c8860e4 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:57.402156 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df52edd-305f-41ec-9ef5-0e971c8860e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:57.402433 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df52edd-305f-41ec-9ef5-0e971c8860e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:57.403236 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df52edd-305f-41ec-9ef5-0e971c8860e4 None admin] RBAC: Adding query filter params (role.id=1c6cc7bf29b146b0a9aaf6a07607258a, scope.project.id=bdf2d550302d4cafb7d454c50b6794c7, user.id=62ccc5c8c0c14b0588bb574681eadcf6) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:57.403546 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df52edd-305f-41ec-9ef5-0e971c8860e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:57.404971 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df52edd-305f-41ec-9ef5-0e971c8860e4 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:57.411292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 93/181] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:49:57 2022] GET /identity/v3/role_assignments?user.id=62ccc5c8c0c14b0588bb574681eadcf6&scope.project.id=bdf2d550302d4cafb7d454c50b6794c7&role.id=1c6cc7bf29b146b0a9aaf6a07607258a => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:57.412477 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dea20-8aea-4675-8ff6-295ad5ac29b9 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:57.412755 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dea20-8aea-4675-8ff6-295ad5ac29b9 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:57.413030 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dea20-8aea-4675-8ff6-295ad5ac29b9 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:57.414412 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 94/182] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:49:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:49:57.415302 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a828f-3b63-4a07-b7ed-9825d61666d3 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:57.415582 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a828f-3b63-4a07-b7ed-9825d61666d3 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:57.415851 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969a828f-3b63-4a07-b7ed-9825d61666d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:57.436495 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-969a828f-3b63-4a07-b7ed-9825d61666d3 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:57.437738 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-969a828f-3b63-4a07-b7ed-9825d61666d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:57.479502 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 89/183] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:49:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:49:57.482401 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e004d-8944-4ca0-bf64-cf86c417e00f None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:57.503930 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:57.531703 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 95/184] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:49:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:49:57.533153 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a828f-3b63-4a07-b7ed-9825d61666d3 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:57.625103 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e004d-8944-4ca0-bf64-cf86c417e00f None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:57.654781 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969a828f-3b63-4a07-b7ed-9825d61666d3 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:57.657554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:57.675296 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba421c67-28e0-408b-aecf-ab3c91e8fc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:57.676630 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba421c67-28e0-408b-aecf-ab3c91e8fc2b None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:57.677433 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba421c67-28e0-408b-aecf-ab3c91e8fc2b None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:57.677917 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba421c67-28e0-408b-aecf-ab3c91e8fc2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:57.679035 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba421c67-28e0-408b-aecf-ab3c91e8fc2b None admin] RBAC: Adding query filter params (role.id=99f0ace9fc4d4d028ca52fa9730cab4b, scope.project.id=bdf2d550302d4cafb7d454c50b6794c7, user.id=7d59f8996a11403d9a7359000be8b8ac) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:57.679975 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba421c67-28e0-408b-aecf-ab3c91e8fc2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:57.681950 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba421c67-28e0-408b-aecf-ab3c91e8fc2b None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:57.692856 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 90/185] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:49:57 2022] GET /identity/v3/role_assignments?user.id=7d59f8996a11403d9a7359000be8b8ac&scope.project.id=bdf2d550302d4cafb7d454c50b6794c7&role.id=99f0ace9fc4d4d028ca52fa9730cab4b => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:57.695341 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba421c67-28e0-408b-aecf-ab3c91e8fc2b None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:57.707549 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4a77c3-2b42-4a6d-81da-dd35281d9774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:57.708204 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a77c3-2b42-4a6d-81da-dd35281d9774 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:57.708482 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a77c3-2b42-4a6d-81da-dd35281d9774 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:57.708755 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4a77c3-2b42-4a6d-81da-dd35281d9774 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:57.732724 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4a77c3-2b42-4a6d-81da-dd35281d9774 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:49:57.737716 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-bb4a77c3-2b42-4a6d-81da-dd35281d9774 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:49:57.737716 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:49:57.737716 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:49:57.737716 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:49:57.737716 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:49:57.737716 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:49:57.737716 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:49:57.737716 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:49:57.737716 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:49:57.737716 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:49:57.737716 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:49:57.737716 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:49:57.737716 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:49:57.737716 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:49:57.737716 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:49:57.737716 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:49:57.738685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:49:57.738685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:49:57.738685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:49:57.738685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:49:57.738685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:49:57.738685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:49:57.738685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:49:57.738685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:49:57.738685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:49:57.738685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:49:57.738685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:49:57.738685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:49:57.738685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:49:57.738685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:49:57.738685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:49:57.738685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:49:57.740192 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:49:57.740192 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:49:57.740192 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:49:57.740192 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:49:57.740192 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:49:57.740192 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:49:57.740192 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:49:57.740192 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:49:57.740192 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:49:57.740192 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:49:57.740192 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:49:57.740192 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:49:57.740192 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 96/186] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:49:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:49:57.742486 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45430c3-f398-4b67-b995-ec5d16535cbc None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:57.742775 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45430c3-f398-4b67-b995-ec5d16535cbc None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:57.743048 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45430c3-f398-4b67-b995-ec5d16535cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:57.766647 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-a45430c3-f398-4b67-b995-ec5d16535cbc None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:49:57.767891 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-a45430c3-f398-4b67-b995-ec5d16535cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:49:57.823978 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:57.852890 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba421c67-28e0-408b-aecf-ab3c91e8fc2b None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:57.860497 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 97/187] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:49:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:49:57.861398 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45430c3-f398-4b67-b995-ec5d16535cbc None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:57.903847 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab3513-5636-4c18-8a03-9120c86eb569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:57.904512 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab3513-5636-4c18-8a03-9120c86eb569 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:57.905029 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab3513-5636-4c18-8a03-9120c86eb569 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:57.905487 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab3513-5636-4c18-8a03-9120c86eb569 None admin] PATH_INFO: `/v3/projects/4d008c89fba44ef892f4209f4db58053` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:57.906963 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eab3513-5636-4c18-8a03-9120c86eb569 None admin] RBAC: Authorizing `identity:get_project(project_id=4d008c89fba44ef892f4209f4db58053)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:57.908715 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eab3513-5636-4c18-8a03-9120c86eb569 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:57.911029 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 91/188] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:49:57 2022] GET /identity/v3/projects/4d008c89fba44ef892f4209f4db58053 => generated 312 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:57.911995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab3513-5636-4c18-8a03-9120c86eb569 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:57.991161 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:58.003835 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45430c3-f398-4b67-b995-ec5d16535cbc None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:58.045688 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eab3513-5636-4c18-8a03-9120c86eb569 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:58.052444 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3cda4-da9a-43cf-9294-a387762fd131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:58.053032 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3cda4-da9a-43cf-9294-a387762fd131 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:58.053312 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3cda4-da9a-43cf-9294-a387762fd131 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:58.053585 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3cda4-da9a-43cf-9294-a387762fd131 None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:58.054800 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3cda4-da9a-43cf-9294-a387762fd131 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:58.055102 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3cda4-da9a-43cf-9294-a387762fd131 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:58.057007 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3cda4-da9a-43cf-9294-a387762fd131 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:58.068968 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 98/189] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:49:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:58.069641 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3cda4-da9a-43cf-9294-a387762fd131 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:58.086242 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3ff2e-3bd2-4164-a43b-3599488053fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:58.087272 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3ff2e-3bd2-4164-a43b-3599488053fc None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:58.087722 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3ff2e-3bd2-4164-a43b-3599488053fc None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:58.088130 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3ff2e-3bd2-4164-a43b-3599488053fc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:58.099899 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d3ff2e-3bd2-4164-a43b-3599488053fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:49:58.105551 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-08d3ff2e-3bd2-4164-a43b-3599488053fc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:49:58.105551 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:49:58.105551 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:49:58.105551 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:49:58.105551 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:49:58.105551 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:49:58.105551 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:49:58.105551 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:49:58.105551 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:49:58.105551 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:49:58.105551 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:49:58.105551 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:49:58.105551 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:49:58.105551 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:49:58.105551 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:49:58.105551 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:49:58.110682 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:49:58.110682 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:49:58.110682 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:49:58.110682 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:49:58.110682 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:49:58.110682 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:49:58.110682 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:49:58.110682 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:49:58.110682 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:49:58.110682 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:49:58.110682 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:49:58.110682 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:49:58.110682 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:49:58.110682 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:49:58.110682 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:49:58.110682 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:49:58.111700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:49:58.111700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:49:58.111700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:49:58.111700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:49:58.111700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:49:58.111700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:49:58.111700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:49:58.111700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:49:58.111700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:49:58.111700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:49:58.111700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:49:58.111700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:49:58.111700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 92/190] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Aug 24 16:49:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:49:58.111700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3ff2e-3bd2-4164-a43b-3599488053fc None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:58.125184 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:58.186646 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3cda4-da9a-43cf-9294-a387762fd131 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:58.220174 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc444e2-d988-4c0a-a4eb-4368070328b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:58.220804 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc444e2-d988-4c0a-a4eb-4368070328b9 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:58.221086 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc444e2-d988-4c0a-a4eb-4368070328b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:58.221361 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc444e2-d988-4c0a-a4eb-4368070328b9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:58.232136 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc444e2-d988-4c0a-a4eb-4368070328b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:49:58.237070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-fcc444e2-d988-4c0a-a4eb-4368070328b9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:49:58.237070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:49:58.237070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:49:58.237070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:49:58.237070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:49:58.237070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:49:58.237070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:49:58.237070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:49:58.237070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:49:58.237070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:49:58.237070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:49:58.237070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:49:58.237070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:49:58.237070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:49:58.237070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:49:58.237070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:49:58.237964 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:49:58.237964 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:49:58.237964 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:49:58.237964 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:49:58.237964 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:49:58.237964 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:49:58.237964 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:49:58.237964 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:49:58.237964 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:49:58.237964 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:49:58.237964 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:49:58.237964 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:49:58.237964 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:49:58.237964 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:49:58.237964 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:49:58.237964 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:49:58.238763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:49:58.238763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:49:58.238763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:49:58.238763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:49:58.238763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:49:58.238763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:49:58.238763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:49:58.238763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:49:58.238763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:49:58.238763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:49:58.238763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:49:58.238763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:49:58.238763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 99/191] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:49:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:49:58.239517 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc444e2-d988-4c0a-a4eb-4368070328b9 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:58.251808 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3ff2e-3bd2-4164-a43b-3599488053fc None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:58.255657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:58.288252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283fcf40-e4e3-4ef7-b751-592a76d2a8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:58.288851 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fcf40-e4e3-4ef7-b751-592a76d2a8f6 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:58.289123 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fcf40-e4e3-4ef7-b751-592a76d2a8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:58.289387 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fcf40-e4e3-4ef7-b751-592a76d2a8f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:58.290113 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283fcf40-e4e3-4ef7-b751-592a76d2a8f6 None admin] RBAC: Adding query filter params (role.id=d886d117c82147e6a6488228fee2ac8b, scope.project.id=4d008c89fba44ef892f4209f4db58053, user.id=62ccc5c8c0c14b0588bb574681eadcf6) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:58.290418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283fcf40-e4e3-4ef7-b751-592a76d2a8f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:58.291903 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283fcf40-e4e3-4ef7-b751-592a76d2a8f6 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:58.298135 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 93/192] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:49:58 2022] GET /identity/v3/role_assignments?user.id=62ccc5c8c0c14b0588bb574681eadcf6&scope.project.id=4d008c89fba44ef892f4209f4db58053&role.id=d886d117c82147e6a6488228fee2ac8b => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:58.298912 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283fcf40-e4e3-4ef7-b751-592a76d2a8f6 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:58.347697 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc444e2-d988-4c0a-a4eb-4368070328b9 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:58.385090 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:58.385297 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee479ac-aff9-4fe3-8931-f340ea1a2e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:58.385905 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee479ac-aff9-4fe3-8931-f340ea1a2e75 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:58.386183 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee479ac-aff9-4fe3-8931-f340ea1a2e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:58.386454 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee479ac-aff9-4fe3-8931-f340ea1a2e75 None admin] PATH_INFO: `/v3/users/509b873e1603479984fa60a4542905bd` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:58.401925 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee479ac-aff9-4fe3-8931-f340ea1a2e75 None admin] RBAC: Authorizing `identity:get_user(user_id=509b873e1603479984fa60a4542905bd)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:58.404062 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee479ac-aff9-4fe3-8931-f340ea1a2e75 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:58.406157 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 100/193] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:49:58 2022] GET /identity/v3/users/509b873e1603479984fa60a4542905bd => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:58.406979 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee479ac-aff9-4fe3-8931-f340ea1a2e75 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:58.423825 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283fcf40-e4e3-4ef7-b751-592a76d2a8f6 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:58.465029 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a66d4-7db2-4a9e-acda-35fffee274bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:58.466425 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a66d4-7db2-4a9e-acda-35fffee274bd None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:58.467043 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a66d4-7db2-4a9e-acda-35fffee274bd None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:58.467370 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a66d4-7db2-4a9e-acda-35fffee274bd None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:58.468053 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a66d4-7db2-4a9e-acda-35fffee274bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:58.468363 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a66d4-7db2-4a9e-acda-35fffee274bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:58.470242 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a66d4-7db2-4a9e-acda-35fffee274bd None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:58.479552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 94/194] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:49:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:58.483333 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a66d4-7db2-4a9e-acda-35fffee274bd None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:58.497605 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:58.529493 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee479ac-aff9-4fe3-8931-f340ea1a2e75 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:58.564069 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd814b5-75f5-4e02-88e1-4d9db1bccbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:58.564701 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd814b5-75f5-4e02-88e1-4d9db1bccbbb None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:58.564980 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd814b5-75f5-4e02-88e1-4d9db1bccbbb None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:58.565249 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd814b5-75f5-4e02-88e1-4d9db1bccbbb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:58.566609 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd814b5-75f5-4e02-88e1-4d9db1bccbbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:58.568119 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd814b5-75f5-4e02-88e1-4d9db1bccbbb None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:58.569692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 101/195] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:49:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:58.570538 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd814b5-75f5-4e02-88e1-4d9db1bccbbb None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:58.589454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a66d4-7db2-4a9e-acda-35fffee274bd None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:58.624266 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe91fa-6eba-4f2e-929d-001fdb49cade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:58.624877 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe91fa-6eba-4f2e-929d-001fdb49cade None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:58.625160 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe91fa-6eba-4f2e-929d-001fdb49cade None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:58.625432 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe91fa-6eba-4f2e-929d-001fdb49cade None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:58.626098 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe91fa-6eba-4f2e-929d-001fdb49cade None admin] RBAC: Adding query filter params (name=reader) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:58.626403 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe91fa-6eba-4f2e-929d-001fdb49cade None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:58.627834 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe91fa-6eba-4f2e-929d-001fdb49cade None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:58.629171 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:58.636677 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 95/196] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Aug 24 16:49:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:58.637414 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe91fa-6eba-4f2e-929d-001fdb49cade None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:58.674898 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd814b5-75f5-4e02-88e1-4d9db1bccbbb None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:58.708740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e54158-89c8-4428-861e-19b93d91df7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:58.709351 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e54158-89c8-4428-861e-19b93d91df7e None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:58.709628 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e54158-89c8-4428-861e-19b93d91df7e None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:58.709902 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e54158-89c8-4428-861e-19b93d91df7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:58.721084 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:58.739031 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe91fa-6eba-4f2e-929d-001fdb49cade None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:58.773594 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b70dd-53ba-43c1-a9cd-f217b416d3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:58.774376 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b70dd-53ba-43c1-a9cd-f217b416d3c3 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:58.774771 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b70dd-53ba-43c1-a9cd-f217b416d3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:58.775049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b70dd-53ba-43c1-a9cd-f217b416d3c3 None admin] PATH_INFO: `/v3/users/509b873e1603479984fa60a4542905bd` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:58.776218 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b70dd-53ba-43c1-a9cd-f217b416d3c3 None admin] RBAC: Authorizing `identity:get_user(user_id=509b873e1603479984fa60a4542905bd)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:58.777288 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e54158-89c8-4428-861e-19b93d91df7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:58.777751 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b70dd-53ba-43c1-a9cd-f217b416d3c3 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:58.779675 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e54158-89c8-4428-861e-19b93d91df7e None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:58.780088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 96/197] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:49:58 2022] GET /identity/v3/users/509b873e1603479984fa60a4542905bd => generated 283 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:58.780837 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b70dd-53ba-43c1-a9cd-f217b416d3c3 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:58.843487 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:58.880429 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 102/198] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:49:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:58.880996 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b70dd-53ba-43c1-a9cd-f217b416d3c3 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:58.881472 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e54158-89c8-4428-861e-19b93d91df7e None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:58.915632 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c0d3d-ca2f-4248-942b-f66eef780a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:58.916242 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c0d3d-ca2f-4248-942b-f66eef780a29 None admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:58.916519 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c0d3d-ca2f-4248-942b-f66eef780a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:58.916789 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c0d3d-ca2f-4248-942b-f66eef780a29 None admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:58.917428 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c0d3d-ca2f-4248-942b-f66eef780a29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:58.919159 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7c0d3d-ca2f-4248-942b-f66eef780a29 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:58.924392 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:58.982694 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e54158-89c8-4428-861e-19b93d91df7e None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:59.002830 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 97/199] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Aug 24 16:49:58 2022] POST /identity/v3/users => generated 297 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:49:59.017092 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a173ae7-a39f-4921-b075-60a018919e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:59.017776 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a173ae7-a39f-4921-b075-60a018919e43 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:59.018038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a173ae7-a39f-4921-b075-60a018919e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:59.018312 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a173ae7-a39f-4921-b075-60a018919e43 None admin] PATH_INFO: `/v3/users/296a6390ecae4d6abc858d96c9445c32` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:59.019580 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a173ae7-a39f-4921-b075-60a018919e43 None admin] RBAC: Authorizing `identity:get_user(user_id=296a6390ecae4d6abc858d96c9445c32)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:59.021064 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a173ae7-a39f-4921-b075-60a018919e43 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:59.022782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 103/200] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:49:58 2022] GET /identity/v3/users/296a6390ecae4d6abc858d96c9445c32 => generated 289 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:59.024257 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c0d3d-ca2f-4248-942b-f66eef780a29 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:59.025264 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a173ae7-a39f-4921-b075-60a018919e43 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:59.143316 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a173ae7-a39f-4921-b075-60a018919e43 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:59.145275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7c0d3d-ca2f-4248-942b-f66eef780a29 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:59.154233 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:59.171676 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:59.189827 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27786b7d-1798-4ec8-af31-442673ce6918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:59.190462 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa75624-babc-49f0-850a-a2e7b946feec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:59.193681 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27786b7d-1798-4ec8-af31-442673ce6918 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:59.193681 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27786b7d-1798-4ec8-af31-442673ce6918 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:59.193840 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa75624-babc-49f0-850a-a2e7b946feec None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:59.193933 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27786b7d-1798-4ec8-af31-442673ce6918 None admin] PATH_INFO: `/v3/projects/9125daf250634e3881ac3ca4ab91d86b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:59.194006 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa75624-babc-49f0-850a-a2e7b946feec None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:59.194006 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa75624-babc-49f0-850a-a2e7b946feec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:59.194125 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27786b7d-1798-4ec8-af31-442673ce6918 None admin] RBAC: Authorizing `identity:get_project(project_id=9125daf250634e3881ac3ca4ab91d86b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:59.194125 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27786b7d-1798-4ec8-af31-442673ce6918 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:59.196161 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 104/201] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:49:59 2022] GET /identity/v3/projects/9125daf250634e3881ac3ca4ab91d86b => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:59.196748 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27786b7d-1798-4ec8-af31-442673ce6918 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:59.284549 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa75624-babc-49f0-850a-a2e7b946feec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:59.285840 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa75624-babc-49f0-850a-a2e7b946feec None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:59.329950 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27786b7d-1798-4ec8-af31-442673ce6918 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:59.375020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e0247-81e1-4943-8c22-905e369ed20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:59.375705 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e0247-81e1-4943-8c22-905e369ed20b None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:59.375986 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e0247-81e1-4943-8c22-905e369ed20b None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:59.377460 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355e0247-81e1-4943-8c22-905e369ed20b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:59.410318 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 98/202] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:49:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:59.411287 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa75624-babc-49f0-850a-a2e7b946feec None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:59.436209 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:59.447550 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:59.473839 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e0247-81e1-4943-8c22-905e369ed20b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:59.475540 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355e0247-81e1-4943-8c22-905e369ed20b None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:59.558510 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa75624-babc-49f0-850a-a2e7b946feec None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:59.593324 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 105/203] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:49:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:49:59.594376 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e0247-81e1-4943-8c22-905e369ed20b None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:59.605607 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d3a32-0b73-4620-8c25-585c67cafa7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:59.606759 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d3a32-0b73-4620-8c25-585c67cafa7a None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:59.607035 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d3a32-0b73-4620-8c25-585c67cafa7a None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:59.607338 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d3a32-0b73-4620-8c25-585c67cafa7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:59.608076 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d3a32-0b73-4620-8c25-585c67cafa7a None admin] RBAC: Adding query filter params (role.id=99f0ace9fc4d4d028ca52fa9730cab4b, scope.project.id=9125daf250634e3881ac3ca4ab91d86b, user.id=509b873e1603479984fa60a4542905bd) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:59.608384 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d3a32-0b73-4620-8c25-585c67cafa7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:59.609833 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d3a32-0b73-4620-8c25-585c67cafa7a None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:59.615878 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 99/204] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:49:59 2022] GET /identity/v3/role_assignments?user.id=509b873e1603479984fa60a4542905bd&scope.project.id=9125daf250634e3881ac3ca4ab91d86b&role.id=99f0ace9fc4d4d028ca52fa9730cab4b => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:59.616529 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d3a32-0b73-4620-8c25-585c67cafa7a None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:59.709553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:59.732784 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d3a32-0b73-4620-8c25-585c67cafa7a None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:59.750150 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:49:59.772534 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d37350-a4ef-466e-959b-6544fad2de80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:59.773191 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d37350-a4ef-466e-959b-6544fad2de80 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:59.773471 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d37350-a4ef-466e-959b-6544fad2de80 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:59.773745 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d37350-a4ef-466e-959b-6544fad2de80 None admin] PATH_INFO: `/v3/projects/bdf2d550302d4cafb7d454c50b6794c7` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:59.775045 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d37350-a4ef-466e-959b-6544fad2de80 None admin] RBAC: Authorizing `identity:get_project(project_id=bdf2d550302d4cafb7d454c50b6794c7)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:59.776594 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d37350-a4ef-466e-959b-6544fad2de80 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:59.778718 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 100/205] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:49:59 2022] GET /identity/v3/projects/bdf2d550302d4cafb7d454c50b6794c7 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:59.784517 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d37350-a4ef-466e-959b-6544fad2de80 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:59.805135 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355e0247-81e1-4943-8c22-905e369ed20b None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:59.901426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d37350-a4ef-466e-959b-6544fad2de80 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:49:59.932423 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f5f3f-5a3e-4d7d-8e07-789ed8305bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:59.933084 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f5f3f-5a3e-4d7d-8e07-789ed8305bac None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:59.933367 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f5f3f-5a3e-4d7d-8e07-789ed8305bac None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:59.933644 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795f5f3f-5a3e-4d7d-8e07-789ed8305bac None admin] PATH_INFO: `/v3/projects/9125daf250634e3881ac3ca4ab91d86b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:59.935652 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f5f3f-5a3e-4d7d-8e07-789ed8305bac None admin] RBAC: Authorizing `identity:get_project(project_id=9125daf250634e3881ac3ca4ab91d86b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:59.937127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795f5f3f-5a3e-4d7d-8e07-789ed8305bac None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:59.938811 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88086eb8-40ec-4175-b88f-95a9c70d13af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:49:59.939062 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 106/206] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:49:59 2022] GET /identity/v3/projects/9125daf250634e3881ac3ca4ab91d86b => generated 302 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:49:59.939462 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88086eb8-40ec-4175-b88f-95a9c70d13af None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:49:59.939750 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88086eb8-40ec-4175-b88f-95a9c70d13af None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:49:59.940026 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88086eb8-40ec-4175-b88f-95a9c70d13af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:49:59.941117 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88086eb8-40ec-4175-b88f-95a9c70d13af None admin] RBAC: Adding query filter params (role.id=6eade9c7eb83430aa3d5076986bfe477, scope.project.id=bdf2d550302d4cafb7d454c50b6794c7, user.id=296a6390ecae4d6abc858d96c9445c32) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:49:59.941428 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88086eb8-40ec-4175-b88f-95a9c70d13af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:49:59.942897 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88086eb8-40ec-4175-b88f-95a9c70d13af None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:49:59.945296 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f5f3f-5a3e-4d7d-8e07-789ed8305bac None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:49:59.950201 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 101/207] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:49:59 2022] GET /identity/v3/role_assignments?user.id=296a6390ecae4d6abc858d96c9445c32&scope.project.id=bdf2d550302d4cafb7d454c50b6794c7&role.id=6eade9c7eb83430aa3d5076986bfe477 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:50:00.065024 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795f5f3f-5a3e-4d7d-8e07-789ed8305bac None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:00.103802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043ce12-cd1a-4a93-9637-30bc7b279c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:00.109121 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043ce12-cd1a-4a93-9637-30bc7b279c9d None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:00.109121 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043ce12-cd1a-4a93-9637-30bc7b279c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:00.109121 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043ce12-cd1a-4a93-9637-30bc7b279c9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:00.109121 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043ce12-cd1a-4a93-9637-30bc7b279c9d None admin] RBAC: Adding query filter params (role.id=1c6cc7bf29b146b0a9aaf6a07607258a, scope.project.id=9125daf250634e3881ac3ca4ab91d86b, user.id=509b873e1603479984fa60a4542905bd) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:00.109121 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043ce12-cd1a-4a93-9637-30bc7b279c9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:00.109121 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043ce12-cd1a-4a93-9637-30bc7b279c9d None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:00.114569 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 107/208] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:49:59 2022] GET /identity/v3/role_assignments?user.id=509b873e1603479984fa60a4542905bd&scope.project.id=9125daf250634e3881ac3ca4ab91d86b&role.id=1c6cc7bf29b146b0a9aaf6a07607258a => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:50:01.286147 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3e15b-ec93-424e-bf00-f799910f1407 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:01.286723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3e15b-ec93-424e-bf00-f799910f1407 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:01.286723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3e15b-ec93-424e-bf00-f799910f1407 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:01.288447 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 102/209] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:01.294946 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1acc5-2f1c-4c0d-9748-99aa69f73d5b None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:01.295502 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1acc5-2f1c-4c0d-9748-99aa69f73d5b None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:01.295502 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1acc5-2f1c-4c0d-9748-99aa69f73d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:01.314878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-91c1acc5-2f1c-4c0d-9748-99aa69f73d5b None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:01.316388 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-91c1acc5-2f1c-4c0d-9748-99aa69f73d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:01.318449 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:01.363102 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd11d9-033b-4415-bf88-6c7143144503 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:01.363433 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd11d9-033b-4415-bf88-6c7143144503 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:01.363669 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd11d9-033b-4415-bf88-6c7143144503 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:01.365156 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 103/210] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:50:01.370621 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9eeaa-c04f-4568-ba3d-5b8f430f6872 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:01.371225 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9eeaa-c04f-4568-ba3d-5b8f430f6872 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:01.372309 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e9eeaa-c04f-4568-ba3d-5b8f430f6872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:01.392770 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-a3e9eeaa-c04f-4568-ba3d-5b8f430f6872 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:01.394374 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-a3e9eeaa-c04f-4568-ba3d-5b8f430f6872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:01.396201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 108/211] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:01.409835 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:01.472742 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 104/212] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:50:01.670157 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9bb98-9504-4b59-a206-082c0a81ddae None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:01.670342 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9bb98-9504-4b59-a206-082c0a81ddae None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:01.670615 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9bb98-9504-4b59-a206-082c0a81ddae None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:01.672233 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 109/213] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:01.674328 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9eeaa-c04f-4568-ba3d-5b8f430f6872 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:01.678540 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f4324-abdf-4970-b066-0be475ca3814 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:01.678803 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f4324-abdf-4970-b066-0be475ca3814 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:01.679075 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f4324-abdf-4970-b066-0be475ca3814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:01.697705 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-922f4324-abdf-4970-b066-0be475ca3814 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:01.698902 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-922f4324-abdf-4970-b066-0be475ca3814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:01.779103 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 110/214] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:01.783413 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f4324-abdf-4970-b066-0be475ca3814 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:01.799504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e9eeaa-c04f-4568-ba3d-5b8f430f6872 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:01.848418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b0492-c80a-4252-84ec-9b82b8a45e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:01.850122 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b0492-c80a-4252-84ec-9b82b8a45e1f None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:01.850816 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b0492-c80a-4252-84ec-9b82b8a45e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:01.851263 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8b0492-c80a-4252-84ec-9b82b8a45e1f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:01.854896 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:01.866522 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8b0492-c80a-4252-84ec-9b82b8a45e1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:01.872722 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-8c8b0492-c80a-4252-84ec-9b82b8a45e1f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:50:01.872722 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:01.872722 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:01.872722 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:01.872722 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:01.872722 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:01.872722 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:01.872722 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:01.872722 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:01.872722 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:01.872722 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:01.872722 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:01.872722 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:01.872722 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:01.872722 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:01.872722 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:01.880241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:01.880241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:01.880241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:01.880241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:01.880241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:01.880241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:01.880241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:01.880241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:01.880241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:01.880241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:01.880241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:01.880241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:01.880241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:01.880241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:01.880241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:01.880241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:01.881571 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:01.881571 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:01.881571 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:01.881571 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:01.881571 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:01.881571 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:01.881571 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:01.881571 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:01.881571 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:01.881571 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:01.881571 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:50:01.881571 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:01.881571 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 105/215] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:50:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:50:01.881571 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b0492-c80a-4252-84ec-9b82b8a45e1f None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:01.895318 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:01.908779 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f4324-abdf-4970-b066-0be475ca3814 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:01.948298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825b5d0-7244-4112-8b7f-aa6c6152d11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:01.949337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825b5d0-7244-4112-8b7f-aa6c6152d11c None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:01.950355 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825b5d0-7244-4112-8b7f-aa6c6152d11c None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:01.950822 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825b5d0-7244-4112-8b7f-aa6c6152d11c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:01.952326 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1825b5d0-7244-4112-8b7f-aa6c6152d11c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:01.954064 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1825b5d0-7244-4112-8b7f-aa6c6152d11c None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:01.956144 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 111/216] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:01.967154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825b5d0-7244-4112-8b7f-aa6c6152d11c None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:01.995292 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8b0492-c80a-4252-84ec-9b82b8a45e1f None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:02.039828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067214b-c5d1-43af-92a3-4574c7fbd662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:02.040467 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067214b-c5d1-43af-92a3-4574c7fbd662 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:02.041202 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067214b-c5d1-43af-92a3-4574c7fbd662 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:02.041481 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067214b-c5d1-43af-92a3-4574c7fbd662 None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:02.042443 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067214b-c5d1-43af-92a3-4574c7fbd662 None admin] RBAC: Adding query filter params (name=member) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:02.042752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067214b-c5d1-43af-92a3-4574c7fbd662 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:02.044730 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067214b-c5d1-43af-92a3-4574c7fbd662 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:02.064652 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 106/217] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Aug 24 16:50:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:02.066277 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067214b-c5d1-43af-92a3-4574c7fbd662 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:02.087964 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825b5d0-7244-4112-8b7f-aa6c6152d11c None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:02.124312 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620dd263-f1a0-41be-b2f2-ed730ed78495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:02.124935 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dd263-f1a0-41be-b2f2-ed730ed78495 None admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:02.125219 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dd263-f1a0-41be-b2f2-ed730ed78495 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:02.125493 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dd263-f1a0-41be-b2f2-ed730ed78495 None admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:02.126169 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620dd263-f1a0-41be-b2f2-ed730ed78495 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:02.128284 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620dd263-f1a0-41be-b2f2-ed730ed78495 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:02.139330 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:02.143298 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:02.176182 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067214b-c5d1-43af-92a3-4574c7fbd662 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:02.210249 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063090ac-2730-40f5-a2a7-2cd65c87d468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:02.210844 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063090ac-2730-40f5-a2a7-2cd65c87d468 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:02.211088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063090ac-2730-40f5-a2a7-2cd65c87d468 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:02.211392 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063090ac-2730-40f5-a2a7-2cd65c87d468 None admin] PATH_INFO: `/v3/users/e9f3dfc54c8b4f93b2155d2806f2d80c` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:02.225785 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063090ac-2730-40f5-a2a7-2cd65c87d468 None admin] RBAC: Authorizing `identity:get_user(user_id=e9f3dfc54c8b4f93b2155d2806f2d80c)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:02.227283 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063090ac-2730-40f5-a2a7-2cd65c87d468 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:02.228959 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 107/218] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:50:02 2022] GET /identity/v3/users/e9f3dfc54c8b4f93b2155d2806f2d80c => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:02.229725 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063090ac-2730-40f5-a2a7-2cd65c87d468 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:02.236290 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 112/219] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Aug 24 16:50:01 2022] POST /identity/v3/users => generated 297 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:50:02.239317 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0a66f-8c3c-4f18-8d18-007b80f0332a None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:02.239597 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0a66f-8c3c-4f18-8d18-007b80f0332a None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:02.240043 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0a66f-8c3c-4f18-8d18-007b80f0332a None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:02.241240 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 113/220] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:02.245822 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0a66f-8c3c-4f18-8d18-007b80f0332a None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:02.354032 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063090ac-2730-40f5-a2a7-2cd65c87d468 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:02.367149 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f0a66f-8c3c-4f18-8d18-007b80f0332a None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:02.384261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:02.398969 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb8d6eb-d1eb-4425-9a12-c4de7f9ae965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:02.399672 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8d6eb-d1eb-4425-9a12-c4de7f9ae965 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:02.400106 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8d6eb-d1eb-4425-9a12-c4de7f9ae965 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:02.400366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb8d6eb-d1eb-4425-9a12-c4de7f9ae965 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:02.409587 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8bf55-f37d-42ea-805d-917ae8b49d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:02.410621 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8bf55-f37d-42ea-805d-917ae8b49d82 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:02.410901 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8bf55-f37d-42ea-805d-917ae8b49d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:02.411217 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8bf55-f37d-42ea-805d-917ae8b49d82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:02.413202 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb8d6eb-d1eb-4425-9a12-c4de7f9ae965 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:02.418102 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-5fb8d6eb-d1eb-4425-9a12-c4de7f9ae965 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:50:02.418102 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:02.418102 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:02.418102 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:02.418102 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:02.418102 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:02.418102 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:02.418102 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:02.418102 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:02.418102 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:02.418102 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:02.418102 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:02.418102 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:02.418102 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:02.418102 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:02.418102 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:02.419583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:02.419583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:02.419583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:02.419583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:02.419583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:02.419583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:02.419583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:02.419583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:02.419583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:02.419583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:02.419583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:02.419583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:02.419583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:02.419583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:02.419583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:02.419583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:02.420433 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:02.420433 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:02.420433 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:02.420433 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:02.420433 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:02.420433 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:02.420433 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:02.420433 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:02.420433 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:02.420433 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:02.420433 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:50:02.420433 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:02.424454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 108/221] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:50:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:02.426176 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76084f63-1f62-4ac2-bad3-65b01d6d9421 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:02.426176 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76084f63-1f62-4ac2-bad3-65b01d6d9421 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:02.426369 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76084f63-1f62-4ac2-bad3-65b01d6d9421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:02.448296 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-76084f63-1f62-4ac2-bad3-65b01d6d9421 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:02.451002 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-76084f63-1f62-4ac2-bad3-65b01d6d9421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:02.485761 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:02.499914 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8bf55-f37d-42ea-805d-917ae8b49d82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:02.501534 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8bf55-f37d-42ea-805d-917ae8b49d82 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:02.534879 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 109/222] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:02.535916 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76084f63-1f62-4ac2-bad3-65b01d6d9421 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:02.646404 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 114/223] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:50:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:02.652644 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8bf55-f37d-42ea-805d-917ae8b49d82 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:02.680715 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76084f63-1f62-4ac2-bad3-65b01d6d9421 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:02.701346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:02.722952 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e00a4e-e005-4559-bdce-0c15c1a14c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:02.723622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e00a4e-e005-4559-bdce-0c15c1a14c6e None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:02.723905 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e00a4e-e005-4559-bdce-0c15c1a14c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:02.724180 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e00a4e-e005-4559-bdce-0c15c1a14c6e None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:02.725131 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e00a4e-e005-4559-bdce-0c15c1a14c6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:02.725131 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e00a4e-e005-4559-bdce-0c15c1a14c6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:02.726546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e00a4e-e005-4559-bdce-0c15c1a14c6e None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:02.737496 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 110/224] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:50:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:02.744998 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e00a4e-e005-4559-bdce-0c15c1a14c6e None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:02.774400 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:02.785629 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8bf55-f37d-42ea-805d-917ae8b49d82 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:02.845369 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167bd5a0-0f58-403f-b60a-1a052955a4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:02.846293 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bd5a0-0f58-403f-b60a-1a052955a4f1 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:02.846714 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bd5a0-0f58-403f-b60a-1a052955a4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:02.847140 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bd5a0-0f58-403f-b60a-1a052955a4f1 None admin] PATH_INFO: `/v3/projects/9125daf250634e3881ac3ca4ab91d86b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:02.849676 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bd5a0-0f58-403f-b60a-1a052955a4f1 None admin] RBAC: Authorizing `identity:get_project(project_id=9125daf250634e3881ac3ca4ab91d86b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:02.851308 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bd5a0-0f58-403f-b60a-1a052955a4f1 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:02.854126 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 115/225] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:50:02 2022] GET /identity/v3/projects/9125daf250634e3881ac3ca4ab91d86b => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:50:02.860938 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167bd5a0-0f58-403f-b60a-1a052955a4f1 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:02.924972 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e00a4e-e005-4559-bdce-0c15c1a14c6e None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:02.964853 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc13b9-d644-4eb1-bbe7-3c5bbe73b52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:02.966326 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc13b9-d644-4eb1-bbe7-3c5bbe73b52b None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:02.966751 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc13b9-d644-4eb1-bbe7-3c5bbe73b52b None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:02.967191 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc13b9-d644-4eb1-bbe7-3c5bbe73b52b None admin] PATH_INFO: `/v3/users/509b873e1603479984fa60a4542905bd` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:02.968749 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc13b9-d644-4eb1-bbe7-3c5bbe73b52b None admin] RBAC: Authorizing `identity:get_user(user_id=509b873e1603479984fa60a4542905bd)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:02.970371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc13b9-d644-4eb1-bbe7-3c5bbe73b52b None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:02.972415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 111/226] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:50:02 2022] GET /identity/v3/users/509b873e1603479984fa60a4542905bd => generated 283 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:02.973415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc13b9-d644-4eb1-bbe7-3c5bbe73b52b None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:02.993088 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167bd5a0-0f58-403f-b60a-1a052955a4f1 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:03.030005 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:03.041688 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b0bdb-ab97-41de-9871-1b577519deb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:03.042315 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b0bdb-ab97-41de-9871-1b577519deb9 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:03.048506 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b0bdb-ab97-41de-9871-1b577519deb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:03.048506 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b0bdb-ab97-41de-9871-1b577519deb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:03.048506 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b0bdb-ab97-41de-9871-1b577519deb9 None admin] RBAC: Adding query filter params (role.id=d886d117c82147e6a6488228fee2ac8b, scope.project.id=9125daf250634e3881ac3ca4ab91d86b, user.id=e9f3dfc54c8b4f93b2155d2806f2d80c) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:03.048506 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b0bdb-ab97-41de-9871-1b577519deb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:03.048506 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b0bdb-ab97-41de-9871-1b577519deb9 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:03.063145 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 116/227] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:50:02 2022] GET /identity/v3/role_assignments?user.id=e9f3dfc54c8b4f93b2155d2806f2d80c&scope.project.id=9125daf250634e3881ac3ca4ab91d86b&role.id=d886d117c82147e6a6488228fee2ac8b => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:03.063145 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b0bdb-ab97-41de-9871-1b577519deb9 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:03.131541 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:03.145995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc13b9-d644-4eb1-bbe7-3c5bbe73b52b None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:03.200252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc78c55-97eb-4fe0-8a51-8f8cb7a3f394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:03.200978 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc78c55-97eb-4fe0-8a51-8f8cb7a3f394 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:03.201263 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc78c55-97eb-4fe0-8a51-8f8cb7a3f394 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:03.201526 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc78c55-97eb-4fe0-8a51-8f8cb7a3f394 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:03.230217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc78c55-97eb-4fe0-8a51-8f8cb7a3f394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:03.236834 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-2cc78c55-97eb-4fe0-8a51-8f8cb7a3f394 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:50:03.236834 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:03.236834 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:03.236834 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:03.236834 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:03.236834 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:03.236834 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:03.236834 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:03.236834 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:03.236834 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:03.236834 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:03.236834 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:03.236834 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:03.236834 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:03.236834 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:03.236834 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:03.237791 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:03.237791 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:03.237791 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:03.237791 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:03.237791 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:03.237791 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:03.237791 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:03.237791 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:03.237791 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:03.237791 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:03.237791 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:03.237791 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:03.237791 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:03.237791 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:03.237791 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:03.237791 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:03.238587 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:03.238587 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:03.238587 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:03.238587 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:03.238587 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:03.238587 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:03.238587 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:03.238587 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:03.238587 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:03.238587 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:03.238587 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:50:03.238587 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:03.241490 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 112/228] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Aug 24 16:50:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:03.248049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc78c55-97eb-4fe0-8a51-8f8cb7a3f394 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:03.277931 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b0bdb-ab97-41de-9871-1b577519deb9 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:03.328046 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8f858-3355-4313-8136-741120dfb034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:03.329739 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8f858-3355-4313-8136-741120dfb034 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:03.330433 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8f858-3355-4313-8136-741120dfb034 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:03.331783 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8f858-3355-4313-8136-741120dfb034 None admin] PATH_INFO: `/v3/projects/9125daf250634e3881ac3ca4ab91d86b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:03.334518 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf8f858-3355-4313-8136-741120dfb034 None admin] RBAC: Authorizing `identity:get_project(project_id=9125daf250634e3881ac3ca4ab91d86b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:03.337164 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf8f858-3355-4313-8136-741120dfb034 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:03.343069 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 117/229] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:50:03 2022] GET /identity/v3/projects/9125daf250634e3881ac3ca4ab91d86b => generated 302 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:03.348582 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8f858-3355-4313-8136-741120dfb034 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:03.461905 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc78c55-97eb-4fe0-8a51-8f8cb7a3f394 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:03.475526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:03.480194 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:03.487090 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8f858-3355-4313-8136-741120dfb034 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:03.526646 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b6f7f-7ef7-4532-b766-4c234ab3c6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:03.527302 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b6f7f-7ef7-4532-b766-4c234ab3c6da None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:03.527628 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b6f7f-7ef7-4532-b766-4c234ab3c6da None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:03.527904 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b6f7f-7ef7-4532-b766-4c234ab3c6da None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:03.528581 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b6f7f-7ef7-4532-b766-4c234ab3c6da None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:03.528883 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b6f7f-7ef7-4532-b766-4c234ab3c6da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:03.532424 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b6f7f-7ef7-4532-b766-4c234ab3c6da None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:03.545639 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 113/230] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:50:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:03.546945 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b6f7f-7ef7-4532-b766-4c234ab3c6da None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:03.563913 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c270e-83fe-497a-b934-2cde968b32ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:03.564934 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c270e-83fe-497a-b934-2cde968b32ca None admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:03.565761 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c270e-83fe-497a-b934-2cde968b32ca None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:03.566211 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23c270e-83fe-497a-b934-2cde968b32ca None admin] PATH_INFO: `/v3/projects/9125daf250634e3881ac3ca4ab91d86b/users/509b873e1603479984fa60a4542905bd/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:03.568636 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c270e-83fe-497a-b934-2cde968b32ca None admin] RBAC: Authorizing `identity:create_grant(project_id=9125daf250634e3881ac3ca4ab91d86b, user_id=509b873e1603479984fa60a4542905bd, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:03.576012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23c270e-83fe-497a-b934-2cde968b32ca None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:03.635970 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 118/231] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Aug 24 16:50:03 2022] PUT /identity/v3/projects/9125daf250634e3881ac3ca4ab91d86b/users/509b873e1603479984fa60a4542905bd/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:50:03.683334 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b6f7f-7ef7-4532-b766-4c234ab3c6da None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:03.726992 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da884e-d8de-4c04-b024-08fe7b089d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:03.727674 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da884e-d8de-4c04-b024-08fe7b089d21 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:03.727953 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da884e-d8de-4c04-b024-08fe7b089d21 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:03.728225 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da884e-d8de-4c04-b024-08fe7b089d21 None admin] PATH_INFO: `/v3/users/509b873e1603479984fa60a4542905bd` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:03.729366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da884e-d8de-4c04-b024-08fe7b089d21 None admin] RBAC: Authorizing `identity:get_user(user_id=509b873e1603479984fa60a4542905bd)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:03.731467 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da884e-d8de-4c04-b024-08fe7b089d21 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:03.736782 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 114/232] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:50:03 2022] GET /identity/v3/users/509b873e1603479984fa60a4542905bd => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:03.739734 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c270e-83fe-497a-b934-2cde968b32ca None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:03.883859 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23c270e-83fe-497a-b934-2cde968b32ca None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:03.937321 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619cfd4-4ecc-4702-a7fd-4cf98b71e90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:03.937977 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619cfd4-4ecc-4702-a7fd-4cf98b71e90c None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:03.938255 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619cfd4-4ecc-4702-a7fd-4cf98b71e90c None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:03.938525 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619cfd4-4ecc-4702-a7fd-4cf98b71e90c None admin] PATH_INFO: `/v3/projects/9125daf250634e3881ac3ca4ab91d86b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:03.939757 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619cfd4-4ecc-4702-a7fd-4cf98b71e90c None admin] RBAC: Authorizing `identity:get_project(project_id=9125daf250634e3881ac3ca4ab91d86b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:03.941590 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2619cfd4-4ecc-4702-a7fd-4cf98b71e90c None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:03.943268 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 119/233] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:50:03 2022] GET /identity/v3/projects/9125daf250634e3881ac3ca4ab91d86b => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:03.949783 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da884e-d8de-4c04-b024-08fe7b089d21 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:03.999083 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:04.080547 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da884e-d8de-4c04-b024-08fe7b089d21 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:04.116504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed1d2f-813c-4658-a5a8-de8ca9122863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:04.117186 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed1d2f-813c-4658-a5a8-de8ca9122863 None admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:04.117463 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed1d2f-813c-4658-a5a8-de8ca9122863 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:04.117737 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed1d2f-813c-4658-a5a8-de8ca9122863 None admin] PATH_INFO: `/v3/projects/9125daf250634e3881ac3ca4ab91d86b/users/509b873e1603479984fa60a4542905bd/roles/1c6cc7bf29b146b0a9aaf6a07607258a` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:04.120011 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed1d2f-813c-4658-a5a8-de8ca9122863 None admin] RBAC: Authorizing `identity:create_grant(project_id=9125daf250634e3881ac3ca4ab91d86b, user_id=509b873e1603479984fa60a4542905bd, role_id=1c6cc7bf29b146b0a9aaf6a07607258a)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:04.122520 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed1d2f-813c-4658-a5a8-de8ca9122863 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:04.226562 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 115/234] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Aug 24 16:50:03 2022] PUT /identity/v3/projects/9125daf250634e3881ac3ca4ab91d86b/users/509b873e1603479984fa60a4542905bd/roles/1c6cc7bf29b146b0a9aaf6a07607258a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:50:04.606412 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9473b1c-636d-4d72-8e3a-c89a87db3da7 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:04.606926 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9473b1c-636d-4d72-8e3a-c89a87db3da7 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:04.606926 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9473b1c-636d-4d72-8e3a-c89a87db3da7 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:04.608469 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 120/235] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:04.614104 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3c391-b8a4-4676-b713-f24721bda803 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:04.614529 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3c391-b8a4-4676-b713-f24721bda803 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:04.614695 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a3c391-b8a4-4676-b713-f24721bda803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:04.634092 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-85a3c391-b8a4-4676-b713-f24721bda803 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:04.635338 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-85a3c391-b8a4-4676-b713-f24721bda803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:04.714762 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91819863-f54d-43dd-9ce1-42fe6749846b None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:04.714762 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91819863-f54d-43dd-9ce1-42fe6749846b None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:04.716015 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91819863-f54d-43dd-9ce1-42fe6749846b None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:04.717616 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 121/236] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:04.722787 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b8d5b-88b1-4118-9f63-2a74b7ec503c None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:04.723069 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b8d5b-88b1-4118-9f63-2a74b7ec503c None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:04.723381 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b8d5b-88b1-4118-9f63-2a74b7ec503c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:04.733106 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 116/237] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:04.756174 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-e24b8d5b-88b1-4118-9f63-2a74b7ec503c None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:04.757386 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-e24b8d5b-88b1-4118-9f63-2a74b7ec503c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:04.775618 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:04.846233 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 122/238] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:50:05.122581 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3c391-b8a4-4676-b713-f24721bda803 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:05.153606 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b8d5b-88b1-4118-9f63-2a74b7ec503c None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:05.171049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:05.322357 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a3c391-b8a4-4676-b713-f24721bda803 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:05.379910 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f4006-5016-4064-a534-c0fd90b907c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:05.380487 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f4006-5016-4064-a534-c0fd90b907c0 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:05.380760 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f4006-5016-4064-a534-c0fd90b907c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:05.381025 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f4006-5016-4064-a534-c0fd90b907c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:05.382312 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f4006-5016-4064-a534-c0fd90b907c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:05.385650 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f4006-5016-4064-a534-c0fd90b907c0 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:05.390000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 117/239] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:05.394560 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b8d5b-88b1-4118-9f63-2a74b7ec503c None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:05.396926 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f4006-5016-4064-a534-c0fd90b907c0 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:05.464917 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d5e937-7c7e-4a90-84f9-34d3d7a2d5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:05.465815 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5e937-7c7e-4a90-84f9-34d3d7a2d5c7 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:05.466128 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5e937-7c7e-4a90-84f9-34d3d7a2d5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:05.466399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d5e937-7c7e-4a90-84f9-34d3d7a2d5c7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:05.483395 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d5e937-7c7e-4a90-84f9-34d3d7a2d5c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:05.488452 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-b0d5e937-7c7e-4a90-84f9-34d3d7a2d5c7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:50:05.488452 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:05.488452 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:05.488452 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:05.488452 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:05.488452 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:05.488452 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:05.488452 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:05.488452 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:05.488452 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:05.488452 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:05.488452 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:05.488452 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:05.488452 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:05.488452 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:05.488452 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:05.489343 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:05.489343 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:05.489343 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:05.489343 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:05.489343 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:05.489343 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:05.489343 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:05.489343 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:05.489343 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:05.489343 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:05.489343 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:05.489343 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:05.489343 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:05.489343 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:05.489343 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:05.489343 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:05.490149 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:05.490149 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:05.490149 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:05.490149 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:05.490149 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:05.490149 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:05.490149 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:05.490149 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:05.490149 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:05.490149 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:05.490149 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:50:05.490149 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:05.490149 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 123/240] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:50:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:50:05.495625 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad422536-8df8-4d51-bc39-1a49eaf0bfb2 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:05.495910 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad422536-8df8-4d51-bc39-1a49eaf0bfb2 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:05.497582 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad422536-8df8-4d51-bc39-1a49eaf0bfb2 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:05.499415 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 124/241] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:05.500159 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad422536-8df8-4d51-bc39-1a49eaf0bfb2 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:05.519402 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:05.536555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:05.543413 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f4006-5016-4064-a534-c0fd90b907c0 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:05.581057 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef18072d-2c34-4e2f-8b7e-b658387b2580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:05.581683 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18072d-2c34-4e2f-8b7e-b658387b2580 None admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:05.582128 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18072d-2c34-4e2f-8b7e-b658387b2580 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:05.582757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18072d-2c34-4e2f-8b7e-b658387b2580 None admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:05.583610 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef18072d-2c34-4e2f-8b7e-b658387b2580 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:05.585199 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef18072d-2c34-4e2f-8b7e-b658387b2580 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:05.641032 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad422536-8df8-4d51-bc39-1a49eaf0bfb2 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:05.656953 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 118/242] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Aug 24 16:50:05 2022] POST /identity/v3/users => generated 293 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:50:05.658759 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df608d0-b51b-4ec1-b14d-1e091a05da07 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:05.659051 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df608d0-b51b-4ec1-b14d-1e091a05da07 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:05.661070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df608d0-b51b-4ec1-b14d-1e091a05da07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:05.683423 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-9df608d0-b51b-4ec1-b14d-1e091a05da07 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:05.684947 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-9df608d0-b51b-4ec1-b14d-1e091a05da07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:05.707721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59df354-a4a4-4bcd-bb7c-8f2decf34827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:05.708762 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59df354-a4a4-4bcd-bb7c-8f2decf34827 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:05.709283 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59df354-a4a4-4bcd-bb7c-8f2decf34827 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:05.709818 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59df354-a4a4-4bcd-bb7c-8f2decf34827 None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:05.710792 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59df354-a4a4-4bcd-bb7c-8f2decf34827 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:05.711396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59df354-a4a4-4bcd-bb7c-8f2decf34827 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:05.713269 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59df354-a4a4-4bcd-bb7c-8f2decf34827 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:05.734976 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 125/243] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Aug 24 16:50:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:05.741217 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59df354-a4a4-4bcd-bb7c-8f2decf34827 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:05.775493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 119/244] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:05.872761 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:05.914625 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59df354-a4a4-4bcd-bb7c-8f2decf34827 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:05.954542 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafef85-d789-4ebe-9fb3-694e673ad986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:05.955613 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafef85-d789-4ebe-9fb3-694e673ad986 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:05.956116 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafef85-d789-4ebe-9fb3-694e673ad986 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:05.956607 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafef85-d789-4ebe-9fb3-694e673ad986 None admin] PATH_INFO: `/v3/users/814f3ed170634ad5891d40693a535a27` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:05.974483 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaafef85-d789-4ebe-9fb3-694e673ad986 None admin] RBAC: Authorizing `identity:get_user(user_id=814f3ed170634ad5891d40693a535a27)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:05.976446 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaafef85-d789-4ebe-9fb3-694e673ad986 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:05.978737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 126/245] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:50:05 2022] GET /identity/v3/users/814f3ed170634ad5891d40693a535a27 => generated 297 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:50:05.988146 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df608d0-b51b-4ec1-b14d-1e091a05da07 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:06.099877 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:06.122344 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafef85-d789-4ebe-9fb3-694e673ad986 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:06.123886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df608d0-b51b-4ec1-b14d-1e091a05da07 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:06.176934 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc04df1-ca89-47ce-829b-e4bc56dfe9d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:06.177551 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc04df1-ca89-47ce-829b-e4bc56dfe9d5 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:06.177837 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc04df1-ca89-47ce-829b-e4bc56dfe9d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:06.178115 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc04df1-ca89-47ce-829b-e4bc56dfe9d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:06.270689 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafef85-d789-4ebe-9fb3-694e673ad986 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:06.275763 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc04df1-ca89-47ce-829b-e4bc56dfe9d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:06.277274 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc04df1-ca89-47ce-829b-e4bc56dfe9d5 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:06.308093 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:06.317153 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8a46f-4c16-43f0-8df3-56d897aeaee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:06.317851 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8a46f-4c16-43f0-8df3-56d897aeaee7 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:06.318212 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8a46f-4c16-43f0-8df3-56d897aeaee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:06.318448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c8a46f-4c16-43f0-8df3-56d897aeaee7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:06.334952 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c8a46f-4c16-43f0-8df3-56d897aeaee7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:06.342524 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-56c8a46f-4c16-43f0-8df3-56d897aeaee7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:50:06.342524 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:06.342524 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:06.342524 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:06.342524 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:06.342524 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:06.342524 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:06.342524 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:06.342524 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:06.342524 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:06.342524 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:06.342524 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:06.342524 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:06.342524 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:06.342524 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:06.342524 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:06.343683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:06.343683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:06.343683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:06.343683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:06.343683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:06.343683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:06.343683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:06.343683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:06.343683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:06.343683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:06.343683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:06.343683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:06.343683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:06.343683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:06.343683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:06.343683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:06.346372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:06.346372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:06.346372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:06.346372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:06.346372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:06.346372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:06.346372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:06.346372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:06.346372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:06.346372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:06.346372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:50:06.346372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:06.346372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 127/246] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:50:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:50:06.349782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8a46f-4c16-43f0-8df3-56d897aeaee7 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:06.405667 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:06.438523 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 120/247] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:50:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:06.440221 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9323527-9589-4e27-915c-8735f6a2e77d None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:06.440824 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9323527-9589-4e27-915c-8735f6a2e77d None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:06.441107 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9323527-9589-4e27-915c-8735f6a2e77d None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:06.443064 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 121/248] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:06.448376 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9323527-9589-4e27-915c-8735f6a2e77d None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:06.477885 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c8a46f-4c16-43f0-8df3-56d897aeaee7 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:06.547673 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc10b294-eda6-4f23-8536-73fa073d8a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:06.548714 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10b294-eda6-4f23-8536-73fa073d8a70 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:06.550940 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10b294-eda6-4f23-8536-73fa073d8a70 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:06.551478 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc10b294-eda6-4f23-8536-73fa073d8a70 None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:06.553268 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10b294-eda6-4f23-8536-73fa073d8a70 None admin] RBAC: Adding query filter params (name=member) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:06.554065 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10b294-eda6-4f23-8536-73fa073d8a70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:06.556667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc10b294-eda6-4f23-8536-73fa073d8a70 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:06.584404 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 128/249] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Aug 24 16:50:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:50:06.586785 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93371abf-11cc-4e9b-afa6-27e1a5da2418 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:06.587331 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93371abf-11cc-4e9b-afa6-27e1a5da2418 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:06.587852 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93371abf-11cc-4e9b-afa6-27e1a5da2418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:06.609850 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-93371abf-11cc-4e9b-afa6-27e1a5da2418 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:06.611464 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-93371abf-11cc-4e9b-afa6-27e1a5da2418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:06.666868 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:06.672452 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9323527-9589-4e27-915c-8735f6a2e77d None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:06.690998 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 129/250] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:06.692098 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93371abf-11cc-4e9b-afa6-27e1a5da2418 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:06.748263 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acec798-5f40-43d4-9791-e787445de63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:06.748959 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acec798-5f40-43d4-9791-e787445de63a None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:06.749237 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acec798-5f40-43d4-9791-e787445de63a None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:06.749516 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acec798-5f40-43d4-9791-e787445de63a None admin] PATH_INFO: `/v3/projects/9125daf250634e3881ac3ca4ab91d86b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:06.750719 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acec798-5f40-43d4-9791-e787445de63a None admin] RBAC: Authorizing `identity:get_project(project_id=9125daf250634e3881ac3ca4ab91d86b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:06.752212 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acec798-5f40-43d4-9791-e787445de63a None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:06.753885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 122/251] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:50:06 2022] GET /identity/v3/projects/9125daf250634e3881ac3ca4ab91d86b => generated 302 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:06.759633 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acec798-5f40-43d4-9791-e787445de63a None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:06.809381 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93371abf-11cc-4e9b-afa6-27e1a5da2418 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:06.848682 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de4146-360f-461d-b9e2-ffae88f79c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:06.849546 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de4146-360f-461d-b9e2-ffae88f79c19 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:06.849831 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de4146-360f-461d-b9e2-ffae88f79c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:06.850107 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de4146-360f-461d-b9e2-ffae88f79c19 None admin] PATH_INFO: `/v3/users/e9f3dfc54c8b4f93b2155d2806f2d80c` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:06.851321 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de4146-360f-461d-b9e2-ffae88f79c19 None admin] RBAC: Authorizing `identity:get_user(user_id=e9f3dfc54c8b4f93b2155d2806f2d80c)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:06.852793 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de4146-360f-461d-b9e2-ffae88f79c19 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:06.854558 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 130/252] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:50:06 2022] GET /identity/v3/users/e9f3dfc54c8b4f93b2155d2806f2d80c => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:06.862560 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de4146-360f-461d-b9e2-ffae88f79c19 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:06.875510 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:06.925077 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:06.962306 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acec798-5f40-43d4-9791-e787445de63a None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:06.981516 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de4146-360f-461d-b9e2-ffae88f79c19 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:07.021923 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ae4c2-6fbf-452f-8c85-9291438389d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:07.022580 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ae4c2-6fbf-452f-8c85-9291438389d1 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:07.022859 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ae4c2-6fbf-452f-8c85-9291438389d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:07.023155 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ae4c2-6fbf-452f-8c85-9291438389d1 None admin] PATH_INFO: `/v3/projects/9125daf250634e3881ac3ca4ab91d86b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:07.024342 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ae4c2-6fbf-452f-8c85-9291438389d1 None admin] RBAC: Authorizing `identity:get_project(project_id=9125daf250634e3881ac3ca4ab91d86b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:07.025868 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51ae4c2-6fbf-452f-8c85-9291438389d1 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:07.027633 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 131/253] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:50:06 2022] GET /identity/v3/projects/9125daf250634e3881ac3ca4ab91d86b => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:07.028917 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e16058-e760-41c5-ab5a-448612e82d24 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:07.029200 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e16058-e760-41c5-ab5a-448612e82d24 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:07.029476 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e16058-e760-41c5-ab5a-448612e82d24 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:07.035079 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 132/254] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:07.035977 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e16058-e760-41c5-ab5a-448612e82d24 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:07.060087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7d9ab-f500-45ba-822f-8208851cb46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:07.061099 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7d9ab-f500-45ba-822f-8208851cb46d None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:07.061613 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7d9ab-f500-45ba-822f-8208851cb46d None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:07.062072 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7d9ab-f500-45ba-822f-8208851cb46d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:07.063048 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7d9ab-f500-45ba-822f-8208851cb46d None admin] RBAC: Adding query filter params (role.id=6eade9c7eb83430aa3d5076986bfe477, scope.project.id=9125daf250634e3881ac3ca4ab91d86b, user.id=814f3ed170634ad5891d40693a535a27) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:07.063692 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7d9ab-f500-45ba-822f-8208851cb46d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:07.065644 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7d9ab-f500-45ba-822f-8208851cb46d None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:07.080001 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 123/255] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:50:06 2022] GET /identity/v3/role_assignments?user.id=814f3ed170634ad5891d40693a535a27&scope.project.id=9125daf250634e3881ac3ca4ab91d86b&role.id=6eade9c7eb83430aa3d5076986bfe477 => generated 259 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:50:07.081637 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbe6e8-6831-411c-ab39-a789dad39619 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:07.082141 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbe6e8-6831-411c-ab39-a789dad39619 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:07.082686 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbe6e8-6831-411c-ab39-a789dad39619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:07.112897 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-12cbe6e8-6831-411c-ab39-a789dad39619 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:07.114421 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-12cbe6e8-6831-411c-ab39-a789dad39619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:07.161386 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e16058-e760-41c5-ab5a-448612e82d24 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:07.184559 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:07.205605 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34c053-eaca-4bbe-bc3e-0265684dcff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:07.206300 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34c053-eaca-4bbe-bc3e-0265684dcff1 None admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:07.206737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34c053-eaca-4bbe-bc3e-0265684dcff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:07.206957 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34c053-eaca-4bbe-bc3e-0265684dcff1 None admin] PATH_INFO: `/v3/projects/9125daf250634e3881ac3ca4ab91d86b/users/e9f3dfc54c8b4f93b2155d2806f2d80c/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:07.209253 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34c053-eaca-4bbe-bc3e-0265684dcff1 None admin] RBAC: Authorizing `identity:create_grant(project_id=9125daf250634e3881ac3ca4ab91d86b, user_id=e9f3dfc54c8b4f93b2155d2806f2d80c, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:07.210761 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34c053-eaca-4bbe-bc3e-0265684dcff1 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:07.240332 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 124/256] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:07.244722 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbe6e8-6831-411c-ab39-a789dad39619 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:07.288668 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 133/257] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Aug 24 16:50:07 2022] PUT /identity/v3/projects/9125daf250634e3881ac3ca4ab91d86b/users/e9f3dfc54c8b4f93b2155d2806f2d80c/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:50:07.316684 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:07.393644 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbe6e8-6831-411c-ab39-a789dad39619 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:07.441366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a116e-3e6e-4424-b426-e88596bab2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:07.442147 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a116e-3e6e-4424-b426-e88596bab2b7 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:07.442432 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a116e-3e6e-4424-b426-e88596bab2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:07.442711 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a116e-3e6e-4424-b426-e88596bab2b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:07.460782 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a116e-3e6e-4424-b426-e88596bab2b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:07.466715 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-290a116e-3e6e-4424-b426-e88596bab2b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:50:07.466715 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:07.466715 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:07.466715 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:07.466715 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:07.466715 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:07.466715 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:07.466715 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:07.466715 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:07.466715 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:07.466715 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:07.466715 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:07.466715 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:07.466715 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:07.466715 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:07.466715 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:07.467659 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:07.467659 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:07.467659 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:07.467659 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:07.467659 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:07.467659 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:07.467659 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:07.467659 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:07.467659 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:07.467659 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:07.467659 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:07.467659 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:07.467659 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:07.467659 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:07.467659 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:07.467659 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:07.468454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:07.468454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:07.468454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:07.468454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:07.468454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:07.468454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:07.468454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:07.468454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:07.468454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:07.468454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:07.468454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:50:07.468454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:07.468454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 125/258] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:50:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:07.473937 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34c053-eaca-4bbe-bc3e-0265684dcff1 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:07.605869 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34c053-eaca-4bbe-bc3e-0265684dcff1 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:07.651816 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a5b65-4163-460b-8e00-ac897fbbdd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:07.652529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a5b65-4163-460b-8e00-ac897fbbdd3e None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:07.652811 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a5b65-4163-460b-8e00-ac897fbbdd3e None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:07.653131 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a5b65-4163-460b-8e00-ac897fbbdd3e None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:07.653895 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a5b65-4163-460b-8e00-ac897fbbdd3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:07.654203 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a5b65-4163-460b-8e00-ac897fbbdd3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:07.655645 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a5b65-4163-460b-8e00-ac897fbbdd3e None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:07.668969 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 134/259] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:50:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:07.674587 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a116e-3e6e-4424-b426-e88596bab2b7 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:07.770440 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a5b65-4163-460b-8e00-ac897fbbdd3e None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:07.830130 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a116e-3e6e-4424-b426-e88596bab2b7 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:07.832662 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:07.857594 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:07.923875 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cab5b-8a4c-4219-aa03-3081fbd9efa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:07.924892 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cab5b-8a4c-4219-aa03-3081fbd9efa2 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:07.925395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cab5b-8a4c-4219-aa03-3081fbd9efa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:07.925860 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53cab5b-8a4c-4219-aa03-3081fbd9efa2 None admin] PATH_INFO: `/v3/users/509b873e1603479984fa60a4542905bd` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:07.927355 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cab5b-8a4c-4219-aa03-3081fbd9efa2 None admin] RBAC: Authorizing `identity:get_user(user_id=509b873e1603479984fa60a4542905bd)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:07.929114 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53cab5b-8a4c-4219-aa03-3081fbd9efa2 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:07.931306 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 126/260] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:50:07 2022] GET /identity/v3/users/509b873e1603479984fa60a4542905bd => generated 283 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:07.937406 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cab5b-8a4c-4219-aa03-3081fbd9efa2 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:07.972106 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a5b65-4163-460b-8e00-ac897fbbdd3e None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:08.025483 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e72f51-a912-4a6a-b046-36bf1feb71e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:08.026120 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e72f51-a912-4a6a-b046-36bf1feb71e3 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:08.026400 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e72f51-a912-4a6a-b046-36bf1feb71e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:08.026678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e72f51-a912-4a6a-b046-36bf1feb71e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:08.045016 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e72f51-a912-4a6a-b046-36bf1feb71e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:08.050313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-a7e72f51-a912-4a6a-b046-36bf1feb71e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:50:08.050313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:08.050313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:08.050313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:08.050313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:08.050313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:08.050313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:08.050313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:08.050313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:08.050313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:08.050313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:08.050313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:08.050313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:08.050313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:08.050313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:08.050313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:08.051228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:08.051228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:08.051228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:08.051228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:08.051228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:08.051228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:08.051228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:08.051228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:08.051228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:08.051228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:08.051228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:08.051228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:08.051228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:08.051228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:08.051228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:08.051228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:08.052020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:08.052020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:08.052020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:08.052020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:08.052020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:08.052020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:08.052020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:08.052020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:08.052020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:08.052020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:08.052020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:50:08.052020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:08.059596 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 135/261] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Aug 24 16:50:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:08.065140 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e72f51-a912-4a6a-b046-36bf1feb71e3 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:08.143841 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53cab5b-8a4c-4219-aa03-3081fbd9efa2 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:08.201332 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda0c6a-09d5-4a60-8543-ed843e4f2712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:08.202396 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda0c6a-09d5-4a60-8543-ed843e4f2712 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:08.202893 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda0c6a-09d5-4a60-8543-ed843e4f2712 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:08.203386 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda0c6a-09d5-4a60-8543-ed843e4f2712 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:08.271987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:08.276307 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:08.279924 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e72f51-a912-4a6a-b046-36bf1feb71e3 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:08.344593 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda0c6a-09d5-4a60-8543-ed843e4f2712 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:08.346448 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feda0c6a-09d5-4a60-8543-ed843e4f2712 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:08.367607 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cc4e4-7f52-4c7b-b2a7-dda006979bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:08.369238 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cc4e4-7f52-4c7b-b2a7-dda006979bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:08.369878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cc4e4-7f52-4c7b-b2a7-dda006979bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:08.371696 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cc4e4-7f52-4c7b-b2a7-dda006979bb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:08.372612 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cc4e4-7f52-4c7b-b2a7-dda006979bb3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:08.373747 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cc4e4-7f52-4c7b-b2a7-dda006979bb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:08.376214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cc4e4-7f52-4c7b-b2a7-dda006979bb3 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:08.397476 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 136/262] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:50:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:50:08.405128 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cc4e4-7f52-4c7b-b2a7-dda006979bb3 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:08.593937 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 127/263] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:50:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 657 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 16:50:08.600958 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda0c6a-09d5-4a60-8543-ed843e4f2712 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:08.675014 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cc4e4-7f52-4c7b-b2a7-dda006979bb3 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:08.776721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22285409-b1fb-420c-9e4f-cf7d305965f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:08.778112 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22285409-b1fb-420c-9e4f-cf7d305965f9 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:08.779570 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22285409-b1fb-420c-9e4f-cf7d305965f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:08.779570 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22285409-b1fb-420c-9e4f-cf7d305965f9 None admin] PATH_INFO: `/v3/users/509b873e1603479984fa60a4542905bd` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:08.783833 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22285409-b1fb-420c-9e4f-cf7d305965f9 None admin] RBAC: Authorizing `identity:get_user(user_id=509b873e1603479984fa60a4542905bd)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:08.785311 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22285409-b1fb-420c-9e4f-cf7d305965f9 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:08.787287 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 137/264] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:50:08 2022] GET /identity/v3/users/509b873e1603479984fa60a4542905bd => generated 283 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:08.787489 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:08.795638 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22285409-b1fb-420c-9e4f-cf7d305965f9 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:08.838964 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda0c6a-09d5-4a60-8543-ed843e4f2712 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:08.880968 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:08.935907 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216d851-1b6b-4725-8e1a-60651fe3cdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:08.936938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216d851-1b6b-4725-8e1a-60651fe3cdce None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:08.937413 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216d851-1b6b-4725-8e1a-60651fe3cdce None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:08.937879 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216d851-1b6b-4725-8e1a-60651fe3cdce None admin] PATH_INFO: `/v3/projects/9125daf250634e3881ac3ca4ab91d86b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:08.939287 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216d851-1b6b-4725-8e1a-60651fe3cdce None admin] RBAC: Authorizing `identity:get_project(project_id=9125daf250634e3881ac3ca4ab91d86b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:08.941255 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216d851-1b6b-4725-8e1a-60651fe3cdce None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:08.945313 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 128/265] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:50:08 2022] GET /identity/v3/projects/9125daf250634e3881ac3ca4ab91d86b => generated 302 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:50:08.953239 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216d851-1b6b-4725-8e1a-60651fe3cdce None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:09.085131 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22285409-b1fb-420c-9e4f-cf7d305965f9 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:09.167081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55450770-9f0e-4852-a6ee-a842aaae9880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:09.168651 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55450770-9f0e-4852-a6ee-a842aaae9880 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:09.168989 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55450770-9f0e-4852-a6ee-a842aaae9880 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:09.169260 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55450770-9f0e-4852-a6ee-a842aaae9880 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:09.177772 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216d851-1b6b-4725-8e1a-60651fe3cdce None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:09.217175 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5cdd2-6e76-4d69-804c-6bbe6232638e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:09.217717 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5cdd2-6e76-4d69-804c-6bbe6232638e None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:09.217996 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5cdd2-6e76-4d69-804c-6bbe6232638e None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:09.218271 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5cdd2-6e76-4d69-804c-6bbe6232638e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:09.219006 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5cdd2-6e76-4d69-804c-6bbe6232638e None admin] RBAC: Adding query filter params (role.id=99f0ace9fc4d4d028ca52fa9730cab4b, scope.project.id=9125daf250634e3881ac3ca4ab91d86b, user.id=509b873e1603479984fa60a4542905bd) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:09.219347 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5cdd2-6e76-4d69-804c-6bbe6232638e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:09.220823 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5cdd2-6e76-4d69-804c-6bbe6232638e None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:09.227608 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 129/266] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:50:08 2022] GET /identity/v3/role_assignments?user.id=509b873e1603479984fa60a4542905bd&scope.project.id=9125daf250634e3881ac3ca4ab91d86b&role.id=99f0ace9fc4d4d028ca52fa9730cab4b => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:50:09.228878 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80efe85-a2f3-4cc8-934b-0ed60b5a7425 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:09.235456 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80efe85-a2f3-4cc8-934b-0ed60b5a7425 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:09.235856 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80efe85-a2f3-4cc8-934b-0ed60b5a7425 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:09.237611 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 130/267] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:09.238772 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1266d5-4ef4-4cbe-9f2e-3474c8e53584 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:09.239105 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1266d5-4ef4-4cbe-9f2e-3474c8e53584 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:09.239402 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1266d5-4ef4-4cbe-9f2e-3474c8e53584 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:09.240855 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 131/268] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:09.259898 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f975dc-0b13-4d57-b0a7-3f2bb016f9f3 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:09.260225 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f975dc-0b13-4d57-b0a7-3f2bb016f9f3 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:09.260445 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f975dc-0b13-4d57-b0a7-3f2bb016f9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:09.288686 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:09.293467 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55450770-9f0e-4852-a6ee-a842aaae9880 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:09.295844 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55450770-9f0e-4852-a6ee-a842aaae9880 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:09.310170 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-27f975dc-0b13-4d57-b0a7-3f2bb016f9f3 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:09.311483 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-27f975dc-0b13-4d57-b0a7-3f2bb016f9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:09.350054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:09.404930 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 132/269] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:09.406288 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92518f44-8c84-474e-9a09-eebef459ed53 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:09.406697 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92518f44-8c84-474e-9a09-eebef459ed53 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:09.406977 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92518f44-8c84-474e-9a09-eebef459ed53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:09.426541 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-92518f44-8c84-474e-9a09-eebef459ed53 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:09.427782 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-92518f44-8c84-474e-9a09-eebef459ed53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:09.503052 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 133/270] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:09.529821 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 138/271] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:50:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 735 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:09.538014 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92518f44-8c84-474e-9a09-eebef459ed53 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:09.627506 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:09.675026 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92518f44-8c84-474e-9a09-eebef459ed53 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:09.717170 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729f703-b4c5-4a8e-a56f-eee4bf830f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:09.717818 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729f703-b4c5-4a8e-a56f-eee4bf830f98 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:09.718098 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729f703-b4c5-4a8e-a56f-eee4bf830f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:09.718369 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729f703-b4c5-4a8e-a56f-eee4bf830f98 None admin] PATH_INFO: `/v3/projects/9125daf250634e3881ac3ca4ab91d86b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:09.719554 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729f703-b4c5-4a8e-a56f-eee4bf830f98 None admin] RBAC: Authorizing `identity:get_project(project_id=9125daf250634e3881ac3ca4ab91d86b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:09.721010 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729f703-b4c5-4a8e-a56f-eee4bf830f98 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:09.723040 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 134/272] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:50:09 2022] GET /identity/v3/projects/9125daf250634e3881ac3ca4ab91d86b => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:09.732065 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55450770-9f0e-4852-a6ee-a842aaae9880 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:09.887613 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8801d0f-1634-48cc-aa9d-5d9a7548e68b None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:09.888549 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8801d0f-1634-48cc-aa9d-5d9a7548e68b None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:09.889013 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8801d0f-1634-48cc-aa9d-5d9a7548e68b None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:09.895199 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 135/273] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:50:09.902595 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a367c-409b-42df-bbec-e583d87472a5 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:09.903148 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a367c-409b-42df-bbec-e583d87472a5 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:09.903787 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221a367c-409b-42df-bbec-e583d87472a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:09.934263 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55450770-9f0e-4852-a6ee-a842aaae9880 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:09.943467 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-221a367c-409b-42df-bbec-e583d87472a5 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:09.945362 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-221a367c-409b-42df-bbec-e583d87472a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:09.983851 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:09.992960 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4745f8-8e6d-40ed-bdf5-70916bc39d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:09.993583 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4745f8-8e6d-40ed-bdf5-70916bc39d4d None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:09.994048 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4745f8-8e6d-40ed-bdf5-70916bc39d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:10.002036 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4745f8-8e6d-40ed-bdf5-70916bc39d4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:10.002036 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4745f8-8e6d-40ed-bdf5-70916bc39d4d None admin] RBAC: Adding query filter params (role.id=1c6cc7bf29b146b0a9aaf6a07607258a, scope.project.id=9125daf250634e3881ac3ca4ab91d86b, user.id=509b873e1603479984fa60a4542905bd) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:10.002036 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4745f8-8e6d-40ed-bdf5-70916bc39d4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:10.002036 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4745f8-8e6d-40ed-bdf5-70916bc39d4d None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:10.004003 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 139/274] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:50:09 2022] GET /identity/v3/role_assignments?user.id=509b873e1603479984fa60a4542905bd&scope.project.id=9125daf250634e3881ac3ca4ab91d86b&role.id=1c6cc7bf29b146b0a9aaf6a07607258a => generated 608 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:10.005022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4745f8-8e6d-40ed-bdf5-70916bc39d4d None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:10.031699 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 136/275] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:10.073566 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a367c-409b-42df-bbec-e583d87472a5 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:10.204252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:10.217546 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4745f8-8e6d-40ed-bdf5-70916bc39d4d None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:10.272294 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b50bf-2e40-4576-aa2b-1d4039304b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:10.272731 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b50bf-2e40-4576-aa2b-1d4039304b17 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:10.273163 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b50bf-2e40-4576-aa2b-1d4039304b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:10.273444 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b50bf-2e40-4576-aa2b-1d4039304b17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:10.274603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b50bf-2e40-4576-aa2b-1d4039304b17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:10.276847 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b50bf-2e40-4576-aa2b-1d4039304b17 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:10.279086 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 140/276] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:10.280282 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7b97a-7bb3-4326-b301-e35dfa652fe9 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:10.280561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7b97a-7bb3-4326-b301-e35dfa652fe9 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:10.280838 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7b97a-7bb3-4326-b301-e35dfa652fe9 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:10.281320 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221a367c-409b-42df-bbec-e583d87472a5 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:10.282289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 141/277] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:10.289610 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7b97a-7bb3-4326-b301-e35dfa652fe9 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:10.328190 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3de1e72-82c8-4ed3-aa81-a11418078c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:10.328190 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de1e72-82c8-4ed3-aa81-a11418078c99 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:10.328623 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de1e72-82c8-4ed3-aa81-a11418078c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:10.328888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3de1e72-82c8-4ed3-aa81-a11418078c99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:10.345141 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3de1e72-82c8-4ed3-aa81-a11418078c99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:10.351261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-d3de1e72-82c8-4ed3-aa81-a11418078c99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:50:10.351261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:10.351261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:10.351261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:10.351261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:10.351261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:10.351261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:10.351261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:10.351261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:10.351261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:10.351261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:10.351261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:10.351261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:10.351261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:10.351261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:10.351261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:10.352175 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:10.352175 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:10.352175 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:10.352175 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:10.352175 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:10.352175 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:10.352175 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:10.352175 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:10.352175 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:10.352175 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:10.352175 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:10.352175 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:10.352175 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:10.352175 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:10.352175 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:10.352175 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:10.353552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:10.353552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:10.353552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:10.353552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:10.353552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:10.353552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:10.353552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:10.353552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:10.353552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:10.353552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:10.353552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:50:10.353552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:10.353552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 137/278] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:50:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:50:10.354423 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5bd49-8482-4a20-bcd8-3bc2fccaaa1e None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:10.354423 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5bd49-8482-4a20-bcd8-3bc2fccaaa1e None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:10.354423 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d5bd49-8482-4a20-bcd8-3bc2fccaaa1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:10.373406 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-14d5bd49-8482-4a20-bcd8-3bc2fccaaa1e None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:10.374594 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-14d5bd49-8482-4a20-bcd8-3bc2fccaaa1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:10.376302 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:10.417218 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7b97a-7bb3-4326-b301-e35dfa652fe9 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:10.445495 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 138/279] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:10.446373 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5bd49-8482-4a20-bcd8-3bc2fccaaa1e None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:10.458371 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29140922-51f5-4256-a219-b0f12a3bb819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:10.458917 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29140922-51f5-4256-a219-b0f12a3bb819 None admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:10.459229 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29140922-51f5-4256-a219-b0f12a3bb819 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:10.459517 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29140922-51f5-4256-a219-b0f12a3bb819 None admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:10.460169 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29140922-51f5-4256-a219-b0f12a3bb819 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:10.461623 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29140922-51f5-4256-a219-b0f12a3bb819 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:10.497974 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:10.547842 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d5bd49-8482-4a20-bcd8-3bc2fccaaa1e None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:10.579596 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 142/280] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Aug 24 16:50:10 2022] POST /identity/v3/users => generated 293 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:50:10.580405 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29140922-51f5-4256-a219-b0f12a3bb819 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:10.590766 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa014a5e-3bf4-42a7-a600-06fa7d84fd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:10.590766 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa014a5e-3bf4-42a7-a600-06fa7d84fd33 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:10.591435 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa014a5e-3bf4-42a7-a600-06fa7d84fd33 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:10.591729 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa014a5e-3bf4-42a7-a600-06fa7d84fd33 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:10.606727 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa014a5e-3bf4-42a7-a600-06fa7d84fd33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:10.612596 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-aa014a5e-3bf4-42a7-a600-06fa7d84fd33 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:50:10.612596 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:10.612596 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:10.612596 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:10.612596 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:10.612596 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:10.612596 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:10.612596 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:10.612596 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:10.612596 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:10.612596 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:10.612596 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:10.612596 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:10.612596 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:10.612596 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:10.612596 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:10.615466 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:10.615466 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:10.615466 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:10.615466 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:10.615466 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:10.615466 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:10.615466 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:10.615466 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:10.615466 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:10.615466 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:10.615466 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:10.615466 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:10.615466 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:10.615466 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:10.615466 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:10.615466 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:10.616280 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:10.616280 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:10.616280 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:10.616280 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:10.616280 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:10.616280 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:10.616280 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:10.616280 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:10.616280 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:10.616280 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:10.616280 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:50:10.616280 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:10.616280 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 139/281] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:50:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:10.620238 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa014a5e-3bf4-42a7-a600-06fa7d84fd33 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:10.703644 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29140922-51f5-4256-a219-b0f12a3bb819 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:10.724266 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:10.744622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa014a5e-3bf4-42a7-a600-06fa7d84fd33 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:10.746957 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5be67d-be7d-4600-bda1-6cf1388ab533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:10.747749 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5be67d-be7d-4600-bda1-6cf1388ab533 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:10.747919 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5be67d-be7d-4600-bda1-6cf1388ab533 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:10.748175 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5be67d-be7d-4600-bda1-6cf1388ab533 None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:10.748859 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5be67d-be7d-4600-bda1-6cf1388ab533 None admin] RBAC: Adding query filter params (name=member) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:10.749226 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5be67d-be7d-4600-bda1-6cf1388ab533 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:10.750604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5be67d-be7d-4600-bda1-6cf1388ab533 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:10.756844 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:10.763618 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 143/282] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Aug 24 16:50:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:10.764560 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5be67d-be7d-4600-bda1-6cf1388ab533 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:10.785677 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd00b7-55a3-4312-bad0-b3071cec3536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:10.789298 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd00b7-55a3-4312-bad0-b3071cec3536 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:10.789298 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd00b7-55a3-4312-bad0-b3071cec3536 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:10.789298 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd00b7-55a3-4312-bad0-b3071cec3536 None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:10.789298 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd00b7-55a3-4312-bad0-b3071cec3536 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:10.789298 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd00b7-55a3-4312-bad0-b3071cec3536 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:10.790140 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd00b7-55a3-4312-bad0-b3071cec3536 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:10.800649 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 140/283] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Aug 24 16:50:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:50:10.801546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd00b7-55a3-4312-bad0-b3071cec3536 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:10.908343 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5be67d-be7d-4600-bda1-6cf1388ab533 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:10.942014 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd00b7-55a3-4312-bad0-b3071cec3536 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:10.954528 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f67bc-3d75-422d-9c06-e9c5487744dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:10.955290 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f67bc-3d75-422d-9c06-e9c5487744dc None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:10.955575 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f67bc-3d75-422d-9c06-e9c5487744dc None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:10.955850 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0f67bc-3d75-422d-9c06-e9c5487744dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:10.968524 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0f67bc-3d75-422d-9c06-e9c5487744dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:10.975396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-3f0f67bc-3d75-422d-9c06-e9c5487744dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:50:10.975396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:10.975396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:10.975396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:10.975396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:10.975396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:10.975396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:10.975396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:10.975396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:10.975396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:10.975396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:10.975396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:10.975396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:10.975396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:10.975396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:10.975396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:10.976281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:10.976281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:10.976281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:10.976281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:10.976281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:10.976281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:10.976281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:10.976281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:10.976281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:10.976281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:10.976281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:10.976281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:10.976281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:10.976281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:10.976281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:10.976281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:10.977091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:10.977091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:10.977091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:10.977091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:10.977091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:10.977091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:10.977091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:10.977091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:10.977091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:10.977091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:10.977091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:50:10.977091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:10.977091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 144/284] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:50:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:10.977796 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f67bc-3d75-422d-9c06-e9c5487744dc None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:10.990480 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166b101-b0cb-4cb6-8ba5-880bee474dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:10.992024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166b101-b0cb-4cb6-8ba5-880bee474dad None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:10.992483 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166b101-b0cb-4cb6-8ba5-880bee474dad None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:10.992898 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166b101-b0cb-4cb6-8ba5-880bee474dad None admin] PATH_INFO: `/v3/users/8229e1e4856e4c61a0d26a485ca7316b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:11.009151 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6166b101-b0cb-4cb6-8ba5-880bee474dad None admin] RBAC: Authorizing `identity:get_user(user_id=8229e1e4856e4c61a0d26a485ca7316b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:11.010640 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6166b101-b0cb-4cb6-8ba5-880bee474dad None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:11.013435 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 141/285] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:50:10 2022] GET /identity/v3/users/8229e1e4856e4c61a0d26a485ca7316b => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:11.014057 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166b101-b0cb-4cb6-8ba5-880bee474dad None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:11.033380 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:11.053438 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:11.106153 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0f67bc-3d75-422d-9c06-e9c5487744dc None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:11.134143 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166b101-b0cb-4cb6-8ba5-880bee474dad None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:11.146990 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae5b72-c922-4c9d-af0c-d34a65fc8a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:11.147961 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae5b72-c922-4c9d-af0c-d34a65fc8a11 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:11.148383 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae5b72-c922-4c9d-af0c-d34a65fc8a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:11.148810 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ae5b72-c922-4c9d-af0c-d34a65fc8a11 None admin] PATH_INFO: `/v3/users/814f3ed170634ad5891d40693a535a27` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:11.150423 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae5b72-c922-4c9d-af0c-d34a65fc8a11 None admin] RBAC: Authorizing `identity:get_user(user_id=814f3ed170634ad5891d40693a535a27)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:11.152517 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ae5b72-c922-4c9d-af0c-d34a65fc8a11 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:11.154464 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 145/286] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:50:10 2022] GET /identity/v3/users/814f3ed170634ad5891d40693a535a27 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:11.155516 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae5b72-c922-4c9d-af0c-d34a65fc8a11 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:11.176888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10093993-308b-4c1e-bbe1-584e6936a31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:11.177509 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10093993-308b-4c1e-bbe1-584e6936a31e None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:11.177958 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10093993-308b-4c1e-bbe1-584e6936a31e None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:11.178073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10093993-308b-4c1e-bbe1-584e6936a31e None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:11.178710 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10093993-308b-4c1e-bbe1-584e6936a31e None admin] RBAC: Adding query filter params (name=member) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:11.179015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10093993-308b-4c1e-bbe1-584e6936a31e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:11.180454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10093993-308b-4c1e-bbe1-584e6936a31e None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:11.190657 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 142/287] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Aug 24 16:50:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:11.191596 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10093993-308b-4c1e-bbe1-584e6936a31e None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:11.276373 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ae5b72-c922-4c9d-af0c-d34a65fc8a11 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:11.287520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:11.309773 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:11.315887 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8155c8-1056-4e99-b7a9-7f7d409d32e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:11.316067 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10093993-308b-4c1e-bbe1-584e6936a31e None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:11.316935 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8155c8-1056-4e99-b7a9-7f7d409d32e3 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:11.317415 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8155c8-1056-4e99-b7a9-7f7d409d32e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:11.317905 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8155c8-1056-4e99-b7a9-7f7d409d32e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:11.319156 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8155c8-1056-4e99-b7a9-7f7d409d32e3 None admin] RBAC: Adding query filter params (role.id=d886d117c82147e6a6488228fee2ac8b, user.id=8229e1e4856e4c61a0d26a485ca7316b, scope.system=all) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:11.319676 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8155c8-1056-4e99-b7a9-7f7d409d32e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:11.321357 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8155c8-1056-4e99-b7a9-7f7d409d32e3 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:11.327367 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 146/288] 10.222.0.55 () {56 vars in 1308 bytes} [Wed Aug 24 16:50:11 2022] GET /identity/v3/role_assignments?user.id=8229e1e4856e4c61a0d26a485ca7316b&scope.system=all&role.id=d886d117c82147e6a6488228fee2ac8b => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:11.328585 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8155c8-1056-4e99-b7a9-7f7d409d32e3 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:11.361777 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2287dd-1897-4a38-8030-7e74ea88b9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:11.362411 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2287dd-1897-4a38-8030-7e74ea88b9ce None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:11.362691 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2287dd-1897-4a38-8030-7e74ea88b9ce None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:11.362965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2287dd-1897-4a38-8030-7e74ea88b9ce None admin] PATH_INFO: `/v3/projects/9125daf250634e3881ac3ca4ab91d86b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:11.364218 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2287dd-1897-4a38-8030-7e74ea88b9ce None admin] RBAC: Authorizing `identity:get_project(project_id=9125daf250634e3881ac3ca4ab91d86b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:11.365890 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2287dd-1897-4a38-8030-7e74ea88b9ce None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:11.367534 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 143/289] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:50:11 2022] GET /identity/v3/projects/9125daf250634e3881ac3ca4ab91d86b => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:11.373954 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2287dd-1897-4a38-8030-7e74ea88b9ce None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:11.458224 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8155c8-1056-4e99-b7a9-7f7d409d32e3 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:11.495068 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2287dd-1897-4a38-8030-7e74ea88b9ce None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:11.505672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb33549-e044-473b-80f1-325660535fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:11.506327 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb33549-e044-473b-80f1-325660535fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:11.506604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb33549-e044-473b-80f1-325660535fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:11.506875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb33549-e044-473b-80f1-325660535fc6 None admin] PATH_INFO: `/v3/users/e9f3dfc54c8b4f93b2155d2806f2d80c` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:11.508660 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb33549-e044-473b-80f1-325660535fc6 None admin] RBAC: Authorizing `identity:get_user(user_id=e9f3dfc54c8b4f93b2155d2806f2d80c)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:11.510927 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb33549-e044-473b-80f1-325660535fc6 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:11.513616 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 147/290] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:50:11 2022] GET /identity/v3/users/e9f3dfc54c8b4f93b2155d2806f2d80c => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:11.519160 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb33549-e044-473b-80f1-325660535fc6 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:11.539083 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e044b-43d6-4676-8d97-2e546d155270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:11.540451 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e044b-43d6-4676-8d97-2e546d155270 None admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:11.540938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e044b-43d6-4676-8d97-2e546d155270 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:11.541409 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e044b-43d6-4676-8d97-2e546d155270 None admin] PATH_INFO: `/v3/projects/9125daf250634e3881ac3ca4ab91d86b/users/814f3ed170634ad5891d40693a535a27/roles/6eade9c7eb83430aa3d5076986bfe477` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:11.544103 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e044b-43d6-4676-8d97-2e546d155270 None admin] RBAC: Authorizing `identity:create_grant(project_id=9125daf250634e3881ac3ca4ab91d86b, user_id=814f3ed170634ad5891d40693a535a27, role_id=6eade9c7eb83430aa3d5076986bfe477)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:11.545773 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e044b-43d6-4676-8d97-2e546d155270 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:11.571580 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:11.641732 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 144/291] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Aug 24 16:50:11 2022] PUT /identity/v3/projects/9125daf250634e3881ac3ca4ab91d86b/users/814f3ed170634ad5891d40693a535a27/roles/6eade9c7eb83430aa3d5076986bfe477 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:50:11.646612 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb33549-e044-473b-80f1-325660535fc6 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:11.687945 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aded184-b7c2-4e06-9809-a4fd842f0009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:11.688628 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aded184-b7c2-4e06-9809-a4fd842f0009 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:11.688910 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aded184-b7c2-4e06-9809-a4fd842f0009 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:11.689176 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aded184-b7c2-4e06-9809-a4fd842f0009 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:11.797472 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aded184-b7c2-4e06-9809-a4fd842f0009 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:11.798878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aded184-b7c2-4e06-9809-a4fd842f0009 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:11.847360 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:11.916651 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 148/292] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:50:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 16:50:11.922879 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e044b-43d6-4676-8d97-2e546d155270 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:11.947778 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:12.048543 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e044b-43d6-4676-8d97-2e546d155270 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:12.085182 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ea003-9bdc-41b6-9722-c26e0ba6374e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:12.085832 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ea003-9bdc-41b6-9722-c26e0ba6374e None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:12.086113 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ea003-9bdc-41b6-9722-c26e0ba6374e None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:12.086389 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ea003-9bdc-41b6-9722-c26e0ba6374e None admin] PATH_INFO: `/v3/projects/9125daf250634e3881ac3ca4ab91d86b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:12.087582 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ea003-9bdc-41b6-9722-c26e0ba6374e None admin] RBAC: Authorizing `identity:get_project(project_id=9125daf250634e3881ac3ca4ab91d86b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:12.089042 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ea003-9bdc-41b6-9722-c26e0ba6374e None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:12.091599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 145/293] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:50:11 2022] GET /identity/v3/projects/9125daf250634e3881ac3ca4ab91d86b => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:12.097440 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aded184-b7c2-4e06-9809-a4fd842f0009 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:12.217177 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aded184-b7c2-4e06-9809-a4fd842f0009 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:12.256733 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a92d58-44b9-4fb0-a8f2-ed837c415da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:12.257343 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a92d58-44b9-4fb0-a8f2-ed837c415da1 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:12.257618 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a92d58-44b9-4fb0-a8f2-ed837c415da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:12.257884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a92d58-44b9-4fb0-a8f2-ed837c415da1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:12.258613 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a92d58-44b9-4fb0-a8f2-ed837c415da1 None admin] RBAC: Adding query filter params (role.id=d886d117c82147e6a6488228fee2ac8b, scope.project.id=9125daf250634e3881ac3ca4ab91d86b, user.id=e9f3dfc54c8b4f93b2155d2806f2d80c) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:12.258917 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a92d58-44b9-4fb0-a8f2-ed837c415da1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:12.260363 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a92d58-44b9-4fb0-a8f2-ed837c415da1 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:12.266741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 149/294] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:50:12 2022] GET /identity/v3/role_assignments?user.id=e9f3dfc54c8b4f93b2155d2806f2d80c&scope.project.id=9125daf250634e3881ac3ca4ab91d86b&role.id=d886d117c82147e6a6488228fee2ac8b => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:12.955124 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815d660-e794-427b-a4b5-0a38c914bc45 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:12.955671 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815d660-e794-427b-a4b5-0a38c914bc45 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:12.955671 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815d660-e794-427b-a4b5-0a38c914bc45 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:12.957149 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 146/295] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:12.962692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af95c91-1289-4f36-bca0-6f8831783c91 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:12.963152 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af95c91-1289-4f36-bca0-6f8831783c91 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:12.963334 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af95c91-1289-4f36-bca0-6f8831783c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:12.973408 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:12.986418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-2af95c91-1289-4f36-bca0-6f8831783c91 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:12.991705 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-2af95c91-1289-4f36-bca0-6f8831783c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:13.063248 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 150/296] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:13.195778 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d5cf6-16b7-4a33-b9ec-711fdc965d68 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:13.196114 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d5cf6-16b7-4a33-b9ec-711fdc965d68 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:13.196289 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145d5cf6-16b7-4a33-b9ec-711fdc965d68 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:13.197865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 147/297] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:13.203655 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d85502-7a3b-4a0f-9e03-ae6bba96f8c3 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:13.203942 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d85502-7a3b-4a0f-9e03-ae6bba96f8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:13.204221 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d85502-7a3b-4a0f-9e03-ae6bba96f8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:13.224117 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-38d85502-7a3b-4a0f-9e03-ae6bba96f8c3 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:13.225363 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-38d85502-7a3b-4a0f-9e03-ae6bba96f8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:13.303080 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 151/298] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:13.332404 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d5cf6-16b7-4a33-b9ec-711fdc965d68 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:13.426993 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:13.442227 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145d5cf6-16b7-4a33-b9ec-711fdc965d68 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:13.479049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1032824-9756-46c4-8290-1c88d07e9cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:13.479633 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1032824-9756-46c4-8290-1c88d07e9cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:13.479964 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1032824-9756-46c4-8290-1c88d07e9cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:13.480372 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1032824-9756-46c4-8290-1c88d07e9cf0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:13.481486 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1032824-9756-46c4-8290-1c88d07e9cf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:13.482912 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1032824-9756-46c4-8290-1c88d07e9cf0 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:13.484802 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 148/299] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:13.490356 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d85502-7a3b-4a0f-9e03-ae6bba96f8c3 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:13.554868 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:13.583919 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1032824-9756-46c4-8290-1c88d07e9cf0 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:13.598380 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d85502-7a3b-4a0f-9e03-ae6bba96f8c3 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:13.638364 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baed8e7d-7aff-42a1-b963-d3ec69245760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:13.639100 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed8e7d-7aff-42a1-b963-d3ec69245760 None admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:13.639393 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed8e7d-7aff-42a1-b963-d3ec69245760 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:13.639659 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baed8e7d-7aff-42a1-b963-d3ec69245760 None admin] PATH_INFO: `/v3/groups` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:13.640407 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed8e7d-7aff-42a1-b963-d3ec69245760 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:13.641904 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baed8e7d-7aff-42a1-b963-d3ec69245760 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:13.696755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1032824-9756-46c4-8290-1c88d07e9cf0 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:13.700665 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 152/300] 10.222.0.55 () {60 vars in 1134 bytes} [Wed Aug 24 16:50:13 2022] POST /identity/v3/groups => generated 229 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:50:13.702039 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb4b45-a1c0-46bd-99c6-904d30be2484 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:13.702325 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb4b45-a1c0-46bd-99c6-904d30be2484 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:13.702598 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb4b45-a1c0-46bd-99c6-904d30be2484 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:13.704409 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 153/301] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:13.710194 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d77ca-d674-4501-9909-673cec9a5ed9 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:13.710497 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d77ca-d674-4501-9909-673cec9a5ed9 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:13.710750 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d77ca-d674-4501-9909-673cec9a5ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:13.736965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-fb8d77ca-d674-4501-9909-673cec9a5ed9 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:13.738172 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-fb8d77ca-d674-4501-9909-673cec9a5ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:13.752259 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9704ce-4b68-480c-b92a-c79a9a69ab8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:13.752946 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9704ce-4b68-480c-b92a-c79a9a69ab8a None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:13.753227 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9704ce-4b68-480c-b92a-c79a9a69ab8a None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:13.753504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9704ce-4b68-480c-b92a-c79a9a69ab8a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:13.765557 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9704ce-4b68-480c-b92a-c79a9a69ab8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:13.770635 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-fd9704ce-4b68-480c-b92a-c79a9a69ab8a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:50:13.770635 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:13.770635 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:13.770635 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:13.770635 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:13.770635 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:13.770635 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:13.770635 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:13.770635 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:13.770635 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:13.770635 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:13.770635 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:13.770635 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:13.770635 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:13.770635 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:13.770635 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:13.771622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:13.771622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:13.771622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:13.771622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:13.771622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:13.771622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:13.771622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:13.771622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:13.771622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:13.771622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:13.771622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:13.771622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:13.771622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:13.771622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:13.771622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:13.771622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:13.772407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:13.772407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:13.772407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:13.772407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:13.772407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:13.772407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:13.772407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:13.772407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:13.772407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:13.772407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:13.772407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:50:13.772407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:13.772407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 149/302] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:50:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:13.778310 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9704ce-4b68-480c-b92a-c79a9a69ab8a None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:13.806210 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:13.840049 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 154/303] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:50:13.912801 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9704ce-4b68-480c-b92a-c79a9a69ab8a None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:13.951908 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc87ba1-e035-47ae-85cf-45a7c48cf944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:13.952521 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc87ba1-e035-47ae-85cf-45a7c48cf944 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:13.952804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc87ba1-e035-47ae-85cf-45a7c48cf944 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:13.953073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc87ba1-e035-47ae-85cf-45a7c48cf944 None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:13.953742 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc87ba1-e035-47ae-85cf-45a7c48cf944 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:13.954053 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc87ba1-e035-47ae-85cf-45a7c48cf944 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:13.955492 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc87ba1-e035-47ae-85cf-45a7c48cf944 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:13.965501 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 150/304] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Aug 24 16:50:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:13.970988 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d77ca-d674-4501-9909-673cec9a5ed9 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:14.000527 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e4268-5f8d-410b-90cc-6e7f9028c7c7 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:14.000906 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e4268-5f8d-410b-90cc-6e7f9028c7c7 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:14.001408 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e4268-5f8d-410b-90cc-6e7f9028c7c7 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:14.003639 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 151/305] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:50:14.008852 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aac317-46f8-4cb1-a40d-3dd1c512249b None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:14.009133 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aac317-46f8-4cb1-a40d-3dd1c512249b None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:14.009403 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aac317-46f8-4cb1-a40d-3dd1c512249b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:14.027772 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-25aac317-46f8-4cb1-a40d-3dd1c512249b None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:14.028978 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-25aac317-46f8-4cb1-a40d-3dd1c512249b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:14.038078 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:14.091450 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d77ca-d674-4501-9909-673cec9a5ed9 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:14.122545 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 152/306] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:50:14.134574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f051566-8a3b-4d14-bc82-d689b393de12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:14.135489 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f051566-8a3b-4d14-bc82-d689b393de12 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:14.135962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f051566-8a3b-4d14-bc82-d689b393de12 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:14.136969 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f051566-8a3b-4d14-bc82-d689b393de12 None admin] PATH_INFO: `/v3/users/55e4a36b58434f8ea002bddfe71ca6fd` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:14.146619 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aac317-46f8-4cb1-a40d-3dd1c512249b None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:14.153882 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f051566-8a3b-4d14-bc82-d689b393de12 None admin] RBAC: Authorizing `identity:get_user(user_id=55e4a36b58434f8ea002bddfe71ca6fd)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:14.155360 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f051566-8a3b-4d14-bc82-d689b393de12 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:14.157451 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 155/307] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:50:13 2022] GET /identity/v3/users/55e4a36b58434f8ea002bddfe71ca6fd => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:14.159384 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:14.163696 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f051566-8a3b-4d14-bc82-d689b393de12 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:14.291186 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aac317-46f8-4cb1-a40d-3dd1c512249b None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:14.295927 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f051566-8a3b-4d14-bc82-d689b393de12 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:14.316437 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:14.339268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ba191-993d-4aea-a97f-8d873bf98241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:14.340115 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ba191-993d-4aea-a97f-8d873bf98241 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:14.340443 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ba191-993d-4aea-a97f-8d873bf98241 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:14.340782 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ba191-993d-4aea-a97f-8d873bf98241 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:14.343422 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9f712-c09f-4a55-bf60-ecab9f0d858f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:14.344487 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9f712-c09f-4a55-bf60-ecab9f0d858f None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:14.344941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9f712-c09f-4a55-bf60-ecab9f0d858f None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:14.345404 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9f712-c09f-4a55-bf60-ecab9f0d858f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:14.346583 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9f712-c09f-4a55-bf60-ecab9f0d858f None admin] RBAC: Adding query filter params (role.id=6eade9c7eb83430aa3d5076986bfe477, user.id=55e4a36b58434f8ea002bddfe71ca6fd, scope.system=all) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:14.347270 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9f712-c09f-4a55-bf60-ecab9f0d858f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:14.349284 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9f712-c09f-4a55-bf60-ecab9f0d858f None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:14.352535 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ba191-993d-4aea-a97f-8d873bf98241 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:14.360002 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-df3ba191-993d-4aea-a97f-8d873bf98241 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:50:14.360002 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:14.360002 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:14.360002 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:14.360002 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:14.360002 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:14.360002 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:14.360002 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:14.360002 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:14.360002 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:14.360002 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:14.360002 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:14.360002 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:14.360002 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:14.360002 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:14.360002 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:14.360931 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:14.360931 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:14.360931 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:14.360931 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:14.360931 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:14.360931 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:14.360931 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:14.360931 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:14.360931 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:14.360931 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:14.360931 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:14.360931 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:14.360931 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:14.360931 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:14.360931 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:14.360931 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:14.361752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:14.361752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:14.361752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:14.361752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:14.361752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:14.361752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:14.361752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:14.361752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:14.361752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:14.361752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:14.361752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:50:14.361752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:14.361752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 153/308] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:50:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:14.362990 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 156/309] 10.222.0.55 () {56 vars in 1308 bytes} [Wed Aug 24 16:50:14 2022] GET /identity/v3/role_assignments?user.id=55e4a36b58434f8ea002bddfe71ca6fd&scope.system=all&role.id=6eade9c7eb83430aa3d5076986bfe477 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:14.372238 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ba191-993d-4aea-a97f-8d873bf98241 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:14.391715 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9f712-c09f-4a55-bf60-ecab9f0d858f None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:14.451324 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:14.493151 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ba191-993d-4aea-a97f-8d873bf98241 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:14.534646 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7dcbc-0932-4c0f-8b69-8c4b9d324c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:14.536059 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7dcbc-0932-4c0f-8b69-8c4b9d324c2c None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:14.536327 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7dcbc-0932-4c0f-8b69-8c4b9d324c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:14.536597 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7dcbc-0932-4c0f-8b69-8c4b9d324c2c None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:14.537269 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7dcbc-0932-4c0f-8b69-8c4b9d324c2c None admin] RBAC: Adding query filter params (name=member) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:14.537571 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7dcbc-0932-4c0f-8b69-8c4b9d324c2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:14.538949 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7dcbc-0932-4c0f-8b69-8c4b9d324c2c None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:14.540965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9f712-c09f-4a55-bf60-ecab9f0d858f None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:14.548178 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 154/310] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Aug 24 16:50:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:14.555477 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7dcbc-0932-4c0f-8b69-8c4b9d324c2c None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:14.580780 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba53d1b-1de6-42a9-b5fa-eb5386953d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:14.581692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba53d1b-1de6-42a9-b5fa-eb5386953d17 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:14.581974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba53d1b-1de6-42a9-b5fa-eb5386953d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:14.582247 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba53d1b-1de6-42a9-b5fa-eb5386953d17 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:14.597502 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba53d1b-1de6-42a9-b5fa-eb5386953d17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:14.603765 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-7ba53d1b-1de6-42a9-b5fa-eb5386953d17 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:50:14.603765 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:14.603765 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:14.603765 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:14.603765 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:14.603765 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:14.603765 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:14.603765 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:14.603765 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:14.603765 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:14.603765 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:14.603765 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:14.603765 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:14.603765 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:14.603765 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:14.603765 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:14.604684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:14.604684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:14.604684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:14.604684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:14.604684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:14.604684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:14.604684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:14.604684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:14.604684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:14.604684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:14.604684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:14.604684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:14.604684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:14.604684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:14.604684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:14.604684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:14.605510 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:14.605510 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:14.605510 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:14.605510 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:14.605510 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:14.605510 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:14.605510 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:14.605510 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:14.605510 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:14.605510 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:14.605510 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:50:14.605510 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:14.606282 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 157/311] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:50:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:50:14.611445 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba53d1b-1de6-42a9-b5fa-eb5386953d17 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:14.667457 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:14.674544 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7dcbc-0932-4c0f-8b69-8c4b9d324c2c None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:14.707568 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:14.714329 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd61405-1257-40e2-bd6e-c47fdd167a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:14.716791 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd61405-1257-40e2-bd6e-c47fdd167a4a None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:14.717262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd61405-1257-40e2-bd6e-c47fdd167a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:14.717722 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd61405-1257-40e2-bd6e-c47fdd167a4a None admin] PATH_INFO: `/v3/users/8229e1e4856e4c61a0d26a485ca7316b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:14.719918 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd61405-1257-40e2-bd6e-c47fdd167a4a None admin] RBAC: Authorizing `identity:get_user(user_id=8229e1e4856e4c61a0d26a485ca7316b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:14.722240 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd61405-1257-40e2-bd6e-c47fdd167a4a None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:14.725362 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 155/312] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:50:14 2022] GET /identity/v3/users/8229e1e4856e4c61a0d26a485ca7316b => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:14.732170 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd61405-1257-40e2-bd6e-c47fdd167a4a None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:14.766026 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba53d1b-1de6-42a9-b5fa-eb5386953d17 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:14.812284 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dff44c-2d22-46b0-83a2-df9d7efe2157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:14.813223 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dff44c-2d22-46b0-83a2-df9d7efe2157 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:14.813639 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dff44c-2d22-46b0-83a2-df9d7efe2157 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:14.814027 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dff44c-2d22-46b0-83a2-df9d7efe2157 None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:14.814707 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dff44c-2d22-46b0-83a2-df9d7efe2157 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:14.815293 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dff44c-2d22-46b0-83a2-df9d7efe2157 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:14.816732 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dff44c-2d22-46b0-83a2-df9d7efe2157 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:14.829221 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 158/313] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Aug 24 16:50:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:14.834456 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dff44c-2d22-46b0-83a2-df9d7efe2157 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:14.871558 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd61405-1257-40e2-bd6e-c47fdd167a4a None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:14.911374 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06622ed-dfba-49f3-b8f7-a7d0dacd59e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:14.912108 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06622ed-dfba-49f3-b8f7-a7d0dacd59e3 None admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:14.912394 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06622ed-dfba-49f3-b8f7-a7d0dacd59e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:14.912678 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06622ed-dfba-49f3-b8f7-a7d0dacd59e3 None admin] PATH_INFO: `/v3/system/users/8229e1e4856e4c61a0d26a485ca7316b/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:14.914513 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06622ed-dfba-49f3-b8f7-a7d0dacd59e3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8229e1e4856e4c61a0d26a485ca7316b, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:14.916016 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06622ed-dfba-49f3-b8f7-a7d0dacd59e3 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:14.953322 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:14.957731 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dff44c-2d22-46b0-83a2-df9d7efe2157 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:14.993079 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f804771-0b41-4345-8520-4ded15382d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:14.993789 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f804771-0b41-4345-8520-4ded15382d3d None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:14.993999 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f804771-0b41-4345-8520-4ded15382d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:14.994315 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f804771-0b41-4345-8520-4ded15382d3d None admin] PATH_INFO: `/v3/users/814f3ed170634ad5891d40693a535a27` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:14.995525 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f804771-0b41-4345-8520-4ded15382d3d None admin] RBAC: Authorizing `identity:get_user(user_id=814f3ed170634ad5891d40693a535a27)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:14.996963 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f804771-0b41-4345-8520-4ded15382d3d None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:14.998737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 159/314] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:50:14 2022] GET /identity/v3/users/814f3ed170634ad5891d40693a535a27 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:50:15.004151 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f804771-0b41-4345-8520-4ded15382d3d None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:15.013730 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 156/315] 10.222.0.55 () {58 vars in 1334 bytes} [Wed Aug 24 16:50:14 2022] PUT /identity/v3/system/users/8229e1e4856e4c61a0d26a485ca7316b/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:50:15.138069 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f804771-0b41-4345-8520-4ded15382d3d None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:15.178193 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434b756-602d-47af-80a9-91d5733e55b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:15.179211 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434b756-602d-47af-80a9-91d5733e55b4 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:15.179696 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434b756-602d-47af-80a9-91d5733e55b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:15.180197 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434b756-602d-47af-80a9-91d5733e55b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:15.217627 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:15.253933 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434b756-602d-47af-80a9-91d5733e55b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:15.255438 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434b756-602d-47af-80a9-91d5733e55b4 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:15.362237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 160/316] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:50:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 16:50:15.368202 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06622ed-dfba-49f3-b8f7-a7d0dacd59e3 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:15.441888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:15.484855 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06622ed-dfba-49f3-b8f7-a7d0dacd59e3 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:15.522129 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dec74e-0f5f-4732-9289-ea74796d5c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:15.522795 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dec74e-0f5f-4732-9289-ea74796d5c01 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:15.523078 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dec74e-0f5f-4732-9289-ea74796d5c01 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:15.523393 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dec74e-0f5f-4732-9289-ea74796d5c01 None admin] PATH_INFO: `/v3/projects/9125daf250634e3881ac3ca4ab91d86b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:15.524654 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dec74e-0f5f-4732-9289-ea74796d5c01 None admin] RBAC: Authorizing `identity:get_project(project_id=9125daf250634e3881ac3ca4ab91d86b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:15.526185 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dec74e-0f5f-4732-9289-ea74796d5c01 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:15.529171 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 157/317] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:50:15 2022] GET /identity/v3/projects/9125daf250634e3881ac3ca4ab91d86b => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:15.534925 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434b756-602d-47af-80a9-91d5733e55b4 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:15.602870 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:15.640849 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434b756-602d-47af-80a9-91d5733e55b4 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:15.675379 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a464dae6-cc9d-4b18-9dc6-4ee403183c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:15.675988 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464dae6-cc9d-4b18-9dc6-4ee403183c99 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:15.676264 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464dae6-cc9d-4b18-9dc6-4ee403183c99 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:15.676531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a464dae6-cc9d-4b18-9dc6-4ee403183c99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:15.677256 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464dae6-cc9d-4b18-9dc6-4ee403183c99 None admin] RBAC: Adding query filter params (role.id=6eade9c7eb83430aa3d5076986bfe477, scope.project.id=9125daf250634e3881ac3ca4ab91d86b, user.id=814f3ed170634ad5891d40693a535a27) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:15.677560 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464dae6-cc9d-4b18-9dc6-4ee403183c99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:15.678976 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a464dae6-cc9d-4b18-9dc6-4ee403183c99 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:15.686262 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 161/318] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:50:15 2022] GET /identity/v3/role_assignments?user.id=814f3ed170634ad5891d40693a535a27&scope.project.id=9125daf250634e3881ac3ca4ab91d86b&role.id=6eade9c7eb83430aa3d5076986bfe477 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:15.777891 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae238ab2-f26c-403c-aed9-bd288975eff1 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:15.778209 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae238ab2-f26c-403c-aed9-bd288975eff1 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:15.778487 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae238ab2-f26c-403c-aed9-bd288975eff1 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:15.780069 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 158/319] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:15.785865 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4fee2-2413-45a5-a9e5-6253f5816725 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:15.786451 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4fee2-2413-45a5-a9e5-6253f5816725 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:15.786866 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf4fee2-2413-45a5-a9e5-6253f5816725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:15.806644 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-6cf4fee2-2413-45a5-a9e5-6253f5816725 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:15.808926 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-6cf4fee2-2413-45a5-a9e5-6253f5816725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:15.884272 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 162/320] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:16.154762 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae238ab2-f26c-403c-aed9-bd288975eff1 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:16.290989 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae238ab2-f26c-403c-aed9-bd288975eff1 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:16.319604 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:16.326932 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fec8c33-4318-4ab1-8a58-376d8f32096b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:16.327598 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec8c33-4318-4ab1-8a58-376d8f32096b None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:16.331766 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec8c33-4318-4ab1-8a58-376d8f32096b None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:16.331766 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fec8c33-4318-4ab1-8a58-376d8f32096b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:16.331766 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec8c33-4318-4ab1-8a58-376d8f32096b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:16.331766 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fec8c33-4318-4ab1-8a58-376d8f32096b None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:16.332629 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 159/321] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:16.337994 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4fee2-2413-45a5-a9e5-6253f5816725 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:16.388013 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899181d-a6f1-445e-9d4f-130e0fcea1cd None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:16.388305 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899181d-a6f1-445e-9d4f-130e0fcea1cd None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:16.388584 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899181d-a6f1-445e-9d4f-130e0fcea1cd None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:16.390076 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 160/322] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:50:16.395007 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a4e4f-6245-4fd2-8679-13d4b7b9a5d3 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:16.395323 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a4e4f-6245-4fd2-8679-13d4b7b9a5d3 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:16.395607 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a4e4f-6245-4fd2-8679-13d4b7b9a5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:16.398742 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:16.414448 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-619a4e4f-6245-4fd2-8679-13d4b7b9a5d3 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:16.415934 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-619a4e4f-6245-4fd2-8679-13d4b7b9a5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:16.446427 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf4fee2-2413-45a5-a9e5-6253f5816725 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:16.482869 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f6655-c21f-477f-9ccb-22e2bc252caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:16.483783 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f6655-c21f-477f-9ccb-22e2bc252caf None admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:16.484210 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f6655-c21f-477f-9ccb-22e2bc252caf None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:16.484656 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f6655-c21f-477f-9ccb-22e2bc252caf None admin] PATH_INFO: `/v3/groups` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:16.485470 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f6655-c21f-477f-9ccb-22e2bc252caf None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:16.487136 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f6655-c21f-477f-9ccb-22e2bc252caf None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:16.490262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 161/323] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:50:16.590520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 163/324] 10.222.0.55 () {60 vars in 1134 bytes} [Wed Aug 24 16:50:16 2022] POST /identity/v3/groups => generated 226 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:50:16.764822 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a4e4f-6245-4fd2-8679-13d4b7b9a5d3 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:16.885337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a4e4f-6245-4fd2-8679-13d4b7b9a5d3 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:16.915336 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:16.924747 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae23bf8-4fcf-45f3-b2d2-6ddcad8e97bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:16.925395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae23bf8-4fcf-45f3-b2d2-6ddcad8e97bd None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:16.933998 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae23bf8-4fcf-45f3-b2d2-6ddcad8e97bd None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:16.933998 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae23bf8-4fcf-45f3-b2d2-6ddcad8e97bd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:16.937523 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae23bf8-4fcf-45f3-b2d2-6ddcad8e97bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:16.942653 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-9ae23bf8-4fcf-45f3-b2d2-6ddcad8e97bd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:50:16.942653 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:16.942653 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:16.942653 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:16.942653 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:16.942653 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:16.942653 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:16.942653 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:16.942653 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:16.942653 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:16.942653 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:16.942653 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:16.942653 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:16.942653 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:16.942653 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:16.942653 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:16.943676 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:16.943676 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:16.943676 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:16.943676 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:16.943676 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:16.943676 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:16.943676 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:16.943676 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:16.943676 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:16.943676 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:16.943676 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:16.943676 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:16.943676 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:16.943676 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:16.943676 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:16.943676 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:16.944487 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:16.944487 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:16.944487 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:16.944487 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:16.944487 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:16.944487 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:16.944487 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:16.944487 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:16.944487 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:16.944487 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:16.944487 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:50:16.944487 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:16.944487 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 162/325] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:50:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:16.950701 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f6655-c21f-477f-9ccb-22e2bc252caf None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:17.082305 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f6655-c21f-477f-9ccb-22e2bc252caf None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:17.102597 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b56a24-5b91-42e6-9eeb-a4d908babc78 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:17.102916 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b56a24-5b91-42e6-9eeb-a4d908babc78 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:17.103156 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b56a24-5b91-42e6-9eeb-a4d908babc78 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:17.105572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 163/326] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:50:17.107232 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:17.112677 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212e667-79d9-4222-9625-56479a8da603 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:17.112958 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212e667-79d9-4222-9625-56479a8da603 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:17.113229 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212e667-79d9-4222-9625-56479a8da603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:17.124112 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bb8bd-7dc1-4d0d-a18a-766a59cae07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:17.124798 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bb8bd-7dc1-4d0d-a18a-766a59cae07b None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:17.125076 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bb8bd-7dc1-4d0d-a18a-766a59cae07b None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:17.125346 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bb8bd-7dc1-4d0d-a18a-766a59cae07b None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:17.126083 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6bb8bd-7dc1-4d0d-a18a-766a59cae07b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:17.126385 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6bb8bd-7dc1-4d0d-a18a-766a59cae07b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:17.127825 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6bb8bd-7dc1-4d0d-a18a-766a59cae07b None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:17.133582 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-9212e667-79d9-4222-9625-56479a8da603 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:17.134961 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-9212e667-79d9-4222-9625-56479a8da603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:17.137732 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 164/327] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Aug 24 16:50:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:17.146069 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bb8bd-7dc1-4d0d-a18a-766a59cae07b None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:17.350764 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 164/328] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:50:17.367423 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bb8bd-7dc1-4d0d-a18a-766a59cae07b None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:17.410580 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea726eb8-9541-4c89-bbab-e5e5f76f3749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:17.411267 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea726eb8-9541-4c89-bbab-e5e5f76f3749 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:17.411552 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea726eb8-9541-4c89-bbab-e5e5f76f3749 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:17.411826 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea726eb8-9541-4c89-bbab-e5e5f76f3749 None admin] PATH_INFO: `/v3/users/55e4a36b58434f8ea002bddfe71ca6fd` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:17.412996 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea726eb8-9541-4c89-bbab-e5e5f76f3749 None admin] RBAC: Authorizing `identity:get_user(user_id=55e4a36b58434f8ea002bddfe71ca6fd)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:17.414442 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea726eb8-9541-4c89-bbab-e5e5f76f3749 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:17.416086 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 165/329] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:50:17 2022] GET /identity/v3/users/55e4a36b58434f8ea002bddfe71ca6fd => generated 293 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:50:17.422395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212e667-79d9-4222-9625-56479a8da603 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:17.545209 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212e667-79d9-4222-9625-56479a8da603 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:17.568226 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:17.593236 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb974f6-465d-4dc0-a9f0-a00adf6901cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:17.593895 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb974f6-465d-4dc0-a9f0-a00adf6901cb None admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:17.595028 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb974f6-465d-4dc0-a9f0-a00adf6901cb None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:17.595028 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb974f6-465d-4dc0-a9f0-a00adf6901cb None admin] PATH_INFO: `/v3/system/users/55e4a36b58434f8ea002bddfe71ca6fd/roles/6eade9c7eb83430aa3d5076986bfe477` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:17.596050 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb974f6-465d-4dc0-a9f0-a00adf6901cb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=55e4a36b58434f8ea002bddfe71ca6fd, role_id=6eade9c7eb83430aa3d5076986bfe477)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:17.597447 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb974f6-465d-4dc0-a9f0-a00adf6901cb None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:17.659981 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 165/330] 10.222.0.55 () {58 vars in 1334 bytes} [Wed Aug 24 16:50:17 2022] PUT /identity/v3/system/users/55e4a36b58434f8ea002bddfe71ca6fd/roles/6eade9c7eb83430aa3d5076986bfe477 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:50:17.696680 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea726eb8-9541-4c89-bbab-e5e5f76f3749 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:17.767885 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:17.835598 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea726eb8-9541-4c89-bbab-e5e5f76f3749 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:17.882776 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e763a8-fb33-4da7-91b9-25e298b00c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:17.883501 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e763a8-fb33-4da7-91b9-25e298b00c3c None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:17.883765 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e763a8-fb33-4da7-91b9-25e298b00c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:17.884040 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e763a8-fb33-4da7-91b9-25e298b00c3c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:17.901306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e763a8-fb33-4da7-91b9-25e298b00c3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:17.906895 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-e5e763a8-fb33-4da7-91b9-25e298b00c3c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:50:17.906895 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:17.906895 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:17.906895 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:17.906895 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:17.906895 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:17.906895 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:17.906895 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:17.906895 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:17.906895 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:17.906895 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:17.906895 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:17.906895 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:17.906895 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:17.906895 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:17.906895 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:17.909054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:17.909054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:17.909054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:17.909054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:17.909054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:17.909054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:17.909054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:17.909054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:17.909054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:17.909054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:17.909054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:17.909054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:17.909054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:17.909054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:17.909054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:17.909054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:17.910983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:17.910983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:17.910983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:17.910983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:17.910983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:17.910983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:17.910983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:17.910983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:17.910983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:17.910983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:17.910983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:50:17.910983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:17.910983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 166/331] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:50:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:17.914226 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb974f6-465d-4dc0-a9f0-a00adf6901cb None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:18.050030 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb974f6-465d-4dc0-a9f0-a00adf6901cb None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:18.093842 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f9f65-f8f4-4a4e-aa1f-e2d4106d59a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:18.094470 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f9f65-f8f4-4a4e-aa1f-e2d4106d59a7 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:18.094741 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f9f65-f8f4-4a4e-aa1f-e2d4106d59a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:18.095013 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f9f65-f8f4-4a4e-aa1f-e2d4106d59a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:18.095725 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f9f65-f8f4-4a4e-aa1f-e2d4106d59a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:18.096030 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f9f65-f8f4-4a4e-aa1f-e2d4106d59a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:18.097688 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f9f65-f8f4-4a4e-aa1f-e2d4106d59a7 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:18.112223 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 166/332] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Aug 24 16:50:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:18.119426 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e763a8-fb33-4da7-91b9-25e298b00c3c None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:18.249465 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e763a8-fb33-4da7-91b9-25e298b00c3c None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:18.263538 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:18.298055 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd0298-3239-49d1-9adc-464003259a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:18.298703 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd0298-3239-49d1-9adc-464003259a25 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:18.298982 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd0298-3239-49d1-9adc-464003259a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:18.299296 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd0298-3239-49d1-9adc-464003259a25 None admin] PATH_INFO: `/v3/users/8229e1e4856e4c61a0d26a485ca7316b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:18.300483 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd0298-3239-49d1-9adc-464003259a25 None admin] RBAC: Authorizing `identity:get_user(user_id=8229e1e4856e4c61a0d26a485ca7316b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:18.301932 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd0298-3239-49d1-9adc-464003259a25 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:18.307290 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 167/333] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:50:18 2022] GET /identity/v3/users/8229e1e4856e4c61a0d26a485ca7316b => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:18.311856 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f9f65-f8f4-4a4e-aa1f-e2d4106d59a7 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:18.379687 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:18.456643 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f9f65-f8f4-4a4e-aa1f-e2d4106d59a7 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:18.502834 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9671d8e1-6e2c-4e89-a3d5-a5152c9a7d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:18.503498 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671d8e1-6e2c-4e89-a3d5-a5152c9a7d01 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:18.503834 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671d8e1-6e2c-4e89-a3d5-a5152c9a7d01 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:18.504113 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9671d8e1-6e2c-4e89-a3d5-a5152c9a7d01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:18.504856 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671d8e1-6e2c-4e89-a3d5-a5152c9a7d01 None admin] RBAC: Adding query filter params (role.id=d886d117c82147e6a6488228fee2ac8b, user.id=8229e1e4856e4c61a0d26a485ca7316b, scope.system=all) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:18.505164 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671d8e1-6e2c-4e89-a3d5-a5152c9a7d01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:18.506607 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9671d8e1-6e2c-4e89-a3d5-a5152c9a7d01 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:18.524892 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 167/334] 10.222.0.55 () {56 vars in 1308 bytes} [Wed Aug 24 16:50:18 2022] GET /identity/v3/role_assignments?user.id=8229e1e4856e4c61a0d26a485ca7316b&scope.system=all&role.id=d886d117c82147e6a6488228fee2ac8b => generated 510 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:19.399882 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88011d1a-1936-4327-afa4-efb046a5649b None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:19.400415 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88011d1a-1936-4327-afa4-efb046a5649b None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:19.400415 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88011d1a-1936-4327-afa4-efb046a5649b None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:19.402639 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 168/335] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:19.416688 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06ed29-a8b4-49b9-abe1-9be2c9bd8684 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:19.417446 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06ed29-a8b4-49b9-abe1-9be2c9bd8684 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:19.417446 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06ed29-a8b4-49b9-abe1-9be2c9bd8684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:19.444172 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-da06ed29-a8b4-49b9-abe1-9be2c9bd8684 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:19.445401 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-da06ed29-a8b4-49b9-abe1-9be2c9bd8684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:19.537594 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 168/336] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:19.639478 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca53fad-251d-42ee-913f-85393deee7ce None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:19.639795 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca53fad-251d-42ee-913f-85393deee7ce None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:19.640031 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca53fad-251d-42ee-913f-85393deee7ce None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:19.641380 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 169/337] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:19.646683 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e204be7-d6f3-489f-b682-b45f7f9641cc None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:19.646972 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e204be7-d6f3-489f-b682-b45f7f9641cc None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:19.647286 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e204be7-d6f3-489f-b682-b45f7f9641cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:19.672252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-4e204be7-d6f3-489f-b682-b45f7f9641cc None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:19.673402 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-4e204be7-d6f3-489f-b682-b45f7f9641cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:19.710742 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:19.733318 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f814d-6094-4bb3-9cfb-b91c2464ecab None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:19.733627 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f814d-6094-4bb3-9cfb-b91c2464ecab None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:19.733861 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f814d-6094-4bb3-9cfb-b91c2464ecab None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:19.737214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 170/338] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:19.743442 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa0b57-8464-43d7-b5c4-943c083fd2b6 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:19.743687 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa0b57-8464-43d7-b5c4-943c083fd2b6 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:19.743911 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aa0b57-8464-43d7-b5c4-943c083fd2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:19.773362 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 169/339] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:19.777440 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-e0aa0b57-8464-43d7-b5c4-943c083fd2b6 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:19.778885 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-e0aa0b57-8464-43d7-b5c4-943c083fd2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:19.904036 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 171/340] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:50:19.971823 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e204be7-d6f3-489f-b682-b45f7f9641cc None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:20.084447 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e204be7-d6f3-489f-b682-b45f7f9641cc None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:20.124886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b50951-ab74-4748-ab44-55dcea462029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:20.125530 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b50951-ab74-4748-ab44-55dcea462029 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:20.125806 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b50951-ab74-4748-ab44-55dcea462029 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:20.126073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b50951-ab74-4748-ab44-55dcea462029 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:20.140870 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b50951-ab74-4748-ab44-55dcea462029 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:20.146252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-48b50951-ab74-4748-ab44-55dcea462029 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:50:20.146252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:20.146252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:20.146252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:20.146252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:20.146252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:20.146252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:20.146252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:20.146252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:20.146252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:20.146252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:20.146252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:20.146252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:20.146252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:20.146252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:20.146252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:20.147241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:20.147241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:20.147241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:20.147241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:20.147241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:20.147241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:20.147241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:20.147241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:20.147241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:20.147241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:20.147241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:20.147241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:20.147241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:20.147241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:20.147241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:20.147241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:20.150994 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:20.150994 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:20.150994 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:20.150994 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:20.150994 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:20.150994 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:20.150994 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:20.150994 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:20.150994 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:20.150994 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:20.150994 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:50:20.150994 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:20.150994 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 170/341] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Aug 24 16:50:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:20.156846 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa0b57-8464-43d7-b5c4-943c083fd2b6 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:20.303618 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b50951-ab74-4748-ab44-55dcea462029 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:20.317511 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aa0b57-8464-43d7-b5c4-943c083fd2b6 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:20.334725 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:20.352430 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:20.366645 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870f0c2-dc7e-4f30-befb-7ebbf124e914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:20.367297 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870f0c2-dc7e-4f30-befb-7ebbf124e914 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:20.367578 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870f0c2-dc7e-4f30-befb-7ebbf124e914 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:20.367852 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870f0c2-dc7e-4f30-befb-7ebbf124e914 None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:20.368519 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870f0c2-dc7e-4f30-befb-7ebbf124e914 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:20.368819 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870f0c2-dc7e-4f30-befb-7ebbf124e914 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:20.370772 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870f0c2-dc7e-4f30-befb-7ebbf124e914 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:20.383968 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 172/342] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:50:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:20.391097 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870f0c2-dc7e-4f30-befb-7ebbf124e914 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:20.533150 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b50951-ab74-4748-ab44-55dcea462029 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:20.537200 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870f0c2-dc7e-4f30-befb-7ebbf124e914 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:20.585858 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517cd8e-79e7-43c2-834d-9f4afc343a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:20.586417 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517cd8e-79e7-43c2-834d-9f4afc343a16 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:20.586691 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517cd8e-79e7-43c2-834d-9f4afc343a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:20.586954 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517cd8e-79e7-43c2-834d-9f4afc343a16 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:20.597993 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4517cd8e-79e7-43c2-834d-9f4afc343a16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:20.599826 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcafe6c-94ed-497e-9a79-2fad99912666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:20.600458 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcafe6c-94ed-497e-9a79-2fad99912666 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:20.600744 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcafe6c-94ed-497e-9a79-2fad99912666 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:20.601019 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcafe6c-94ed-497e-9a79-2fad99912666 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:20.605480 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-4517cd8e-79e7-43c2-834d-9f4afc343a16 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:50:20.605480 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:20.605480 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:20.605480 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:20.605480 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:20.605480 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:20.605480 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:20.605480 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:20.605480 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:20.605480 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:20.605480 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:20.605480 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:20.605480 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:20.605480 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:20.605480 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:20.605480 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:20.606367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:20.606367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:20.606367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:20.606367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:20.606367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:20.606367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:20.606367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:20.606367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:20.606367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:20.606367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:20.606367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:20.606367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:20.606367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:20.606367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:20.606367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:20.606367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:20.607183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:20.607183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:20.607183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:20.607183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:20.607183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:20.607183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:20.607183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:20.607183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:20.607183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:20.607183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:20.607183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:50:20.607183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:20.607183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 171/343] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:50:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:50:20.607852 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517cd8e-79e7-43c2-834d-9f4afc343a16 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:20.647578 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:20.696317 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcafe6c-94ed-497e-9a79-2fad99912666 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:20.697809 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcafe6c-94ed-497e-9a79-2fad99912666 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:20.703753 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:20.723754 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517cd8e-79e7-43c2-834d-9f4afc343a16 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:20.768446 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46588b7-c2cd-4e54-9e37-88125fb73eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:20.769096 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46588b7-c2cd-4e54-9e37-88125fb73eed None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:20.769373 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46588b7-c2cd-4e54-9e37-88125fb73eed None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:20.769640 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46588b7-c2cd-4e54-9e37-88125fb73eed None admin] PATH_INFO: `/v3/roles/member` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:20.782663 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46588b7-c2cd-4e54-9e37-88125fb73eed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:20.788773 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-a46588b7-c2cd-4e54-9e37-88125fb73eed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:50:20.788773 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:20.788773 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:20.788773 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:20.788773 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:20.788773 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:20.788773 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:20.788773 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:20.788773 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:20.788773 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:20.788773 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:20.788773 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:20.788773 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:20.788773 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:20.788773 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:20.788773 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:20.790879 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:20.790879 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:20.790879 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:20.790879 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:20.790879 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:20.790879 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:20.790879 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:20.790879 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:20.790879 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:20.790879 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:20.790879 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:20.790879 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:20.790879 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:20.790879 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:20.790879 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:20.790879 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:20.793400 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:20.793400 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:20.793400 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:20.793400 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:20.793400 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:20.793400 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:20.793400 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:20.793400 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:20.793400 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:20.793400 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:20.793400 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:50:20.793400 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:20.793400 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 172/344] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:50:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:20.793400 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46588b7-c2cd-4e54-9e37-88125fb73eed None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:20.848736 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 173/345] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:50:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 16:50:20.849531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcafe6c-94ed-497e-9a79-2fad99912666 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:20.907620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46588b7-c2cd-4e54-9e37-88125fb73eed None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:20.944098 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994c01d-89bc-4ab0-a02d-42c7afec748a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:20.944713 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994c01d-89bc-4ab0-a02d-42c7afec748a None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:20.944996 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994c01d-89bc-4ab0-a02d-42c7afec748a None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:20.945265 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994c01d-89bc-4ab0-a02d-42c7afec748a None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:20.945932 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994c01d-89bc-4ab0-a02d-42c7afec748a None admin] RBAC: Adding query filter params (name=member) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:20.946228 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994c01d-89bc-4ab0-a02d-42c7afec748a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:20.947641 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9994c01d-89bc-4ab0-a02d-42c7afec748a None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:20.957112 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 173/346] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Aug 24 16:50:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:20.957952 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994c01d-89bc-4ab0-a02d-42c7afec748a None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:20.961555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:20.967153 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:21.009123 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcafe6c-94ed-497e-9a79-2fad99912666 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:21.069941 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994c01d-89bc-4ab0-a02d-42c7afec748a None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:21.073846 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e45ac2-b21a-41ab-94b3-4d12fbaa55fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:21.074482 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e45ac2-b21a-41ab-94b3-4d12fbaa55fd None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:21.074759 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e45ac2-b21a-41ab-94b3-4d12fbaa55fd None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:21.075034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e45ac2-b21a-41ab-94b3-4d12fbaa55fd None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:21.075816 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e45ac2-b21a-41ab-94b3-4d12fbaa55fd None admin] RBAC: Adding query filter params (name=member) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:21.076117 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e45ac2-b21a-41ab-94b3-4d12fbaa55fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:21.077495 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e45ac2-b21a-41ab-94b3-4d12fbaa55fd None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:21.091086 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 174/347] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Aug 24 16:50:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:21.091770 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e45ac2-b21a-41ab-94b3-4d12fbaa55fd None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:21.111984 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521d43d-267d-4b57-aaee-ef10736b7315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:21.112598 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521d43d-267d-4b57-aaee-ef10736b7315 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:21.112876 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521d43d-267d-4b57-aaee-ef10736b7315 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:21.113238 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8521d43d-267d-4b57-aaee-ef10736b7315 None admin] PATH_INFO: `/v3/projects/bdf2d550302d4cafb7d454c50b6794c7` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:21.114480 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521d43d-267d-4b57-aaee-ef10736b7315 None admin] RBAC: Authorizing `identity:get_project(project_id=bdf2d550302d4cafb7d454c50b6794c7)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:21.116010 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8521d43d-267d-4b57-aaee-ef10736b7315 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:21.117989 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 174/348] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:50:20 2022] GET /identity/v3/projects/bdf2d550302d4cafb7d454c50b6794c7 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:21.118756 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521d43d-267d-4b57-aaee-ef10736b7315 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:21.202385 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:21.238465 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8521d43d-267d-4b57-aaee-ef10736b7315 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:21.251974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e45ac2-b21a-41ab-94b3-4d12fbaa55fd None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:21.278859 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5446784-bf02-4e88-b8d8-1d2804cfd891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:21.279527 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5446784-bf02-4e88-b8d8-1d2804cfd891 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:21.279805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5446784-bf02-4e88-b8d8-1d2804cfd891 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:21.280076 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5446784-bf02-4e88-b8d8-1d2804cfd891 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:21.285215 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:21.290222 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4c225-d869-42e0-a24e-8544c7c21b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:21.290840 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4c225-d869-42e0-a24e-8544c7c21b1c None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:21.291155 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4c225-d869-42e0-a24e-8544c7c21b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:21.291421 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4c225-d869-42e0-a24e-8544c7c21b1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:21.363756 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5446784-bf02-4e88-b8d8-1d2804cfd891 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:21.365167 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5446784-bf02-4e88-b8d8-1d2804cfd891 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:21.383130 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba4c225-d869-42e0-a24e-8544c7c21b1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:21.384617 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba4c225-d869-42e0-a24e-8544c7c21b1c None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:21.466371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:21.505979 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 175/349] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:50:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:21.507296 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5446784-bf02-4e88-b8d8-1d2804cfd891 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:21.532358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 175/350] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:50:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:21.533111 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14434e-aeda-4e74-a442-27f60b2a5ab8 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:21.533399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14434e-aeda-4e74-a442-27f60b2a5ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:21.533666 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14434e-aeda-4e74-a442-27f60b2a5ab8 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:21.535044 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 176/351] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:21.538438 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0cdd9-1e12-4233-be06-809f2781c53c None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:21.539006 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0cdd9-1e12-4233-be06-809f2781c53c None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:21.539006 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0cdd9-1e12-4233-be06-809f2781c53c None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:21.540387 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 177/352] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:21.543048 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0cdd9-1e12-4233-be06-809f2781c53c None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:21.580081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:21.650233 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5446784-bf02-4e88-b8d8-1d2804cfd891 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:21.676140 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0cdd9-1e12-4233-be06-809f2781c53c None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:21.691354 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa338bf-cf7b-466f-9cf3-1cb7d6d30a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:21.692005 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa338bf-cf7b-466f-9cf3-1cb7d6d30a5d None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:21.692280 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa338bf-cf7b-466f-9cf3-1cb7d6d30a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:21.692712 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa338bf-cf7b-466f-9cf3-1cb7d6d30a5d None admin] PATH_INFO: `/v3/groups/8d7691de30a04ae395356475cf11338b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:21.700315 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa338bf-cf7b-466f-9cf3-1cb7d6d30a5d None admin] RBAC: Authorizing `identity:get_group(group_id=8d7691de30a04ae395356475cf11338b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:21.701737 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa338bf-cf7b-466f-9cf3-1cb7d6d30a5d None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:21.703612 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 176/353] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Aug 24 16:50:21 2022] GET /identity/v3/groups/8d7691de30a04ae395356475cf11338b => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:21.704431 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa338bf-cf7b-466f-9cf3-1cb7d6d30a5d None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:21.717973 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569148d-e108-4507-9ee1-ef230fdcb71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:21.718624 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569148d-e108-4507-9ee1-ef230fdcb71f None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:21.718902 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569148d-e108-4507-9ee1-ef230fdcb71f None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:21.719211 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569148d-e108-4507-9ee1-ef230fdcb71f None admin] PATH_INFO: `/v3/projects/9125daf250634e3881ac3ca4ab91d86b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:21.720379 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569148d-e108-4507-9ee1-ef230fdcb71f None admin] RBAC: Authorizing `identity:get_project(project_id=9125daf250634e3881ac3ca4ab91d86b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:21.721833 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569148d-e108-4507-9ee1-ef230fdcb71f None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:21.723551 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 178/354] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:50:21 2022] GET /identity/v3/projects/9125daf250634e3881ac3ca4ab91d86b => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:21.724702 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e1420-c2e2-4fe1-af2a-d79be30fb884 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:21.724984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e1420-c2e2-4fe1-af2a-d79be30fb884 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:21.725256 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e1420-c2e2-4fe1-af2a-d79be30fb884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:21.744376 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-5b4e1420-c2e2-4fe1-af2a-d79be30fb884 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:21.746160 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-5b4e1420-c2e2-4fe1-af2a-d79be30fb884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:21.758599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:21.826786 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 179/355] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:21.828989 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da7fb1-31e5-4e9c-b10e-56d2111356b1 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:21.829277 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da7fb1-31e5-4e9c-b10e-56d2111356b1 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:21.829550 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da7fb1-31e5-4e9c-b10e-56d2111356b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:21.841618 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa338bf-cf7b-466f-9cf3-1cb7d6d30a5d None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:21.851020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-35da7fb1-31e5-4e9c-b10e-56d2111356b1 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:21.852246 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-35da7fb1-31e5-4e9c-b10e-56d2111356b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:21.881551 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:21.894636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c0bff1-6e75-4204-b615-7fb0dcdf0380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:21.895453 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0bff1-6e75-4204-b615-7fb0dcdf0380 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:21.895805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0bff1-6e75-4204-b615-7fb0dcdf0380 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:21.896148 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c0bff1-6e75-4204-b615-7fb0dcdf0380 None admin] PATH_INFO: `/v3/projects/bdf2d550302d4cafb7d454c50b6794c7` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:21.897430 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c0bff1-6e75-4204-b615-7fb0dcdf0380 None admin] RBAC: Authorizing `identity:get_project(project_id=bdf2d550302d4cafb7d454c50b6794c7)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:21.898950 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c0bff1-6e75-4204-b615-7fb0dcdf0380 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:21.900883 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 177/356] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:50:21 2022] GET /identity/v3/projects/bdf2d550302d4cafb7d454c50b6794c7 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:21.903145 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd76db-827f-42c9-8b16-773ab6f83f67 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:21.903427 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd76db-827f-42c9-8b16-773ab6f83f67 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:21.903702 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd76db-827f-42c9-8b16-773ab6f83f67 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:21.905007 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 178/357] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:21.905724 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd76db-827f-42c9-8b16-773ab6f83f67 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:21.941135 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 180/358] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:21.942055 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da7fb1-31e5-4e9c-b10e-56d2111356b1 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:22.043942 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd76db-827f-42c9-8b16-773ab6f83f67 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:22.046533 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:22.092648 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2dd58-f441-4458-a337-8770e0f48016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:22.092966 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da7fb1-31e5-4e9c-b10e-56d2111356b1 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:22.093691 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2dd58-f441-4458-a337-8770e0f48016 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:22.094160 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2dd58-f441-4458-a337-8770e0f48016 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:22.094571 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e2dd58-f441-4458-a337-8770e0f48016 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:22.095518 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2dd58-f441-4458-a337-8770e0f48016 None admin] RBAC: Adding query filter params (group.id=8d7691de30a04ae395356475cf11338b, role.id=1c6cc7bf29b146b0a9aaf6a07607258a, scope.project.id=bdf2d550302d4cafb7d454c50b6794c7) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:22.095989 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2dd58-f441-4458-a337-8770e0f48016 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:22.097592 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e2dd58-f441-4458-a337-8770e0f48016 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:22.105181 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 179/359] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Aug 24 16:50:21 2022] GET /identity/v3/role_assignments?group.id=8d7691de30a04ae395356475cf11338b&scope.project.id=bdf2d550302d4cafb7d454c50b6794c7&role.id=1c6cc7bf29b146b0a9aaf6a07607258a => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:22.112027 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2dd58-f441-4458-a337-8770e0f48016 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:22.142191 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d3acb5-0cc9-47ce-ab62-057533ad4e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:22.142888 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3acb5-0cc9-47ce-ab62-057533ad4e70 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:22.143192 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3acb5-0cc9-47ce-ab62-057533ad4e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:22.143464 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3acb5-0cc9-47ce-ab62-057533ad4e70 None admin] PATH_INFO: `/v3/groups/8d7691de30a04ae395356475cf11338b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:22.144863 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d3acb5-0cc9-47ce-ab62-057533ad4e70 None admin] RBAC: Authorizing `identity:get_group(group_id=8d7691de30a04ae395356475cf11338b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:22.146936 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d3acb5-0cc9-47ce-ab62-057533ad4e70 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:22.149688 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 181/360] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Aug 24 16:50:21 2022] GET /identity/v3/groups/8d7691de30a04ae395356475cf11338b => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:22.152358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280307e-96bd-4ad8-a75e-1ea1e50a0d39 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:22.152358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280307e-96bd-4ad8-a75e-1ea1e50a0d39 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:22.152358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a280307e-96bd-4ad8-a75e-1ea1e50a0d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:22.174169 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-a280307e-96bd-4ad8-a75e-1ea1e50a0d39 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:22.175481 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-a280307e-96bd-4ad8-a75e-1ea1e50a0d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:22.208323 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:22.268585 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 182/361] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:22.270370 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280307e-96bd-4ad8-a75e-1ea1e50a0d39 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:22.300723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e2dd58-f441-4458-a337-8770e0f48016 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:22.348970 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242973c-65d4-4fa1-b67c-297d75e7fdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:22.349761 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242973c-65d4-4fa1-b67c-297d75e7fdd6 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:22.350040 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242973c-65d4-4fa1-b67c-297d75e7fdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:22.350312 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242973c-65d4-4fa1-b67c-297d75e7fdd6 None admin] PATH_INFO: `/v3/groups/8d7691de30a04ae395356475cf11338b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:22.351593 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242973c-65d4-4fa1-b67c-297d75e7fdd6 None admin] RBAC: Authorizing `identity:get_group(group_id=8d7691de30a04ae395356475cf11338b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:22.353066 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242973c-65d4-4fa1-b67c-297d75e7fdd6 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:22.354730 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 180/362] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Aug 24 16:50:22 2022] GET /identity/v3/groups/8d7691de30a04ae395356475cf11338b => generated 226 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:22.356760 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242973c-65d4-4fa1-b67c-297d75e7fdd6 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:22.397532 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:22.417456 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a280307e-96bd-4ad8-a75e-1ea1e50a0d39 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:22.467625 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0dff8-6715-4d4f-a97f-2534a3b563a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:22.468386 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0dff8-6715-4d4f-a97f-2534a3b563a3 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:22.468814 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0dff8-6715-4d4f-a97f-2534a3b563a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:22.469153 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f0dff8-6715-4d4f-a97f-2534a3b563a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:22.470572 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0dff8-6715-4d4f-a97f-2534a3b563a3 None admin] RBAC: Adding query filter params (group.id=8d7691de30a04ae395356475cf11338b, role.id=d886d117c82147e6a6488228fee2ac8b, scope.project.id=9125daf250634e3881ac3ca4ab91d86b) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:22.470889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0dff8-6715-4d4f-a97f-2534a3b563a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:22.472883 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f0dff8-6715-4d4f-a97f-2534a3b563a3 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:22.475845 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242973c-65d4-4fa1-b67c-297d75e7fdd6 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:22.481153 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 183/363] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Aug 24 16:50:22 2022] GET /identity/v3/role_assignments?group.id=8d7691de30a04ae395356475cf11338b&scope.project.id=9125daf250634e3881ac3ca4ab91d86b&role.id=d886d117c82147e6a6488228fee2ac8b => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:22.482061 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0dff8-6715-4d4f-a97f-2534a3b563a3 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:22.514349 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:22.533033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8cb80-ba39-43ef-9e4b-c384e129c2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:22.533787 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8cb80-ba39-43ef-9e4b-c384e129c2c9 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:22.534079 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8cb80-ba39-43ef-9e4b-c384e129c2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:22.534383 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8cb80-ba39-43ef-9e4b-c384e129c2c9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:22.546835 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8cb80-ba39-43ef-9e4b-c384e129c2c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:22.553080 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-c5a8cb80-ba39-43ef-9e4b-c384e129c2c9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:50:22.553080 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:22.553080 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:22.553080 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:22.553080 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:22.553080 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:22.553080 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:22.553080 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:22.553080 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:22.553080 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:22.553080 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:22.553080 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:22.553080 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:22.553080 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:22.553080 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:22.553080 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:22.555230 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:22.555230 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:22.555230 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:22.555230 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:22.555230 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:22.555230 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:22.555230 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:22.555230 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:22.555230 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:22.555230 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:22.555230 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:22.555230 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:22.555230 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:22.555230 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:22.555230 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:22.555230 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:22.557249 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:22.557249 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:22.557249 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:22.557249 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:22.557249 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:22.557249 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:22.557249 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:22.557249 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:22.557249 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:22.557249 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:22.557249 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 16:50:22.557249 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:22.557249 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 181/364] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:50:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:22.557249 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8cb80-ba39-43ef-9e4b-c384e129c2c9 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:22.628389 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f0dff8-6715-4d4f-a97f-2534a3b563a3 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:22.675169 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07352f-088d-42e1-9997-ed62593989e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:22.676519 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07352f-088d-42e1-9997-ed62593989e7 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:22.676993 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07352f-088d-42e1-9997-ed62593989e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:22.677450 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d07352f-088d-42e1-9997-ed62593989e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:22.693169 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d07352f-088d-42e1-9997-ed62593989e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:22.698052 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:22.701485 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-1d07352f-088d-42e1-9997-ed62593989e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:50:22.701485 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:22.701485 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:22.701485 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:22.701485 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:22.701485 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:22.701485 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:22.701485 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:22.701485 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:22.701485 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:22.701485 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:22.701485 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:22.701485 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:22.701485 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:22.701485 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:22.701485 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:22.702369 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:22.702369 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:22.702369 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:22.702369 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:22.702369 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:22.702369 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:22.702369 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:22.702369 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:22.702369 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:22.702369 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:22.702369 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:22.702369 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:22.702369 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:22.702369 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:22.702369 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:22.702369 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:22.703188 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:22.703188 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:22.703188 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:22.703188 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:22.703188 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:22.703188 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:22.703188 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:22.703188 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:22.703188 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:22.703188 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:22.703188 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:50:22.703188 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:22.704559 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 184/365] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Aug 24 16:50:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:22.705416 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07352f-088d-42e1-9997-ed62593989e7 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:22.713029 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8cb80-ba39-43ef-9e4b-c384e129c2c9 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:22.752026 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a8248-afcd-40fb-9d5f-d37fb3b03cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:22.752707 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a8248-afcd-40fb-9d5f-d37fb3b03cef None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:22.752984 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a8248-afcd-40fb-9d5f-d37fb3b03cef None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:22.753251 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a8248-afcd-40fb-9d5f-d37fb3b03cef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:22.754043 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a8248-afcd-40fb-9d5f-d37fb3b03cef None admin] RBAC: Adding query filter params (group.id=8d7691de30a04ae395356475cf11338b, role.id=d886d117c82147e6a6488228fee2ac8b, scope.project.id=bdf2d550302d4cafb7d454c50b6794c7) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:22.754381 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a8248-afcd-40fb-9d5f-d37fb3b03cef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:22.757261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a8248-afcd-40fb-9d5f-d37fb3b03cef None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:22.763904 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 182/366] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Aug 24 16:50:22 2022] GET /identity/v3/role_assignments?group.id=8d7691de30a04ae395356475cf11338b&scope.project.id=bdf2d550302d4cafb7d454c50b6794c7&role.id=d886d117c82147e6a6488228fee2ac8b => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:22.764928 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a8248-afcd-40fb-9d5f-d37fb3b03cef None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:22.820628 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:22.846313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d07352f-088d-42e1-9997-ed62593989e7 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:22.893662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b1da0-4a94-4345-a4ab-9ba61bcbcbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:22.894664 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b1da0-4a94-4345-a4ab-9ba61bcbcbf4 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:22.895180 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b1da0-4a94-4345-a4ab-9ba61bcbcbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:22.895654 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b1da0-4a94-4345-a4ab-9ba61bcbcbf4 None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:22.896535 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b1da0-4a94-4345-a4ab-9ba61bcbcbf4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:22.897042 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b1da0-4a94-4345-a4ab-9ba61bcbcbf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:22.898798 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b1da0-4a94-4345-a4ab-9ba61bcbcbf4 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:22.899806 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a8248-afcd-40fb-9d5f-d37fb3b03cef None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:22.910370 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 185/367] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Aug 24 16:50:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:22.911577 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b1da0-4a94-4345-a4ab-9ba61bcbcbf4 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:22.948726 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556255d-9298-4a5b-b247-32706764c5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:22.949387 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556255d-9298-4a5b-b247-32706764c5d8 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:22.949669 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556255d-9298-4a5b-b247-32706764c5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:22.949963 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556255d-9298-4a5b-b247-32706764c5d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:22.966070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556255d-9298-4a5b-b247-32706764c5d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:22.973047 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-a556255d-9298-4a5b-b247-32706764c5d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:50:22.973047 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:22.973047 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:22.973047 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:22.973047 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:22.973047 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:22.973047 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:22.973047 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:22.973047 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:22.973047 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:22.973047 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:22.973047 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:22.973047 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:22.973047 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:22.973047 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:22.973047 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:22.974021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:22.974021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:22.974021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:22.974021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:22.974021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:22.974021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:22.974021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:22.974021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:22.974021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:22.974021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:22.974021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:22.974021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:22.974021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:22.974021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:22.974021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:22.974021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:22.974816 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:22.974816 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:22.974816 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:22.974816 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:22.974816 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:22.974816 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:22.974816 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:22.974816 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:22.974816 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:22.974816 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:22.974816 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:50:22.974816 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:22.974816 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 183/368] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:50:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:22.979555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556255d-9298-4a5b-b247-32706764c5d8 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:23.013375 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:23.045819 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b1da0-4a94-4345-a4ab-9ba61bcbcbf4 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:23.087983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c38db-62be-4cca-92bb-98edac56abba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:23.089707 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c38db-62be-4cca-92bb-98edac56abba None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:23.090195 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c38db-62be-4cca-92bb-98edac56abba None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:23.090671 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c38db-62be-4cca-92bb-98edac56abba None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:23.091662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c38db-62be-4cca-92bb-98edac56abba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:23.092216 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c38db-62be-4cca-92bb-98edac56abba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:23.093816 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c38db-62be-4cca-92bb-98edac56abba None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:23.105872 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 186/369] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:50:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:23.110538 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556255d-9298-4a5b-b247-32706764c5d8 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:23.111865 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c38db-62be-4cca-92bb-98edac56abba None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:23.122256 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:23.163380 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5bf58-aa4c-487a-91c5-8f9de4b10d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:23.164354 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5bf58-aa4c-487a-91c5-8f9de4b10d11 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:23.164846 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5bf58-aa4c-487a-91c5-8f9de4b10d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:23.165294 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5bf58-aa4c-487a-91c5-8f9de4b10d11 None admin] PATH_INFO: `/v3/users/55e4a36b58434f8ea002bddfe71ca6fd` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:23.166823 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5bf58-aa4c-487a-91c5-8f9de4b10d11 None admin] RBAC: Authorizing `identity:get_user(user_id=55e4a36b58434f8ea002bddfe71ca6fd)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:23.168565 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5bf58-aa4c-487a-91c5-8f9de4b10d11 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:23.170992 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 184/370] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:50:22 2022] GET /identity/v3/users/55e4a36b58434f8ea002bddfe71ca6fd => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:23.172138 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5bf58-aa4c-487a-91c5-8f9de4b10d11 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:23.243857 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c38db-62be-4cca-92bb-98edac56abba None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:23.287510 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:23.289298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf78c2-09fe-424d-be6f-36a580858a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:23.289298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf78c2-09fe-424d-be6f-36a580858a35 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:23.289604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf78c2-09fe-424d-be6f-36a580858a35 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:23.289991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf78c2-09fe-424d-be6f-36a580858a35 None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:23.290737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf78c2-09fe-424d-be6f-36a580858a35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:23.291131 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf78c2-09fe-424d-be6f-36a580858a35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:23.293654 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf78c2-09fe-424d-be6f-36a580858a35 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:23.300355 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5bf58-aa4c-487a-91c5-8f9de4b10d11 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:23.303458 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 187/371] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:50:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:23.305263 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf78c2-09fe-424d-be6f-36a580858a35 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:23.347083 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404af17-ce66-43ce-900b-fea348eb48b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:23.348059 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404af17-ce66-43ce-900b-fea348eb48b5 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:23.348584 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404af17-ce66-43ce-900b-fea348eb48b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:23.349061 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6404af17-ce66-43ce-900b-fea348eb48b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:23.385227 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:23.426106 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf78c2-09fe-424d-be6f-36a580858a35 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:23.445385 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404af17-ce66-43ce-900b-fea348eb48b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:23.447299 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6404af17-ce66-43ce-900b-fea348eb48b5 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:23.470959 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05199857-0b00-44d0-9911-9997ab6e0fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:23.470959 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05199857-0b00-44d0-9911-9997ab6e0fea None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:23.470959 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05199857-0b00-44d0-9911-9997ab6e0fea None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:23.470959 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05199857-0b00-44d0-9911-9997ab6e0fea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:23.471393 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05199857-0b00-44d0-9911-9997ab6e0fea None admin] RBAC: Adding query filter params (role.id=6eade9c7eb83430aa3d5076986bfe477, user.id=55e4a36b58434f8ea002bddfe71ca6fd, scope.system=all) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:23.471393 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05199857-0b00-44d0-9911-9997ab6e0fea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:23.471393 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05199857-0b00-44d0-9911-9997ab6e0fea None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:23.487268 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 188/372] 10.222.0.55 () {56 vars in 1308 bytes} [Wed Aug 24 16:50:23 2022] GET /identity/v3/role_assignments?user.id=55e4a36b58434f8ea002bddfe71ca6fd&scope.system=all&role.id=6eade9c7eb83430aa3d5076986bfe477 => generated 510 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:23.488116 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05199857-0b00-44d0-9911-9997ab6e0fea None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:23.605886 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05199857-0b00-44d0-9911-9997ab6e0fea None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:23.614598 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:23.637326 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:23.640101 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 185/373] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:50:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:23.645959 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404af17-ce66-43ce-900b-fea348eb48b5 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:23.646239 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250b6a7-07cf-4f99-b773-721befc502a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:23.646868 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250b6a7-07cf-4f99-b773-721befc502a5 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:23.647210 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250b6a7-07cf-4f99-b773-721befc502a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:23.647492 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250b6a7-07cf-4f99-b773-721befc502a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:23.731755 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250b6a7-07cf-4f99-b773-721befc502a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:23.733248 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250b6a7-07cf-4f99-b773-721befc502a5 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:23.853114 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 189/374] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:50:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:23.863197 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250b6a7-07cf-4f99-b773-721befc502a5 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:23.899532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:23.937420 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6404af17-ce66-43ce-900b-fea348eb48b5 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:23.984205 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250b6a7-07cf-4f99-b773-721befc502a5 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:24.010706 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90a739-c57a-4bd6-8ad7-1eb2fcd9d1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:24.011441 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90a739-c57a-4bd6-8ad7-1eb2fcd9d1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:24.011666 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90a739-c57a-4bd6-8ad7-1eb2fcd9d1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:24.011938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf90a739-c57a-4bd6-8ad7-1eb2fcd9d1f0 None admin] PATH_INFO: `/v3/projects/9125daf250634e3881ac3ca4ab91d86b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:24.013247 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf90a739-c57a-4bd6-8ad7-1eb2fcd9d1f0 None admin] RBAC: Authorizing `identity:get_project(project_id=9125daf250634e3881ac3ca4ab91d86b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:24.014665 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf90a739-c57a-4bd6-8ad7-1eb2fcd9d1f0 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:24.016669 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 186/375] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:50:23 2022] GET /identity/v3/projects/9125daf250634e3881ac3ca4ab91d86b => generated 302 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:24.022721 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90a739-c57a-4bd6-8ad7-1eb2fcd9d1f0 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:24.023524 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f389b0-f955-4a8d-9e1d-6dc85dee74cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:24.024169 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f389b0-f955-4a8d-9e1d-6dc85dee74cb None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:24.024449 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f389b0-f955-4a8d-9e1d-6dc85dee74cb None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:24.024720 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f389b0-f955-4a8d-9e1d-6dc85dee74cb None admin] PATH_INFO: `/v3/projects/f322c406251a41cbaa75ad5201783a99` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:24.025856 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f389b0-f955-4a8d-9e1d-6dc85dee74cb None admin] RBAC: Authorizing `identity:get_project(project_id=f322c406251a41cbaa75ad5201783a99)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:24.027860 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f389b0-f955-4a8d-9e1d-6dc85dee74cb None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:24.029858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 190/376] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:50:23 2022] GET /identity/v3/projects/f322c406251a41cbaa75ad5201783a99 => generated 344 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:50:24.035297 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f389b0-f955-4a8d-9e1d-6dc85dee74cb None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:24.126363 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:24.143328 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:24.149849 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f389b0-f955-4a8d-9e1d-6dc85dee74cb None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:24.192877 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf90a739-c57a-4bd6-8ad7-1eb2fcd9d1f0 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:24.193217 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2111b4-c49a-4fef-bd72-b34d1fd0e1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:24.193846 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2111b4-c49a-4fef-bd72-b34d1fd0e1b8 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:24.194126 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2111b4-c49a-4fef-bd72-b34d1fd0e1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:24.194402 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2111b4-c49a-4fef-bd72-b34d1fd0e1b8 None admin] PATH_INFO: `/v3/groups/06a598aa0f9640dd836e99e5f4d53d64` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:24.204359 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2111b4-c49a-4fef-bd72-b34d1fd0e1b8 None admin] RBAC: Authorizing `identity:get_group(group_id=06a598aa0f9640dd836e99e5f4d53d64)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:24.205908 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2111b4-c49a-4fef-bd72-b34d1fd0e1b8 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:24.207957 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 191/377] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Aug 24 16:50:24 2022] GET /identity/v3/groups/06a598aa0f9640dd836e99e5f4d53d64 => generated 229 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:50:24.213904 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2111b4-c49a-4fef-bd72-b34d1fd0e1b8 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:24.232814 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f04b56-70cc-468e-87c6-fdec2120518d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:24.233465 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f04b56-70cc-468e-87c6-fdec2120518d None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:24.233745 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f04b56-70cc-468e-87c6-fdec2120518d None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:24.234020 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f04b56-70cc-468e-87c6-fdec2120518d None admin] PATH_INFO: `/v3/groups/8d7691de30a04ae395356475cf11338b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:24.235192 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f04b56-70cc-468e-87c6-fdec2120518d None admin] RBAC: Authorizing `identity:get_group(group_id=8d7691de30a04ae395356475cf11338b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:24.236650 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f04b56-70cc-468e-87c6-fdec2120518d None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:24.238247 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 187/378] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Aug 24 16:50:24 2022] GET /identity/v3/groups/8d7691de30a04ae395356475cf11338b => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:50:24.246292 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f04b56-70cc-468e-87c6-fdec2120518d None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:24.363495 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2111b4-c49a-4fef-bd72-b34d1fd0e1b8 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:24.393661 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f04b56-70cc-468e-87c6-fdec2120518d None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:24.410604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c8d20-b45c-4360-a77c-052c45abbad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:24.411333 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c8d20-b45c-4360-a77c-052c45abbad8 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:24.411603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c8d20-b45c-4360-a77c-052c45abbad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:24.411870 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c8d20-b45c-4360-a77c-052c45abbad8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:24.412602 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c8d20-b45c-4360-a77c-052c45abbad8 None admin] RBAC: Adding query filter params (group.id=06a598aa0f9640dd836e99e5f4d53d64, role.id=99f0ace9fc4d4d028ca52fa9730cab4b, scope.project.id=f322c406251a41cbaa75ad5201783a99) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:24.412903 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c8d20-b45c-4360-a77c-052c45abbad8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:24.414411 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c8d20-b45c-4360-a77c-052c45abbad8 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:24.424476 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 192/379] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Aug 24 16:50:24 2022] GET /identity/v3/role_assignments?group.id=06a598aa0f9640dd836e99e5f4d53d64&scope.project.id=f322c406251a41cbaa75ad5201783a99&role.id=99f0ace9fc4d4d028ca52fa9730cab4b => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:50:24.443266 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:24.456466 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715a6da-7dc2-45f1-b44a-55372e20840d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:24.457086 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715a6da-7dc2-45f1-b44a-55372e20840d None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:24.457360 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715a6da-7dc2-45f1-b44a-55372e20840d None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:24.458168 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715a6da-7dc2-45f1-b44a-55372e20840d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:24.458418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715a6da-7dc2-45f1-b44a-55372e20840d None admin] RBAC: Adding query filter params (group.id=8d7691de30a04ae395356475cf11338b, role.id=1c6cc7bf29b146b0a9aaf6a07607258a, scope.project.id=9125daf250634e3881ac3ca4ab91d86b) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:24.458773 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715a6da-7dc2-45f1-b44a-55372e20840d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:24.460261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715a6da-7dc2-45f1-b44a-55372e20840d None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:24.467846 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 188/380] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Aug 24 16:50:24 2022] GET /identity/v3/role_assignments?group.id=8d7691de30a04ae395356475cf11338b&scope.project.id=9125daf250634e3881ac3ca4ab91d86b&role.id=1c6cc7bf29b146b0a9aaf6a07607258a => generated 260 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:50:25.101418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd935c9-78ba-439e-82a7-bd1f5baecacc None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:25.101926 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd935c9-78ba-439e-82a7-bd1f5baecacc None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:25.102001 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd935c9-78ba-439e-82a7-bd1f5baecacc None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:25.103675 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 193/381] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:25.110192 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17338d70-c2c3-4764-abcb-6a7c45c50e2c None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:25.110679 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17338d70-c2c3-4764-abcb-6a7c45c50e2c None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:25.110754 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17338d70-c2c3-4764-abcb-6a7c45c50e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:25.139294 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-17338d70-c2c3-4764-abcb-6a7c45c50e2c None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:25.140501 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-17338d70-c2c3-4764-abcb-6a7c45c50e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:25.221075 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 189/382] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:25.572286 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cb587-6c44-4300-9053-6503c318e0d5 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:25.572588 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cb587-6c44-4300-9053-6503c318e0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:25.572937 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257cb587-6c44-4300-9053-6503c318e0d5 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:25.574755 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 194/383] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:25.580977 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fae54c-40dd-4f2e-8e69-ad2a9de4b011 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:25.581277 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fae54c-40dd-4f2e-8e69-ad2a9de4b011 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:25.581537 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fae54c-40dd-4f2e-8e69-ad2a9de4b011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:25.606810 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-14fae54c-40dd-4f2e-8e69-ad2a9de4b011 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:25.608068 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-14fae54c-40dd-4f2e-8e69-ad2a9de4b011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:25.677737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514978fe-a144-4a1a-81ff-f6b7d6d3a18c None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:25.678089 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514978fe-a144-4a1a-81ff-f6b7d6d3a18c None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:25.678278 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514978fe-a144-4a1a-81ff-f6b7d6d3a18c None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:25.679910 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 195/384] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:25.685878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248d561-dd56-4d73-a4bc-57483cada26c None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:25.686171 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248d561-dd56-4d73-a4bc-57483cada26c None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:25.686428 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3248d561-dd56-4d73-a4bc-57483cada26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:25.702441 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 190/385] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:25.708538 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-3248d561-dd56-4d73-a4bc-57483cada26c None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:25.709779 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-3248d561-dd56-4d73-a4bc-57483cada26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:25.733376 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:25.801402 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fae54c-40dd-4f2e-8e69-ad2a9de4b011 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:25.814396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 196/386] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:50:25.877237 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:25.939094 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fae54c-40dd-4f2e-8e69-ad2a9de4b011 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:25.980388 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b092e-cf5f-4dce-8c07-863830718a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:25.981105 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b092e-cf5f-4dce-8c07-863830718a72 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:25.981374 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b092e-cf5f-4dce-8c07-863830718a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:25.981640 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b092e-cf5f-4dce-8c07-863830718a72 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:25.994930 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b092e-cf5f-4dce-8c07-863830718a72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:26.000198 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-6a0b092e-cf5f-4dce-8c07-863830718a72 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:50:26.000198 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:26.000198 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:26.000198 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:26.000198 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:26.000198 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:26.000198 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:26.000198 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:26.000198 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:26.000198 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:26.000198 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:26.000198 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:26.000198 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:26.000198 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:26.000198 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:26.000198 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:26.001154 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:26.001154 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:26.001154 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:26.001154 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:26.001154 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:26.001154 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:26.001154 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:26.001154 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:26.001154 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:26.001154 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:26.001154 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:26.001154 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:26.001154 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:26.001154 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:26.001154 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:26.001154 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:26.001987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:26.001987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:26.001987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:26.001987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:26.001987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:26.001987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:26.001987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:26.001987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:26.001987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:26.001987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:26.001987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:50:26.001987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:26.001987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 191/387] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Aug 24 16:50:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:26.008227 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248d561-dd56-4d73-a4bc-57483cada26c None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:26.056317 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b092e-cf5f-4dce-8c07-863830718a72 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:26.158798 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3248d561-dd56-4d73-a4bc-57483cada26c None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:26.231600 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24aa326-caa7-4ca9-9e34-fbba4d2fabf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:26.232229 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24aa326-caa7-4ca9-9e34-fbba4d2fabf0 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:26.232512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24aa326-caa7-4ca9-9e34-fbba4d2fabf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:26.232784 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24aa326-caa7-4ca9-9e34-fbba4d2fabf0 None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:26.233468 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24aa326-caa7-4ca9-9e34-fbba4d2fabf0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:26.233772 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24aa326-caa7-4ca9-9e34-fbba4d2fabf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:26.235187 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24aa326-caa7-4ca9-9e34-fbba4d2fabf0 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:26.249412 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 197/388] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:50:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:26.250384 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24aa326-caa7-4ca9-9e34-fbba4d2fabf0 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:26.268479 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:26.273389 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b092e-cf5f-4dce-8c07-863830718a72 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:26.286269 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:26.327029 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49a34f-91b3-4362-83f9-5b7622ba1918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:26.328247 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49a34f-91b3-4362-83f9-5b7622ba1918 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:26.328689 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49a34f-91b3-4362-83f9-5b7622ba1918 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:26.329090 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49a34f-91b3-4362-83f9-5b7622ba1918 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:26.346778 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49a34f-91b3-4362-83f9-5b7622ba1918 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:26.355391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-2e49a34f-91b3-4362-83f9-5b7622ba1918 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:50:26.355391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:26.355391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:26.355391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:26.355391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:26.355391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:26.355391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:26.355391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:26.355391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:26.355391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:26.355391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:26.355391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:26.355391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:26.355391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:26.355391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:26.355391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:26.358236 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:26.358236 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:26.358236 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:26.358236 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:26.358236 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:26.358236 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:26.358236 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:26.358236 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:26.358236 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:26.358236 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:26.358236 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:26.358236 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:26.358236 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:26.358236 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:26.358236 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:26.358236 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:26.361204 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:26.361204 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:26.361204 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:26.361204 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:26.361204 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:26.361204 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:26.361204 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:26.361204 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:26.361204 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:26.361204 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:26.361204 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:50:26.361204 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:26.361204 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 192/389] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:50:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:26.361204 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49a34f-91b3-4362-83f9-5b7622ba1918 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:26.382038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24aa326-caa7-4ca9-9e34-fbba4d2fabf0 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:26.442319 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c37c9-98ec-433d-b035-8e67d62e8a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:26.444094 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c37c9-98ec-433d-b035-8e67d62e8a38 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:26.444094 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c37c9-98ec-433d-b035-8e67d62e8a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:26.444094 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594c37c9-98ec-433d-b035-8e67d62e8a38 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:26.459382 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594c37c9-98ec-433d-b035-8e67d62e8a38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:26.465998 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-594c37c9-98ec-433d-b035-8e67d62e8a38 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:50:26.465998 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:26.465998 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:26.465998 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:26.465998 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:26.465998 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:26.465998 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:26.465998 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:26.465998 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:26.465998 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:26.465998 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:26.465998 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:26.465998 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:26.465998 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:26.465998 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:26.465998 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:26.469146 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:26.469146 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:26.469146 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:26.469146 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:26.469146 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:26.469146 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:26.469146 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:26.469146 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:26.469146 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:26.469146 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:26.469146 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:26.469146 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:26.469146 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:26.469146 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:26.469146 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:26.469146 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:26.471950 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:26.471950 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:26.471950 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:26.471950 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:26.471950 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:26.471950 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:26.471950 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:26.471950 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:26.471950 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:26.471950 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:26.471950 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:50:26.471950 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:26.471950 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 198/390] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:50:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:26.471950 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c37c9-98ec-433d-b035-8e67d62e8a38 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:26.505403 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49a34f-91b3-4362-83f9-5b7622ba1918 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:26.554757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55fa8c-8668-4e46-9819-97a3bf40e224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:26.556315 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55fa8c-8668-4e46-9819-97a3bf40e224 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:26.556810 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55fa8c-8668-4e46-9819-97a3bf40e224 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:26.557344 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55fa8c-8668-4e46-9819-97a3bf40e224 None admin] PATH_INFO: `/v3/groups/8d7691de30a04ae395356475cf11338b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:26.559326 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55fa8c-8668-4e46-9819-97a3bf40e224 None admin] RBAC: Authorizing `identity:get_group(group_id=8d7691de30a04ae395356475cf11338b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:26.565553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55fa8c-8668-4e46-9819-97a3bf40e224 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:26.568622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 193/391] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Aug 24 16:50:26 2022] GET /identity/v3/groups/8d7691de30a04ae395356475cf11338b => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:26.569941 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55fa8c-8668-4e46-9819-97a3bf40e224 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:26.593475 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:26.642560 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:26.645880 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594c37c9-98ec-433d-b035-8e67d62e8a38 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:26.711865 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8404b-a357-470f-824b-b584df559383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:26.712379 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8404b-a357-470f-824b-b584df559383 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:26.712651 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8404b-a357-470f-824b-b584df559383 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:26.712919 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8404b-a357-470f-824b-b584df559383 None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:26.714295 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8404b-a357-470f-824b-b584df559383 None admin] RBAC: Adding query filter params (name=member) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:26.714592 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8404b-a357-470f-824b-b584df559383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:26.716441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8404b-a357-470f-824b-b584df559383 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:26.728846 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 199/392] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Aug 24 16:50:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:26.730312 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8404b-a357-470f-824b-b584df559383 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:26.756547 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55fa8c-8668-4e46-9819-97a3bf40e224 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:26.811869 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c47a4-00f2-489d-ab88-95e1033cc9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:26.812819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c47a4-00f2-489d-ab88-95e1033cc9a4 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:26.813099 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c47a4-00f2-489d-ab88-95e1033cc9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:26.813370 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c47a4-00f2-489d-ab88-95e1033cc9a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:26.814052 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c47a4-00f2-489d-ab88-95e1033cc9a4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:26.814606 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c47a4-00f2-489d-ab88-95e1033cc9a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:26.816202 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c47a4-00f2-489d-ab88-95e1033cc9a4 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:26.827357 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 194/393] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Aug 24 16:50:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:26.828361 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c47a4-00f2-489d-ab88-95e1033cc9a4 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:26.865153 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8404b-a357-470f-824b-b584df559383 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:26.908891 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279682d0-d9cb-4ceb-bf78-aa50d03760be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:26.909597 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279682d0-d9cb-4ceb-bf78-aa50d03760be None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:26.909877 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279682d0-d9cb-4ceb-bf78-aa50d03760be None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:26.910149 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279682d0-d9cb-4ceb-bf78-aa50d03760be None admin] PATH_INFO: `/v3/projects/bdf2d550302d4cafb7d454c50b6794c7` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:26.911514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279682d0-d9cb-4ceb-bf78-aa50d03760be None admin] RBAC: Authorizing `identity:get_project(project_id=bdf2d550302d4cafb7d454c50b6794c7)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:26.913205 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279682d0-d9cb-4ceb-bf78-aa50d03760be None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:26.915052 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 200/394] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:50:26 2022] GET /identity/v3/projects/bdf2d550302d4cafb7d454c50b6794c7 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:26.915995 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279682d0-d9cb-4ceb-bf78-aa50d03760be None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:26.920570 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:26.961811 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:26.967929 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c47a4-00f2-489d-ab88-95e1033cc9a4 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:27.008492 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcefaf5-4fe6-4ebc-a6a2-7ef5d2ad9e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:27.010116 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcefaf5-4fe6-4ebc-a6a2-7ef5d2ad9e22 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:27.010455 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcefaf5-4fe6-4ebc-a6a2-7ef5d2ad9e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:27.011520 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcefaf5-4fe6-4ebc-a6a2-7ef5d2ad9e22 None admin] PATH_INFO: `/v3/groups/8d7691de30a04ae395356475cf11338b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:27.012852 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcefaf5-4fe6-4ebc-a6a2-7ef5d2ad9e22 None admin] RBAC: Authorizing `identity:get_group(group_id=8d7691de30a04ae395356475cf11338b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:27.014885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcefaf5-4fe6-4ebc-a6a2-7ef5d2ad9e22 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:27.016740 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 195/395] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Aug 24 16:50:26 2022] GET /identity/v3/groups/8d7691de30a04ae395356475cf11338b => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:27.020494 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcefaf5-4fe6-4ebc-a6a2-7ef5d2ad9e22 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:27.046118 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279682d0-d9cb-4ceb-bf78-aa50d03760be None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:27.085697 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34989dfb-94f7-4dc1-a8d4-87e9e7d64e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:27.086324 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34989dfb-94f7-4dc1-a8d4-87e9e7d64e3c None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:27.086599 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34989dfb-94f7-4dc1-a8d4-87e9e7d64e3c None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:27.086869 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34989dfb-94f7-4dc1-a8d4-87e9e7d64e3c None admin] PATH_INFO: `/v3/groups/8d7691de30a04ae395356475cf11338b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:27.089129 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34989dfb-94f7-4dc1-a8d4-87e9e7d64e3c None admin] RBAC: Authorizing `identity:get_group(group_id=8d7691de30a04ae395356475cf11338b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:27.090971 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34989dfb-94f7-4dc1-a8d4-87e9e7d64e3c None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:27.096740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 201/396] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Aug 24 16:50:26 2022] GET /identity/v3/groups/8d7691de30a04ae395356475cf11338b => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:27.096740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f2c13-04b0-412a-a94e-e7e3af8e683a None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:27.096740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f2c13-04b0-412a-a94e-e7e3af8e683a None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:27.096740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f2c13-04b0-412a-a94e-e7e3af8e683a None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:27.096740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 202/397] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:27.096740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f2c13-04b0-412a-a94e-e7e3af8e683a None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:27.153829 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcefaf5-4fe6-4ebc-a6a2-7ef5d2ad9e22 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:27.191566 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:27.196564 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309e808-1100-4e6a-9506-0e01aae56a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:27.197234 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309e808-1100-4e6a-9506-0e01aae56a85 None admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:27.197511 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309e808-1100-4e6a-9506-0e01aae56a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:27.197840 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309e808-1100-4e6a-9506-0e01aae56a85 None admin] PATH_INFO: `/v3/projects/bdf2d550302d4cafb7d454c50b6794c7/groups/8d7691de30a04ae395356475cf11338b/roles/1c6cc7bf29b146b0a9aaf6a07607258a` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:27.203605 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309e808-1100-4e6a-9506-0e01aae56a85 None admin] RBAC: Authorizing `identity:create_grant(project_id=bdf2d550302d4cafb7d454c50b6794c7, group_id=8d7691de30a04ae395356475cf11338b, role_id=1c6cc7bf29b146b0a9aaf6a07607258a)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:27.206796 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5309e808-1100-4e6a-9506-0e01aae56a85 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:27.227417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f2c13-04b0-412a-a94e-e7e3af8e683a None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:27.266183 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f0b2c-38cf-475c-9ec7-559b2e45ce73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:27.266823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f0b2c-38cf-475c-9ec7-559b2e45ce73 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:27.267102 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f0b2c-38cf-475c-9ec7-559b2e45ce73 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:27.267399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f0b2c-38cf-475c-9ec7-559b2e45ce73 None admin] PATH_INFO: `/v3/projects/9125daf250634e3881ac3ca4ab91d86b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:27.268531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f0b2c-38cf-475c-9ec7-559b2e45ce73 None admin] RBAC: Authorizing `identity:get_project(project_id=9125daf250634e3881ac3ca4ab91d86b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:27.269968 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f0b2c-38cf-475c-9ec7-559b2e45ce73 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:27.271643 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 203/398] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:50:27 2022] GET /identity/v3/projects/9125daf250634e3881ac3ca4ab91d86b => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:27.272406 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f0b2c-38cf-475c-9ec7-559b2e45ce73 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:27.322482 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 196/399] 10.222.0.55 () {58 vars in 1442 bytes} [Wed Aug 24 16:50:27 2022] PUT /identity/v3/projects/bdf2d550302d4cafb7d454c50b6794c7/groups/8d7691de30a04ae395356475cf11338b/roles/1c6cc7bf29b146b0a9aaf6a07607258a => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:50:27.324818 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b5d52-66e9-4a80-a0e0-eb45cedcc484 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:27.325417 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b5d52-66e9-4a80-a0e0-eb45cedcc484 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:27.326045 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b5d52-66e9-4a80-a0e0-eb45cedcc484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:27.357918 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-678b5d52-66e9-4a80-a0e0-eb45cedcc484 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:27.359987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-678b5d52-66e9-4a80-a0e0-eb45cedcc484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:27.395405 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:27.406876 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f0b2c-38cf-475c-9ec7-559b2e45ce73 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:27.451981 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841cb27-2a96-49dc-8fda-8b5edffb0db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:27.452556 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841cb27-2a96-49dc-8fda-8b5edffb0db2 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:27.452831 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841cb27-2a96-49dc-8fda-8b5edffb0db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:27.453094 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841cb27-2a96-49dc-8fda-8b5edffb0db2 None admin] PATH_INFO: `/v3/projects/bdf2d550302d4cafb7d454c50b6794c7` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:27.454243 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841cb27-2a96-49dc-8fda-8b5edffb0db2 None admin] RBAC: Authorizing `identity:get_project(project_id=bdf2d550302d4cafb7d454c50b6794c7)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:27.455778 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841cb27-2a96-49dc-8fda-8b5edffb0db2 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:27.464874 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 204/400] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:50:27 2022] GET /identity/v3/projects/bdf2d550302d4cafb7d454c50b6794c7 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:27.464874 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841cb27-2a96-49dc-8fda-8b5edffb0db2 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:27.474100 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 197/401] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:27.475730 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23af94-3194-4c7f-beda-b0420686ad3b None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:27.475986 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23af94-3194-4c7f-beda-b0420686ad3b None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:27.476267 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc23af94-3194-4c7f-beda-b0420686ad3b None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:27.482490 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 198/402] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:27.482490 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23af94-3194-4c7f-beda-b0420686ad3b None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:27.485736 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:27.615739 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc23af94-3194-4c7f-beda-b0420686ad3b None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:27.632738 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841cb27-2a96-49dc-8fda-8b5edffb0db2 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:27.662026 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39f8d53-6c27-4427-9925-8c0e722ca378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:27.662690 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f8d53-6c27-4427-9925-8c0e722ca378 None admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:27.662967 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f8d53-6c27-4427-9925-8c0e722ca378 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:27.663266 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39f8d53-6c27-4427-9925-8c0e722ca378 None admin] PATH_INFO: `/v3/projects/bdf2d550302d4cafb7d454c50b6794c7/groups/8d7691de30a04ae395356475cf11338b/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:27.665244 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f8d53-6c27-4427-9925-8c0e722ca378 None admin] RBAC: Authorizing `identity:create_grant(project_id=bdf2d550302d4cafb7d454c50b6794c7, group_id=8d7691de30a04ae395356475cf11338b, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:27.667952 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39f8d53-6c27-4427-9925-8c0e722ca378 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:27.678071 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af963b92-78f1-4953-9e13-1ff5d4d3853d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:27.678742 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af963b92-78f1-4953-9e13-1ff5d4d3853d None admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:27.679021 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af963b92-78f1-4953-9e13-1ff5d4d3853d None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:27.679379 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af963b92-78f1-4953-9e13-1ff5d4d3853d None admin] PATH_INFO: `/v3/projects/9125daf250634e3881ac3ca4ab91d86b/groups/8d7691de30a04ae395356475cf11338b/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:27.681433 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af963b92-78f1-4953-9e13-1ff5d4d3853d None admin] RBAC: Authorizing `identity:create_grant(project_id=9125daf250634e3881ac3ca4ab91d86b, group_id=8d7691de30a04ae395356475cf11338b, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:27.683303 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af963b92-78f1-4953-9e13-1ff5d4d3853d None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:27.764080 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 199/403] 10.222.0.55 () {58 vars in 1442 bytes} [Wed Aug 24 16:50:27 2022] PUT /identity/v3/projects/bdf2d550302d4cafb7d454c50b6794c7/groups/8d7691de30a04ae395356475cf11338b/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:50:27.765418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a705e2-b814-4f91-a440-4a90d003a2b7 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:27.765799 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a705e2-b814-4f91-a440-4a90d003a2b7 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:27.766177 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a705e2-b814-4f91-a440-4a90d003a2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:27.795754 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-44a705e2-b814-4f91-a440-4a90d003a2b7 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:27.797172 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-44a705e2-b814-4f91-a440-4a90d003a2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:27.810711 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:27.820994 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 205/404] 10.222.0.55 () {58 vars in 1442 bytes} [Wed Aug 24 16:50:27 2022] PUT /identity/v3/projects/9125daf250634e3881ac3ca4ab91d86b/groups/8d7691de30a04ae395356475cf11338b/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:50:27.822352 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af963b92-78f1-4953-9e13-1ff5d4d3853d None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:27.928694 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 200/405] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:27.952983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:27.995989 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af963b92-78f1-4953-9e13-1ff5d4d3853d None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:28.038137 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdd6df-d397-4305-9842-b6e5986e1944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:28.038781 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdd6df-d397-4305-9842-b6e5986e1944 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:28.039059 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdd6df-d397-4305-9842-b6e5986e1944 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:28.039377 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fdd6df-d397-4305-9842-b6e5986e1944 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:28.051624 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fdd6df-d397-4305-9842-b6e5986e1944 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:28.056891 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-21fdd6df-d397-4305-9842-b6e5986e1944 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:50:28.056891 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:28.056891 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:28.056891 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:28.056891 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:28.056891 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:28.056891 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:28.056891 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:28.056891 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:28.056891 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:28.056891 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:28.056891 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:28.056891 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:28.056891 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:28.056891 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:28.056891 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:28.057845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:28.057845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:28.057845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:28.057845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:28.057845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:28.057845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:28.057845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:28.057845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:28.057845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:28.057845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:28.057845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:28.057845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:28.057845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:28.057845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:28.057845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:28.057845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:28.058666 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:28.058666 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:28.058666 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:28.058666 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:28.058666 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:28.058666 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:28.058666 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:28.058666 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:28.058666 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:28.058666 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:28.058666 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:50:28.058666 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:28.058666 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 206/406] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:50:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:28.065565 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a705e2-b814-4f91-a440-4a90d003a2b7 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:28.207513 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a705e2-b814-4f91-a440-4a90d003a2b7 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:28.251329 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab49a06-4179-469d-a352-77840f70e7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:28.251960 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab49a06-4179-469d-a352-77840f70e7eb None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:28.252241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab49a06-4179-469d-a352-77840f70e7eb None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:28.252516 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab49a06-4179-469d-a352-77840f70e7eb None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:28.253197 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab49a06-4179-469d-a352-77840f70e7eb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:28.253502 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab49a06-4179-469d-a352-77840f70e7eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:28.254897 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab49a06-4179-469d-a352-77840f70e7eb None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:28.273333 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 201/407] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:50:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:28.279202 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdd6df-d397-4305-9842-b6e5986e1944 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:28.323848 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab49a06-4179-469d-a352-77840f70e7eb None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:28.335504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:28.449367 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fdd6df-d397-4305-9842-b6e5986e1944 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:28.478013 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:28.487135 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45174699-8c28-4a98-83bb-76f4e5c1464e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:28.487995 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45174699-8c28-4a98-83bb-76f4e5c1464e None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:28.489452 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45174699-8c28-4a98-83bb-76f4e5c1464e None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:28.489452 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45174699-8c28-4a98-83bb-76f4e5c1464e None admin] PATH_INFO: `/v3/groups/06a598aa0f9640dd836e99e5f4d53d64` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:28.490044 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45174699-8c28-4a98-83bb-76f4e5c1464e None admin] RBAC: Authorizing `identity:get_group(group_id=06a598aa0f9640dd836e99e5f4d53d64)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:28.491896 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45174699-8c28-4a98-83bb-76f4e5c1464e None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:28.499609 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 207/408] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Aug 24 16:50:28 2022] GET /identity/v3/groups/06a598aa0f9640dd836e99e5f4d53d64 => generated 229 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:28.503537 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45174699-8c28-4a98-83bb-76f4e5c1464e None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:28.511351 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab49a06-4179-469d-a352-77840f70e7eb None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:28.584346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa096d00-8473-4d14-9c43-5ff977bb8b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:28.584957 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa096d00-8473-4d14-9c43-5ff977bb8b57 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:28.585241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa096d00-8473-4d14-9c43-5ff977bb8b57 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:28.585509 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa096d00-8473-4d14-9c43-5ff977bb8b57 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:28.605847 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa096d00-8473-4d14-9c43-5ff977bb8b57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:28.612475 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45174699-8c28-4a98-83bb-76f4e5c1464e None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:28.622018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-fa096d00-8473-4d14-9c43-5ff977bb8b57 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:50:28.622018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:28.622018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:28.622018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:28.622018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:28.622018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:28.622018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:28.622018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:28.622018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:28.622018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:28.622018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:28.622018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:28.622018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:28.622018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:28.622018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:28.622018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:28.623015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:28.623015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:28.623015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:28.623015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:28.623015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:28.623015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:28.623015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:28.623015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:28.623015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:28.623015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:28.623015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:28.623015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:28.623015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:28.623015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:28.623015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:28.623015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:28.623873 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:28.623873 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:28.623873 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:28.623873 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:28.623873 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:28.623873 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:28.623873 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:28.623873 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:28.623873 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:28.623873 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:28.623873 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:50:28.623873 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:28.626143 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 202/409] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Aug 24 16:50:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:50:28.631130 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa096d00-8473-4d14-9c43-5ff977bb8b57 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:28.657291 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d148d-941a-4fbb-a30c-e8f2bc47fa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:28.657992 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d148d-941a-4fbb-a30c-e8f2bc47fa3f None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:28.658268 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d148d-941a-4fbb-a30c-e8f2bc47fa3f None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:28.658582 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d148d-941a-4fbb-a30c-e8f2bc47fa3f None admin] PATH_INFO: `/v3/projects/f322c406251a41cbaa75ad5201783a99` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:28.659814 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d148d-941a-4fbb-a30c-e8f2bc47fa3f None admin] RBAC: Authorizing `identity:get_project(project_id=f322c406251a41cbaa75ad5201783a99)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:28.661317 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71d148d-941a-4fbb-a30c-e8f2bc47fa3f None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:28.663017 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 208/410] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:50:28 2022] GET /identity/v3/projects/f322c406251a41cbaa75ad5201783a99 => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:28.669292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d148d-941a-4fbb-a30c-e8f2bc47fa3f None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:28.732387 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:28.769573 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa096d00-8473-4d14-9c43-5ff977bb8b57 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:28.805410 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01fd83-9872-4802-afde-6499036bf191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:28.806387 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01fd83-9872-4802-afde-6499036bf191 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:28.806883 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01fd83-9872-4802-afde-6499036bf191 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:28.808037 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01fd83-9872-4802-afde-6499036bf191 None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:28.809122 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01fd83-9872-4802-afde-6499036bf191 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:28.809694 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01fd83-9872-4802-afde-6499036bf191 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:28.811296 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01fd83-9872-4802-afde-6499036bf191 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:28.820459 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 203/411] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:50:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:28.828030 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01fd83-9872-4802-afde-6499036bf191 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:28.853386 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:28.920397 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d148d-941a-4fbb-a30c-e8f2bc47fa3f None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:28.998377 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733948ed-4daf-4e5f-bab1-9a8cae85ca6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:28.999445 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733948ed-4daf-4e5f-bab1-9a8cae85ca6a None admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:28.999985 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733948ed-4daf-4e5f-bab1-9a8cae85ca6a None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:29.000492 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733948ed-4daf-4e5f-bab1-9a8cae85ca6a None admin] PATH_INFO: `/v3/projects/f322c406251a41cbaa75ad5201783a99/groups/06a598aa0f9640dd836e99e5f4d53d64/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:29.005214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733948ed-4daf-4e5f-bab1-9a8cae85ca6a None admin] RBAC: Authorizing `identity:create_grant(project_id=f322c406251a41cbaa75ad5201783a99, group_id=06a598aa0f9640dd836e99e5f4d53d64, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:29.007128 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733948ed-4daf-4e5f-bab1-9a8cae85ca6a None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:29.031648 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01fd83-9872-4802-afde-6499036bf191 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:29.065572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:29.072157 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc0618-316f-40dc-8dee-4a84533d2e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:29.073216 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc0618-316f-40dc-8dee-4a84533d2e1d None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:29.073709 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc0618-316f-40dc-8dee-4a84533d2e1d None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:29.074181 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc0618-316f-40dc-8dee-4a84533d2e1d None admin] PATH_INFO: `/v3/groups/8d7691de30a04ae395356475cf11338b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:29.075654 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc0618-316f-40dc-8dee-4a84533d2e1d None admin] RBAC: Authorizing `identity:get_group(group_id=8d7691de30a04ae395356475cf11338b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:29.077339 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbc0618-316f-40dc-8dee-4a84533d2e1d None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:29.079523 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 204/412] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Aug 24 16:50:28 2022] GET /identity/v3/groups/8d7691de30a04ae395356475cf11338b => generated 226 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:29.089772 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc0618-316f-40dc-8dee-4a84533d2e1d None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:29.122272 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 209/413] 10.222.0.55 () {58 vars in 1442 bytes} [Wed Aug 24 16:50:28 2022] PUT /identity/v3/projects/f322c406251a41cbaa75ad5201783a99/groups/06a598aa0f9640dd836e99e5f4d53d64/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:50:29.215959 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbc0618-316f-40dc-8dee-4a84533d2e1d None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:29.254296 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815abbf-856b-47d2-9b64-f83adbd30097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:29.254930 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815abbf-856b-47d2-9b64-f83adbd30097 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:29.255278 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815abbf-856b-47d2-9b64-f83adbd30097 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:29.255554 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815abbf-856b-47d2-9b64-f83adbd30097 None admin] PATH_INFO: `/v3/projects/9125daf250634e3881ac3ca4ab91d86b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:29.256685 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815abbf-856b-47d2-9b64-f83adbd30097 None admin] RBAC: Authorizing `identity:get_project(project_id=9125daf250634e3881ac3ca4ab91d86b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:29.258132 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815abbf-856b-47d2-9b64-f83adbd30097 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:29.260313 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 205/414] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:50:29 2022] GET /identity/v3/projects/9125daf250634e3881ac3ca4ab91d86b => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:29.265756 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733948ed-4daf-4e5f-bab1-9a8cae85ca6a None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:29.409417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733948ed-4daf-4e5f-bab1-9a8cae85ca6a None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:29.437934 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:29.450302 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429f9336-be20-4e78-a608-e28105cac3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:29.451284 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f9336-be20-4e78-a608-e28105cac3e6 None admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:29.451284 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f9336-be20-4e78-a608-e28105cac3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:29.451527 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429f9336-be20-4e78-a608-e28105cac3e6 None admin] PATH_INFO: `/v3/projects/9125daf250634e3881ac3ca4ab91d86b/groups/8d7691de30a04ae395356475cf11338b/roles/1c6cc7bf29b146b0a9aaf6a07607258a` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:29.453695 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f9336-be20-4e78-a608-e28105cac3e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=9125daf250634e3881ac3ca4ab91d86b, group_id=8d7691de30a04ae395356475cf11338b, role_id=1c6cc7bf29b146b0a9aaf6a07607258a)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:29.455218 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429f9336-be20-4e78-a608-e28105cac3e6 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:29.555579 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 210/415] 10.222.0.55 () {58 vars in 1442 bytes} [Wed Aug 24 16:50:29 2022] PUT /identity/v3/projects/9125daf250634e3881ac3ca4ab91d86b/groups/8d7691de30a04ae395356475cf11338b/roles/1c6cc7bf29b146b0a9aaf6a07607258a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:50:29.704799 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d871294-6b6d-4461-9252-2cfa9653b58f None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:29.705295 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d871294-6b6d-4461-9252-2cfa9653b58f None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:29.705295 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d871294-6b6d-4461-9252-2cfa9653b58f None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:29.706960 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 206/416] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:29.714269 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4ea01-e9e9-487e-8572-8de87e1d7c87 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:29.714583 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4ea01-e9e9-487e-8572-8de87e1d7c87 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:29.714844 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4ea01-e9e9-487e-8572-8de87e1d7c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:29.742818 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-1cc4ea01-e9e9-487e-8572-8de87e1d7c87 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:29.744057 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-1cc4ea01-e9e9-487e-8572-8de87e1d7c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:29.837293 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 211/417] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:30.063695 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f39a0-e6d6-465f-a58c-8e2003b06b92 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:30.064318 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f39a0-e6d6-465f-a58c-8e2003b06b92 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:30.064508 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f39a0-e6d6-465f-a58c-8e2003b06b92 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:30.066129 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 207/418] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:30.071725 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cbb91-b3cf-4af6-b413-b3d9278c1b43 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:30.072011 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cbb91-b3cf-4af6-b413-b3d9278c1b43 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:30.072288 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cbb91-b3cf-4af6-b413-b3d9278c1b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:30.099403 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-5b3cbb91-b3cf-4af6-b413-b3d9278c1b43 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:30.100608 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-5b3cbb91-b3cf-4af6-b413-b3d9278c1b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:30.138551 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f39a0-e6d6-465f-a58c-8e2003b06b92 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:30.210938 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 212/419] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:30.211848 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:30.212953 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a1193-4e6a-49d7-9e88-2300f1b7a380 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:30.213788 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a1193-4e6a-49d7-9e88-2300f1b7a380 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:30.214068 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a1193-4e6a-49d7-9e88-2300f1b7a380 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:30.216142 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 213/420] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:30.221604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd4baf-f4e6-45a1-8e42-3c6a2c3ec1f6 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:30.221891 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd4baf-f4e6-45a1-8e42-3c6a2c3ec1f6 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:30.222172 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd4baf-f4e6-45a1-8e42-3c6a2c3ec1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:30.241537 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-83bd4baf-f4e6-45a1-8e42-3c6a2c3ec1f6 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:30.242759 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-83bd4baf-f4e6-45a1-8e42-3c6a2c3ec1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:30.251163 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f39a0-e6d6-465f-a58c-8e2003b06b92 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:30.288579 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:30.311976 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f81b65-3098-4320-88a9-88ca6e8289bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:30.312616 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f81b65-3098-4320-88a9-88ca6e8289bb None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:30.312898 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f81b65-3098-4320-88a9-88ca6e8289bb None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:30.313176 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f81b65-3098-4320-88a9-88ca6e8289bb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:30.334794 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f81b65-3098-4320-88a9-88ca6e8289bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:30.340743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-71f81b65-3098-4320-88a9-88ca6e8289bb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:50:30.340743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:30.340743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:30.340743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:30.340743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:30.340743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:30.340743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:30.340743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:30.340743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:30.340743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:30.340743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:30.340743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:30.340743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:30.340743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:30.340743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:30.340743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:30.343965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:30.343965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:30.343965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:30.343965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:30.343965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:30.343965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:30.343965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:30.343965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:30.343965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:30.343965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:30.343965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:30.343965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:30.343965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:30.343965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:30.343965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:30.343965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:30.344760 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:30.344760 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:30.344760 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:30.344760 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:30.344760 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:30.344760 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:30.344760 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:30.344760 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:30.344760 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:30.344760 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:30.344760 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:50:30.344760 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:30.344760 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 208/421] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Aug 24 16:50:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:50:30.347367 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 214/422] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:50:30.352537 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f81b65-3098-4320-88a9-88ca6e8289bb None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:30.484599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f81b65-3098-4320-88a9-88ca6e8289bb None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:30.521895 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:30.535068 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858a840-fac9-4b41-9fc0-a3bde065897f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:30.535733 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858a840-fac9-4b41-9fc0-a3bde065897f None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:30.543556 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858a840-fac9-4b41-9fc0-a3bde065897f None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:30.543556 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858a840-fac9-4b41-9fc0-a3bde065897f None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:30.543556 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b858a840-fac9-4b41-9fc0-a3bde065897f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:30.543556 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b858a840-fac9-4b41-9fc0-a3bde065897f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:30.543556 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b858a840-fac9-4b41-9fc0-a3bde065897f None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:30.551083 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 209/423] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:50:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:30.556945 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd4baf-f4e6-45a1-8e42-3c6a2c3ec1f6 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:30.566384 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858a840-fac9-4b41-9fc0-a3bde065897f None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:30.681569 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858a840-fac9-4b41-9fc0-a3bde065897f None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:30.724062 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ed9d3-1999-418c-a868-5c7ba22d5a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:30.724692 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ed9d3-1999-418c-a868-5c7ba22d5a26 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:30.724955 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ed9d3-1999-418c-a868-5c7ba22d5a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:30.725217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ed9d3-1999-418c-a868-5c7ba22d5a26 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:30.746439 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ed9d3-1999-418c-a868-5c7ba22d5a26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:30.753384 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-e71ed9d3-1999-418c-a868-5c7ba22d5a26 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:50:30.753384 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:30.753384 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:30.753384 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:30.753384 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:30.753384 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:30.753384 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:30.753384 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:30.753384 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:30.753384 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:30.753384 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:30.753384 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:30.753384 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:30.753384 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:30.753384 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:30.753384 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:30.754261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:30.754261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:30.754261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:30.754261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:30.754261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:30.754261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:30.754261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:30.754261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:30.754261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:30.754261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:30.754261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:30.754261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:30.754261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:30.754261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:30.754261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:30.754261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:30.755052 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:30.755052 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:30.755052 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:30.755052 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:30.755052 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:30.755052 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:30.755052 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:30.755052 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:30.755052 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:30.755052 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:30.755052 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:50:30.755052 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:30.758252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 210/424] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:50:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:50:30.762409 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ed9d3-1999-418c-a868-5c7ba22d5a26 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:30.778280 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd4baf-f4e6-45a1-8e42-3c6a2c3ec1f6 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:30.817467 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de8d20-e417-47ec-98f3-46b6a4453dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:30.818082 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de8d20-e417-47ec-98f3-46b6a4453dba None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:30.818361 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de8d20-e417-47ec-98f3-46b6a4453dba None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:30.818613 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de8d20-e417-47ec-98f3-46b6a4453dba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:30.819810 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:30.874265 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:30.881541 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ed9d3-1999-418c-a868-5c7ba22d5a26 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:30.904488 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de8d20-e417-47ec-98f3-46b6a4453dba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:30.905950 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de8d20-e417-47ec-98f3-46b6a4453dba None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:30.926097 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f8f0f-324c-401b-9fe3-d7ef1949f187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:30.926930 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f8f0f-324c-401b-9fe3-d7ef1949f187 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:30.927403 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f8f0f-324c-401b-9fe3-d7ef1949f187 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:30.928279 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504f8f0f-324c-401b-9fe3-d7ef1949f187 None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:30.929420 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f8f0f-324c-401b-9fe3-d7ef1949f187 None admin] RBAC: Adding query filter params (name=member) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:30.929877 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f8f0f-324c-401b-9fe3-d7ef1949f187 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:30.932802 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504f8f0f-324c-401b-9fe3-d7ef1949f187 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:30.945199 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 211/425] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Aug 24 16:50:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:30.946377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f8f0f-324c-401b-9fe3-d7ef1949f187 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:31.030153 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 215/426] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:50:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:31.032063 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de8d20-e417-47ec-98f3-46b6a4453dba None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:31.068086 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504f8f0f-324c-401b-9fe3-d7ef1949f187 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:31.085003 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:31.118734 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20d084-c0ac-4ac5-ba5b-e9472eca4b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:31.119576 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20d084-c0ac-4ac5-ba5b-e9472eca4b6a None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:31.119904 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20d084-c0ac-4ac5-ba5b-e9472eca4b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:31.120178 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20d084-c0ac-4ac5-ba5b-e9472eca4b6a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:31.123489 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:31.136667 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be20d084-c0ac-4ac5-ba5b-e9472eca4b6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:31.143251 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-be20d084-c0ac-4ac5-ba5b-e9472eca4b6a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:50:31.143251 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:31.143251 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:31.143251 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:31.143251 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:31.143251 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:31.143251 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:31.143251 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:31.143251 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:31.143251 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:31.143251 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:31.143251 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:31.143251 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:31.143251 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:31.143251 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:31.143251 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:31.144187 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:31.144187 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:31.144187 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:31.144187 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:31.144187 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:31.144187 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:31.144187 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:31.144187 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:31.144187 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:31.144187 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:31.144187 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:31.144187 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:31.144187 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:31.144187 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:31.144187 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:31.144187 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:31.144976 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:31.144976 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:31.144976 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:31.144976 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:31.144976 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:31.144976 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:31.144976 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:31.144976 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:31.144976 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:31.144976 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:31.144976 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 16:50:31.144976 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:31.147852 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 212/427] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:50:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:31.148812 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20d084-c0ac-4ac5-ba5b-e9472eca4b6a None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:31.164130 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de8d20-e417-47ec-98f3-46b6a4453dba None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:31.206350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e267521-d7a2-4466-8757-96897d95a4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:31.207816 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e267521-d7a2-4466-8757-96897d95a4df None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:31.208273 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e267521-d7a2-4466-8757-96897d95a4df None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:31.209176 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e267521-d7a2-4466-8757-96897d95a4df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:31.275349 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20d084-c0ac-4ac5-ba5b-e9472eca4b6a None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:31.290871 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e267521-d7a2-4466-8757-96897d95a4df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:31.293528 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e267521-d7a2-4466-8757-96897d95a4df None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:31.314371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0295667-3a34-43b7-9e46-92ba81a6190c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:31.315315 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0295667-3a34-43b7-9e46-92ba81a6190c None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:31.315885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0295667-3a34-43b7-9e46-92ba81a6190c None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:31.316158 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0295667-3a34-43b7-9e46-92ba81a6190c None admin] PATH_INFO: `/v3/projects/bdf2d550302d4cafb7d454c50b6794c7` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:31.317296 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0295667-3a34-43b7-9e46-92ba81a6190c None admin] RBAC: Authorizing `identity:get_project(project_id=bdf2d550302d4cafb7d454c50b6794c7)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:31.318834 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0295667-3a34-43b7-9e46-92ba81a6190c None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:31.320600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 213/428] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:50:31 2022] GET /identity/v3/projects/bdf2d550302d4cafb7d454c50b6794c7 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:31.326760 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0295667-3a34-43b7-9e46-92ba81a6190c None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:31.375057 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:31.379454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:31.408328 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 216/429] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:50:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:31.408328 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e267521-d7a2-4466-8757-96897d95a4df None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:31.445133 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0295667-3a34-43b7-9e46-92ba81a6190c None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:31.486652 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b135e3-6ad2-40a9-893a-a4dd34357af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:31.487379 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b135e3-6ad2-40a9-893a-a4dd34357af2 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:31.487661 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b135e3-6ad2-40a9-893a-a4dd34357af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:31.487983 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b135e3-6ad2-40a9-893a-a4dd34357af2 None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:31.489204 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b135e3-6ad2-40a9-893a-a4dd34357af2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:31.489521 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b135e3-6ad2-40a9-893a-a4dd34357af2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:31.491232 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b135e3-6ad2-40a9-893a-a4dd34357af2 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:31.503050 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 214/430] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Aug 24 16:50:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:31.505342 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b135e3-6ad2-40a9-893a-a4dd34357af2 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:31.539392 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e267521-d7a2-4466-8757-96897d95a4df None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:31.577670 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79eda3-9e56-40d9-83fe-f9a0e99343b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:31.578797 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79eda3-9e56-40d9-83fe-f9a0e99343b7 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:31.578797 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79eda3-9e56-40d9-83fe-f9a0e99343b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:31.579003 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79eda3-9e56-40d9-83fe-f9a0e99343b7 None admin] PATH_INFO: `/v3/groups/8d7691de30a04ae395356475cf11338b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:31.580277 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79eda3-9e56-40d9-83fe-f9a0e99343b7 None admin] RBAC: Authorizing `identity:get_group(group_id=8d7691de30a04ae395356475cf11338b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:31.581753 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79eda3-9e56-40d9-83fe-f9a0e99343b7 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:31.583617 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 217/431] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Aug 24 16:50:31 2022] GET /identity/v3/groups/8d7691de30a04ae395356475cf11338b => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:31.590051 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79eda3-9e56-40d9-83fe-f9a0e99343b7 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:31.614348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:31.617575 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b135e3-6ad2-40a9-893a-a4dd34357af2 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:31.636466 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:31.655010 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7625f-1bd8-4934-9750-f4bd90a82c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:31.655677 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7625f-1bd8-4934-9750-f4bd90a82c7c None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:31.655955 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7625f-1bd8-4934-9750-f4bd90a82c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:31.656235 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7625f-1bd8-4934-9750-f4bd90a82c7c None admin] PATH_INFO: `/v3/projects/9125daf250634e3881ac3ca4ab91d86b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:31.657426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7625f-1bd8-4934-9750-f4bd90a82c7c None admin] RBAC: Authorizing `identity:get_project(project_id=9125daf250634e3881ac3ca4ab91d86b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:31.658893 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7625f-1bd8-4934-9750-f4bd90a82c7c None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:31.660552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 215/432] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:50:31 2022] GET /identity/v3/projects/9125daf250634e3881ac3ca4ab91d86b => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:31.661657 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f44887-414f-47c9-a5e7-d57c07b64bfd None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:31.661941 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f44887-414f-47c9-a5e7-d57c07b64bfd None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:31.662256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f44887-414f-47c9-a5e7-d57c07b64bfd None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:31.668221 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 216/433] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:31.669122 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f44887-414f-47c9-a5e7-d57c07b64bfd None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:31.706734 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79eda3-9e56-40d9-83fe-f9a0e99343b7 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:31.743748 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320560bd-78b6-419f-8f13-eac03e66b17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:31.745503 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320560bd-78b6-419f-8f13-eac03e66b17d None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:31.745986 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320560bd-78b6-419f-8f13-eac03e66b17d None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:31.746487 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320560bd-78b6-419f-8f13-eac03e66b17d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:31.781879 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f44887-414f-47c9-a5e7-d57c07b64bfd None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:31.816883 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80eb90-9ff1-4b54-a2de-e849246d73b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:31.817491 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80eb90-9ff1-4b54-a2de-e849246d73b7 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:31.817772 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80eb90-9ff1-4b54-a2de-e849246d73b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:31.818044 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b80eb90-9ff1-4b54-a2de-e849246d73b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:31.818776 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80eb90-9ff1-4b54-a2de-e849246d73b7 None admin] RBAC: Adding query filter params (group.id=8d7691de30a04ae395356475cf11338b, role.id=1c6cc7bf29b146b0a9aaf6a07607258a, scope.project.id=bdf2d550302d4cafb7d454c50b6794c7) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:31.819090 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80eb90-9ff1-4b54-a2de-e849246d73b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:31.820556 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b80eb90-9ff1-4b54-a2de-e849246d73b7 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:31.825687 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320560bd-78b6-419f-8f13-eac03e66b17d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:31.827095 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320560bd-78b6-419f-8f13-eac03e66b17d None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:31.828093 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 217/434] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Aug 24 16:50:31 2022] GET /identity/v3/role_assignments?group.id=8d7691de30a04ae395356475cf11338b&scope.project.id=bdf2d550302d4cafb7d454c50b6794c7&role.id=1c6cc7bf29b146b0a9aaf6a07607258a => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:31.828823 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80eb90-9ff1-4b54-a2de-e849246d73b7 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:31.877178 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:31.903255 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:31.980413 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 218/435] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:50:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:31.980413 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cee6b-0e3d-4f8d-a261-0e731aab36b5 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:31.980413 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cee6b-0e3d-4f8d-a261-0e731aab36b5 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:31.980413 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cee6b-0e3d-4f8d-a261-0e731aab36b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:31.988466 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b80eb90-9ff1-4b54-a2de-e849246d73b7 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:32.000092 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-fc7cee6b-0e3d-4f8d-a261-0e731aab36b5 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:32.001231 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-fc7cee6b-0e3d-4f8d-a261-0e731aab36b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:32.033710 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636dedd-fe5e-4b2c-bda7-db26671b34e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:32.034377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636dedd-fe5e-4b2c-bda7-db26671b34e1 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:32.034714 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636dedd-fe5e-4b2c-bda7-db26671b34e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:32.034987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636dedd-fe5e-4b2c-bda7-db26671b34e1 None admin] PATH_INFO: `/v3/groups/8d7691de30a04ae395356475cf11338b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:32.036196 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636dedd-fe5e-4b2c-bda7-db26671b34e1 None admin] RBAC: Authorizing `identity:get_group(group_id=8d7691de30a04ae395356475cf11338b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:32.037648 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636dedd-fe5e-4b2c-bda7-db26671b34e1 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:32.039345 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 218/436] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Aug 24 16:50:31 2022] GET /identity/v3/groups/8d7691de30a04ae395356475cf11338b => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:32.040035 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636dedd-fe5e-4b2c-bda7-db26671b34e1 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:32.087474 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 219/437] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:32.088890 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7cee6b-0e3d-4f8d-a261-0e731aab36b5 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:32.158233 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:32.161117 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636dedd-fe5e-4b2c-bda7-db26671b34e1 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:32.168194 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:32.197189 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1a973-76f0-4542-8f32-37ac7839b660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:32.198428 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1a973-76f0-4542-8f32-37ac7839b660 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:32.198711 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1a973-76f0-4542-8f32-37ac7839b660 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:32.199042 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1a973-76f0-4542-8f32-37ac7839b660 None admin] PATH_INFO: `/v3/projects/bdf2d550302d4cafb7d454c50b6794c7` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:32.199590 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7cee6b-0e3d-4f8d-a261-0e731aab36b5 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:32.200412 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1a973-76f0-4542-8f32-37ac7839b660 None admin] RBAC: Authorizing `identity:get_project(project_id=bdf2d550302d4cafb7d454c50b6794c7)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:32.201877 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1a973-76f0-4542-8f32-37ac7839b660 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:32.208083 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 219/438] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:50:32 2022] GET /identity/v3/projects/bdf2d550302d4cafb7d454c50b6794c7 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:32.208083 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b036a9-f865-4492-bd42-e5f9d4fedc8c None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:32.208083 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b036a9-f865-4492-bd42-e5f9d4fedc8c None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:32.208083 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b036a9-f865-4492-bd42-e5f9d4fedc8c None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:32.208083 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 220/439] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:32.211661 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b036a9-f865-4492-bd42-e5f9d4fedc8c None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:32.236472 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80d0a2-9fee-422b-a480-e28be6799343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:32.237084 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80d0a2-9fee-422b-a480-e28be6799343 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:32.237359 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80d0a2-9fee-422b-a480-e28be6799343 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:32.237627 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80d0a2-9fee-422b-a480-e28be6799343 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:32.238351 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80d0a2-9fee-422b-a480-e28be6799343 None admin] RBAC: Adding query filter params (group.id=8d7691de30a04ae395356475cf11338b, role.id=d886d117c82147e6a6488228fee2ac8b, scope.project.id=9125daf250634e3881ac3ca4ab91d86b) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:32.238656 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80d0a2-9fee-422b-a480-e28be6799343 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:32.240113 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80d0a2-9fee-422b-a480-e28be6799343 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:32.247101 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 220/440] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Aug 24 16:50:32 2022] GET /identity/v3/role_assignments?group.id=8d7691de30a04ae395356475cf11338b&scope.project.id=9125daf250634e3881ac3ca4ab91d86b&role.id=d886d117c82147e6a6488228fee2ac8b => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:32.248276 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82c882-2342-4b9d-b784-8f8eb769907a None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:32.248557 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82c882-2342-4b9d-b784-8f8eb769907a None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:32.248828 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82c882-2342-4b9d-b784-8f8eb769907a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:32.269511 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-db82c882-2342-4b9d-b784-8f8eb769907a None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:32.270709 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-db82c882-2342-4b9d-b784-8f8eb769907a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:32.343058 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b036a9-f865-4492-bd42-e5f9d4fedc8c None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:32.358608 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 221/441] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:32.359864 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82c882-2342-4b9d-b784-8f8eb769907a None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:32.384256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004249d-c3e6-48a9-9b69-5630784330bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:32.385782 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004249d-c3e6-48a9-9b69-5630784330bc None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:32.386213 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004249d-c3e6-48a9-9b69-5630784330bc None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:32.386733 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004249d-c3e6-48a9-9b69-5630784330bc None admin] PATH_INFO: `/v3/groups/8d7691de30a04ae395356475cf11338b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:32.388255 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004249d-c3e6-48a9-9b69-5630784330bc None admin] RBAC: Authorizing `identity:get_group(group_id=8d7691de30a04ae395356475cf11338b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:32.390164 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004249d-c3e6-48a9-9b69-5630784330bc None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:32.392459 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 221/442] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Aug 24 16:50:32 2022] GET /identity/v3/groups/8d7691de30a04ae395356475cf11338b => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:32.398926 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004249d-c3e6-48a9-9b69-5630784330bc None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:32.442903 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:32.454206 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:32.507768 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82c882-2342-4b9d-b784-8f8eb769907a None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:32.534838 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004249d-c3e6-48a9-9b69-5630784330bc None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:32.552663 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc9c47-dea0-4698-9f6c-34f2eff77505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:32.553708 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc9c47-dea0-4698-9f6c-34f2eff77505 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:32.554072 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc9c47-dea0-4698-9f6c-34f2eff77505 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:32.554349 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc9c47-dea0-4698-9f6c-34f2eff77505 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:32.566530 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc9c47-dea0-4698-9f6c-34f2eff77505 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:32.571399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-11fc9c47-dea0-4698-9f6c-34f2eff77505 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:50:32.571399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:32.571399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:32.571399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:32.571399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:32.571399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:32.571399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:32.571399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:32.571399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:32.571399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:32.571399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:32.571399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:32.571399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:32.571399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:32.571399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:32.571399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:32.572849 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:32.572849 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:32.572849 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:32.572849 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:32.572849 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:32.572849 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:32.572849 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:32.572849 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:32.572849 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:32.572849 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:32.572849 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:32.572849 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:32.572849 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:32.572849 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:32.572849 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:32.572849 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:32.573721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:32.573721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:32.573721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:32.573721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:32.573721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:32.573721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:32.573721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:32.573721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:32.573721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:32.573721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:32.573721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:50:32.573721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:32.573721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 222/443] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:50:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:32.576570 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a842a80a-2af4-49bc-9853-f53953f4238c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:32.577183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842a80a-2af4-49bc-9853-f53953f4238c None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:32.577463 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842a80a-2af4-49bc-9853-f53953f4238c None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:32.577987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842a80a-2af4-49bc-9853-f53953f4238c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:32.578565 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a842a80a-2af4-49bc-9853-f53953f4238c None admin] RBAC: Adding query filter params (group.id=8d7691de30a04ae395356475cf11338b, role.id=d886d117c82147e6a6488228fee2ac8b, scope.project.id=bdf2d550302d4cafb7d454c50b6794c7) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:32.578825 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc9c47-dea0-4698-9f6c-34f2eff77505 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:32.579426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a842a80a-2af4-49bc-9853-f53953f4238c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:32.580412 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a842a80a-2af4-49bc-9853-f53953f4238c None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:32.587462 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 222/444] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Aug 24 16:50:32 2022] GET /identity/v3/role_assignments?group.id=8d7691de30a04ae395356475cf11338b&scope.project.id=bdf2d550302d4cafb7d454c50b6794c7&role.id=d886d117c82147e6a6488228fee2ac8b => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:32.634408 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a842a80a-2af4-49bc-9853-f53953f4238c None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:32.715563 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc9c47-dea0-4698-9f6c-34f2eff77505 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:32.746625 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:32.757637 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b77a5f-60a3-4c43-a236-e1f63f55a9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:32.758256 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b77a5f-60a3-4c43-a236-e1f63f55a9b7 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:32.758535 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b77a5f-60a3-4c43-a236-e1f63f55a9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:32.767312 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b77a5f-60a3-4c43-a236-e1f63f55a9b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:32.767312 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b77a5f-60a3-4c43-a236-e1f63f55a9b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:32.767312 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b77a5f-60a3-4c43-a236-e1f63f55a9b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:32.767553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:32.767627 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b77a5f-60a3-4c43-a236-e1f63f55a9b7 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:32.767715 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a842a80a-2af4-49bc-9853-f53953f4238c None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:32.773672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 223/445] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:50:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:50:32.780702 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b77a5f-60a3-4c43-a236-e1f63f55a9b7 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:32.804538 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc58f15-293c-4d09-8035-f16b316f4686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:32.805523 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc58f15-293c-4d09-8035-f16b316f4686 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:32.805523 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc58f15-293c-4d09-8035-f16b316f4686 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:32.805676 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc58f15-293c-4d09-8035-f16b316f4686 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:32.824731 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc58f15-293c-4d09-8035-f16b316f4686 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:32.830898 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-6fc58f15-293c-4d09-8035-f16b316f4686 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:50:32.830898 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:32.830898 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:32.830898 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:32.830898 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:32.830898 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:32.830898 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:32.830898 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:32.830898 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:32.830898 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:32.830898 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:32.830898 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:32.830898 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:32.830898 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:32.830898 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:32.830898 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:32.831942 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:32.831942 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:32.831942 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:32.831942 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:32.831942 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:32.831942 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:32.831942 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:32.831942 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:32.831942 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:32.831942 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:32.831942 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:32.831942 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:32.831942 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:32.831942 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:32.831942 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:32.831942 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:32.836021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:32.836021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:32.836021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:32.836021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:32.836021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:32.836021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:32.836021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:32.836021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:32.836021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:32.836021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:32.836021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:50:32.836021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:32.836021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 223/446] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Aug 24 16:50:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:50:32.838853 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc58f15-293c-4d09-8035-f16b316f4686 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:32.916097 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b77a5f-60a3-4c43-a236-e1f63f55a9b7 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:32.958253 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626a415-2d81-4170-9e93-0605ac46c239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:32.959222 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626a415-2d81-4170-9e93-0605ac46c239 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:32.959495 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626a415-2d81-4170-9e93-0605ac46c239 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:32.959761 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626a415-2d81-4170-9e93-0605ac46c239 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:32.988932 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc58f15-293c-4d09-8035-f16b316f4686 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:33.032322 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:33.033960 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27381ed0-919a-4fcc-8329-ab9b9bb61324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:33.034954 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27381ed0-919a-4fcc-8329-ab9b9bb61324 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:33.034954 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27381ed0-919a-4fcc-8329-ab9b9bb61324 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:33.035207 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27381ed0-919a-4fcc-8329-ab9b9bb61324 None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:33.035863 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27381ed0-919a-4fcc-8329-ab9b9bb61324 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:33.036168 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27381ed0-919a-4fcc-8329-ab9b9bb61324 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:33.037568 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27381ed0-919a-4fcc-8329-ab9b9bb61324 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:33.048741 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 224/447] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:50:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:33.054240 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626a415-2d81-4170-9e93-0605ac46c239 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:33.055949 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626a415-2d81-4170-9e93-0605ac46c239 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:33.056654 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27381ed0-919a-4fcc-8329-ab9b9bb61324 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:33.089938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:33.193291 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27381ed0-919a-4fcc-8329-ab9b9bb61324 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:33.201016 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 224/448] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:50:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 16:50:33.202287 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626a415-2d81-4170-9e93-0605ac46c239 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:33.236170 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df539fe2-8e12-4934-8889-4b660b4f7c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:33.238073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df539fe2-8e12-4934-8889-4b660b4f7c19 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:33.238073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df539fe2-8e12-4934-8889-4b660b4f7c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:33.238073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df539fe2-8e12-4934-8889-4b660b4f7c19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:33.321777 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:33.324642 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df539fe2-8e12-4934-8889-4b660b4f7c19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:33.326121 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df539fe2-8e12-4934-8889-4b660b4f7c19 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:33.334050 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626a415-2d81-4170-9e93-0605ac46c239 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:33.349059 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:33.369602 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063ac2f-f8c7-44d8-90d7-998f2906aa03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:33.370243 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063ac2f-f8c7-44d8-90d7-998f2906aa03 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:33.370515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063ac2f-f8c7-44d8-90d7-998f2906aa03 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:33.370784 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063ac2f-f8c7-44d8-90d7-998f2906aa03 None admin] PATH_INFO: `/v3/projects/f322c406251a41cbaa75ad5201783a99` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:33.371948 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063ac2f-f8c7-44d8-90d7-998f2906aa03 None admin] RBAC: Authorizing `identity:get_project(project_id=f322c406251a41cbaa75ad5201783a99)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:33.373396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063ac2f-f8c7-44d8-90d7-998f2906aa03 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:33.375016 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 225/449] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:50:33 2022] GET /identity/v3/projects/f322c406251a41cbaa75ad5201783a99 => generated 344 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:33.380642 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063ac2f-f8c7-44d8-90d7-998f2906aa03 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:33.425774 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 225/450] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:50:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 16:50:33.431539 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df539fe2-8e12-4934-8889-4b660b4f7c19 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:33.480915 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063ac2f-f8c7-44d8-90d7-998f2906aa03 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:33.521563 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d969a-b555-47f3-909e-85f179e72e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:33.522198 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d969a-b555-47f3-909e-85f179e72e51 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:33.522479 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d969a-b555-47f3-909e-85f179e72e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:33.522759 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d969a-b555-47f3-909e-85f179e72e51 None admin] PATH_INFO: `/v3/groups/06a598aa0f9640dd836e99e5f4d53d64` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:33.523915 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d969a-b555-47f3-909e-85f179e72e51 None admin] RBAC: Authorizing `identity:get_group(group_id=06a598aa0f9640dd836e99e5f4d53d64)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:33.525383 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d969a-b555-47f3-909e-85f179e72e51 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:33.527814 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 226/451] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Aug 24 16:50:33 2022] GET /identity/v3/groups/06a598aa0f9640dd836e99e5f4d53d64 => generated 229 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:50:33.531269 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df539fe2-8e12-4934-8889-4b660b4f7c19 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:33.533890 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d969a-b555-47f3-909e-85f179e72e51 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:33.554350 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:33.559994 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:33.575583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af19b1d-69cc-40e0-91cd-aada62ff8594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:33.575583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af19b1d-69cc-40e0-91cd-aada62ff8594 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:33.575583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af19b1d-69cc-40e0-91cd-aada62ff8594 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:33.575583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af19b1d-69cc-40e0-91cd-aada62ff8594 None admin] PATH_INFO: `/v3/projects/9125daf250634e3881ac3ca4ab91d86b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:33.575962 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af19b1d-69cc-40e0-91cd-aada62ff8594 None admin] RBAC: Authorizing `identity:get_project(project_id=9125daf250634e3881ac3ca4ab91d86b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:33.576692 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af19b1d-69cc-40e0-91cd-aada62ff8594 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:33.578309 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 226/452] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:50:33 2022] GET /identity/v3/projects/9125daf250634e3881ac3ca4ab91d86b => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:50:33.583811 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af19b1d-69cc-40e0-91cd-aada62ff8594 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:33.637309 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d969a-b555-47f3-909e-85f179e72e51 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:33.676555 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fb0a1-b9d9-4eeb-8088-3038c34c6631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:33.677166 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fb0a1-b9d9-4eeb-8088-3038c34c6631 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:33.677441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fb0a1-b9d9-4eeb-8088-3038c34c6631 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:33.677770 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520fb0a1-b9d9-4eeb-8088-3038c34c6631 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:33.678637 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520fb0a1-b9d9-4eeb-8088-3038c34c6631 None admin] RBAC: Adding query filter params (group.id=06a598aa0f9640dd836e99e5f4d53d64, role.id=99f0ace9fc4d4d028ca52fa9730cab4b, scope.project.id=f322c406251a41cbaa75ad5201783a99) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:33.678994 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520fb0a1-b9d9-4eeb-8088-3038c34c6631 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:33.680659 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520fb0a1-b9d9-4eeb-8088-3038c34c6631 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:33.687488 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af19b1d-69cc-40e0-91cd-aada62ff8594 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:33.687766 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 227/453] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Aug 24 16:50:33 2022] GET /identity/v3/role_assignments?group.id=06a598aa0f9640dd836e99e5f4d53d64&scope.project.id=f322c406251a41cbaa75ad5201783a99&role.id=99f0ace9fc4d4d028ca52fa9730cab4b => generated 611 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:50:33.731011 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c309f2-2f14-4687-91af-f3195c5f124a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:33.731696 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c309f2-2f14-4687-91af-f3195c5f124a None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:33.731984 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c309f2-2f14-4687-91af-f3195c5f124a None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:33.732254 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c309f2-2f14-4687-91af-f3195c5f124a None admin] PATH_INFO: `/v3/groups/8d7691de30a04ae395356475cf11338b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:33.733476 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c309f2-2f14-4687-91af-f3195c5f124a None admin] RBAC: Authorizing `identity:get_group(group_id=8d7691de30a04ae395356475cf11338b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:33.734970 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c309f2-2f14-4687-91af-f3195c5f124a None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:33.736672 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 227/454] 10.222.0.55 () {56 vars in 1180 bytes} [Wed Aug 24 16:50:33 2022] GET /identity/v3/groups/8d7691de30a04ae395356475cf11338b => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:33.743008 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fb0a1-b9d9-4eeb-8088-3038c34c6631 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:33.838661 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:33.851229 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520fb0a1-b9d9-4eeb-8088-3038c34c6631 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:33.891605 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec6e177-eb30-47a8-9f33-8fe681da2f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:33.892219 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6e177-eb30-47a8-9f33-8fe681da2f39 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:33.892499 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6e177-eb30-47a8-9f33-8fe681da2f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:33.892770 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec6e177-eb30-47a8-9f33-8fe681da2f39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:33.893497 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec6e177-eb30-47a8-9f33-8fe681da2f39 None admin] RBAC: Adding query filter params (group.id=8d7691de30a04ae395356475cf11338b, role.id=1c6cc7bf29b146b0a9aaf6a07607258a, scope.project.id=9125daf250634e3881ac3ca4ab91d86b) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:33.893809 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec6e177-eb30-47a8-9f33-8fe681da2f39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:33.895306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec6e177-eb30-47a8-9f33-8fe681da2f39 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:33.901838 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 228/455] 10.222.0.55 () {56 vars in 1376 bytes} [Wed Aug 24 16:50:33 2022] GET /identity/v3/role_assignments?group.id=8d7691de30a04ae395356475cf11338b&scope.project.id=9125daf250634e3881ac3ca4ab91d86b&role.id=1c6cc7bf29b146b0a9aaf6a07607258a => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:36.477901 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb164954-c6df-41c8-93c9-f6e2eb8c0980 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:36.479828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb164954-c6df-41c8-93c9-f6e2eb8c0980 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:36.480499 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb164954-c6df-41c8-93c9-f6e2eb8c0980 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:36.483630 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 228/456] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:36.491805 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f632ce-924b-4182-a3e3-e06a34e41daf None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:36.492508 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f632ce-924b-4182-a3e3-e06a34e41daf None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:36.492508 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f632ce-924b-4182-a3e3-e06a34e41daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:36.520125 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-a8f632ce-924b-4182-a3e3-e06a34e41daf None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:36.521346 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-a8f632ce-924b-4182-a3e3-e06a34e41daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:36.596058 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82549b58-5d7a-4774-b3a9-986ca70ced1d None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:36.596982 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82549b58-5d7a-4774-b3a9-986ca70ced1d None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:36.597780 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82549b58-5d7a-4774-b3a9-986ca70ced1d None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:36.601163 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 229/457] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:36.610793 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aed4d0-6e73-4e8b-9ccf-673c1f2d8d52 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:36.611683 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aed4d0-6e73-4e8b-9ccf-673c1f2d8d52 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:36.612433 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aed4d0-6e73-4e8b-9ccf-673c1f2d8d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:36.619160 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 229/458] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:36.654275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-28aed4d0-6e73-4e8b-9ccf-673c1f2d8d52 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:36.656777 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-28aed4d0-6e73-4e8b-9ccf-673c1f2d8d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:36.760624 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:36.778375 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 230/459] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:50:36.899123 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f83682-c839-4ffc-b4aa-0711b6a57d7e None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:36.899507 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f83682-c839-4ffc-b4aa-0711b6a57d7e None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:36.899681 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f83682-c839-4ffc-b4aa-0711b6a57d7e None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:36.901749 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 230/460] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:50:36.912409 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f7253-65e4-463e-9634-d4de239fa722 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:36.913186 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f7253-65e4-463e-9634-d4de239fa722 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:36.913919 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f7253-65e4-463e-9634-d4de239fa722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:36.949044 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-669f7253-65e4-463e-9634-d4de239fa722 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:36.951813 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-669f7253-65e4-463e-9634-d4de239fa722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:37.070420 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 231/461] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:37.163708 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f83682-c839-4ffc-b4aa-0711b6a57d7e None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:37.196102 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f7253-65e4-463e-9634-d4de239fa722 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:37.335640 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:37.374738 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f83682-c839-4ffc-b4aa-0711b6a57d7e None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:37.480442 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc22f3-2402-4d97-9822-d9a0224e2d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:37.481408 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc22f3-2402-4d97-9822-d9a0224e2d7a None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:37.481408 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc22f3-2402-4d97-9822-d9a0224e2d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:37.481689 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc22f3-2402-4d97-9822-d9a0224e2d7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:37.495979 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f7253-65e4-463e-9634-d4de239fa722 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:37.508217 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc22f3-2402-4d97-9822-d9a0224e2d7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:37.509929 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc22f3-2402-4d97-9822-d9a0224e2d7a None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:37.528971 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:37.542355 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-b2bc22f3-2402-4d97-9822-d9a0224e2d7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:37.542355 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:37.542355 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:37.542355 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:37.542355 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:37.542355 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:37.542355 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:37.542355 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:37.542355 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:37.542355 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:37.542355 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:37.542355 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:37.542355 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:50:37.542355 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:50:37.542355 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:50:37.542355 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:50:37.549238 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:37.549238 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:37.549238 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:37.549238 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:37.549238 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:37.549238 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:37.549238 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:37.549238 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:37.549238 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:37.549238 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:37.549238 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:37.549238 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:37.549238 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:37.549238 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:37.549238 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:37.549238 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:37.549238 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:50:37.550119 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:50:37.550119 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:37.550119 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:37.550119 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 231/462] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:37.550119 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e35266-5bfe-41cc-9277-c34930345d45 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:37.550119 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e35266-5bfe-41cc-9277-c34930345d45 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:37.550119 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e35266-5bfe-41cc-9277-c34930345d45 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:37.550119 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 232/463] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:37.553513 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39dfc4-d64b-4a6b-993c-c53a33ac3134 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:37.553797 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39dfc4-d64b-4a6b-993c-c53a33ac3134 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:37.554223 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f39dfc4-d64b-4a6b-993c-c53a33ac3134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:37.557380 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f354e-2953-4653-affc-a661300e8ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:37.558225 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f354e-2953-4653-affc-a661300e8ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:37.558647 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f354e-2953-4653-affc-a661300e8ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:37.559101 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f354e-2953-4653-affc-a661300e8ee3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:37.571386 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f354e-2953-4653-affc-a661300e8ee3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:37.574733 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f354e-2953-4653-affc-a661300e8ee3 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:37.581473 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-4f39dfc4-d64b-4a6b-993c-c53a33ac3134 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:37.582785 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-4f39dfc4-d64b-4a6b-993c-c53a33ac3134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:37.592162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-fc0f354e-2953-4653-affc-a661300e8ee3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:37.592162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:37.592162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:37.592162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:37.592162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:37.592162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:37.592162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:37.592162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:37.592162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:37.592162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:37.592162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:37.592162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:37.592162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:50:37.592162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:50:37.592162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:50:37.592162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:50:37.593109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:37.593109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:37.593109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:37.593109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:37.593109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:37.593109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:37.593109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:37.593109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:37.593109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:37.593109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:37.593109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:37.593109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:37.593109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:37.593109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:37.593109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:37.593109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:37.593109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:50:37.594040 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:50:37.594040 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:37.594040 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:37.596416 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 232/464] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:37.597448 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f354e-2953-4653-affc-a661300e8ee3 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:37.666970 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 233/465] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:37.668722 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39dfc4-d64b-4a6b-993c-c53a33ac3134 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:37.713480 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f354e-2953-4653-affc-a661300e8ee3 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:37.751349 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:37.753098 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d89513-7f53-4571-94fc-aef932e3d83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:37.753819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d89513-7f53-4571-94fc-aef932e3d83e None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:37.754203 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d89513-7f53-4571-94fc-aef932e3d83e None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:37.754600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d89513-7f53-4571-94fc-aef932e3d83e None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:37.755387 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d89513-7f53-4571-94fc-aef932e3d83e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:37.755794 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d89513-7f53-4571-94fc-aef932e3d83e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:37.757371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d89513-7f53-4571-94fc-aef932e3d83e None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:37.776669 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 233/466] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:37.778329 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d89513-7f53-4571-94fc-aef932e3d83e None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:37.814674 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f39dfc4-d64b-4a6b-993c-c53a33ac3134 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:37.817535 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:37.861986 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb528c-ccdd-41fb-beef-54363354b509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:37.862838 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb528c-ccdd-41fb-beef-54363354b509 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:37.863333 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb528c-ccdd-41fb-beef-54363354b509 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:37.863770 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbb528c-ccdd-41fb-beef-54363354b509 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:37.877511 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb528c-ccdd-41fb-beef-54363354b509 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:37.879436 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbb528c-ccdd-41fb-beef-54363354b509 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:37.899501 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-5dbb528c-ccdd-41fb-beef-54363354b509 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:37.899501 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:37.899501 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:37.899501 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:37.899501 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:37.899501 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:37.899501 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:37.899501 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:37.899501 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:37.899501 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:37.899501 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:37.899501 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:37.899501 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:50:37.899501 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:50:37.899501 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:50:37.899501 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:50:37.901448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:37.901448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:37.901448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:37.901448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:37.901448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:37.901448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:37.901448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:37.901448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:37.901448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:37.901448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:37.901448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:37.901448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:37.901448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:37.901448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:37.901448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:37.901448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:37.901448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:50:37.902389 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:50:37.902389 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:37.902389 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:37.902389 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 234/467] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:37.902603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb528c-ccdd-41fb-beef-54363354b509 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:37.918177 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d89513-7f53-4571-94fc-aef932e3d83e None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:37.957204 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c62cb1-9882-4551-9285-72d7f17caf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:37.958350 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c62cb1-9882-4551-9285-72d7f17caf6c None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:37.958860 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c62cb1-9882-4551-9285-72d7f17caf6c None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:37.959357 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c62cb1-9882-4551-9285-72d7f17caf6c None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:37.960175 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c62cb1-9882-4551-9285-72d7f17caf6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:37.960756 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c62cb1-9882-4551-9285-72d7f17caf6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:37.964952 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c62cb1-9882-4551-9285-72d7f17caf6c None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:37.982054 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 234/468] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:37.982743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c62cb1-9882-4551-9285-72d7f17caf6c None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:38.045954 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbb528c-ccdd-41fb-beef-54363354b509 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:38.065105 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:38.094448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02720ac-a68d-4af9-a1fb-acfd621c7a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:38.095506 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02720ac-a68d-4af9-a1fb-acfd621c7a05 None admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:38.096065 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02720ac-a68d-4af9-a1fb-acfd621c7a05 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:38.096347 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02720ac-a68d-4af9-a1fb-acfd621c7a05 None admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:38.097003 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02720ac-a68d-4af9-a1fb-acfd621c7a05 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:38.098958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02720ac-a68d-4af9-a1fb-acfd621c7a05 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:38.104511 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:38.114774 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c62cb1-9882-4551-9285-72d7f17caf6c None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:38.152052 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3288c8-35bf-4960-befe-ca127310ea7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:38.152672 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3288c8-35bf-4960-befe-ca127310ea7a None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:38.154099 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3288c8-35bf-4960-befe-ca127310ea7a None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:38.154099 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3288c8-35bf-4960-befe-ca127310ea7a None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:38.154099 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3288c8-35bf-4960-befe-ca127310ea7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:38.154336 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3288c8-35bf-4960-befe-ca127310ea7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:38.155591 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3288c8-35bf-4960-befe-ca127310ea7a None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:38.168227 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 235/469] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:38.169187 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3288c8-35bf-4960-befe-ca127310ea7a None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:38.191201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 235/470] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Aug 24 16:50:37 2022] POST /identity/v3/users => generated 246 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:50:38.192133 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02720ac-a68d-4af9-a1fb-acfd621c7a05 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:38.325885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3288c8-35bf-4960-befe-ca127310ea7a None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:38.359155 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02720ac-a68d-4af9-a1fb-acfd621c7a05 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:38.377691 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de836033-7fb5-45f6-a8fd-6b3d87b4bd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:38.378994 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de836033-7fb5-45f6-a8fd-6b3d87b4bd90 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:38.378994 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de836033-7fb5-45f6-a8fd-6b3d87b4bd90 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:38.379455 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de836033-7fb5-45f6-a8fd-6b3d87b4bd90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:38.399007 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de836033-7fb5-45f6-a8fd-6b3d87b4bd90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:38.401068 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de836033-7fb5-45f6-a8fd-6b3d87b4bd90 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:38.405896 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7680c-ecfe-4872-99b0-939ccee2a41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:38.406526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7680c-ecfe-4872-99b0-939ccee2a41a None admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:38.406802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7680c-ecfe-4872-99b0-939ccee2a41a None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:38.407069 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7680c-ecfe-4872-99b0-939ccee2a41a None admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:38.407750 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7680c-ecfe-4872-99b0-939ccee2a41a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:38.409192 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7680c-ecfe-4872-99b0-939ccee2a41a None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:38.421583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-de836033-7fb5-45f6-a8fd-6b3d87b4bd90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:38.421583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:38.421583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:38.421583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:38.421583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:38.421583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:38.421583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:38.421583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:38.421583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:38.421583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:38.421583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:38.421583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:38.421583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:50:38.421583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:50:38.421583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:50:38.421583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:50:38.422553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:38.422553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:38.422553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:38.422553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:38.422553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:38.422553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:38.422553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:38.422553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:38.422553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:38.422553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:38.422553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:38.422553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:38.422553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:38.422553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:38.422553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:38.422553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:38.422553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:50:38.423463 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:50:38.423463 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:38.423463 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:38.427188 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 236/471] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:38.428027 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de836033-7fb5-45f6-a8fd-6b3d87b4bd90 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:38.430954 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:38.480791 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 236/472] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Aug 24 16:50:38 2022] POST /identity/v3/users => generated 248 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:50:38.482371 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b400958-50d0-4c51-992f-433d9239754c None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:38.482733 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b400958-50d0-4c51-992f-433d9239754c None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:38.483007 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b400958-50d0-4c51-992f-433d9239754c None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:38.484637 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 237/473] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:38.485115 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b400958-50d0-4c51-992f-433d9239754c None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:38.541970 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:38.580253 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de836033-7fb5-45f6-a8fd-6b3d87b4bd90 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:38.624377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a2907-6314-4206-bfd6-090d9ed541c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:38.625170 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a2907-6314-4206-bfd6-090d9ed541c1 None admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:38.625548 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a2907-6314-4206-bfd6-090d9ed541c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:38.625919 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a2907-6314-4206-bfd6-090d9ed541c1 None admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:38.626693 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a2907-6314-4206-bfd6-090d9ed541c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:38.628695 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a2907-6314-4206-bfd6-090d9ed541c1 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:38.651742 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b400958-50d0-4c51-992f-433d9239754c None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:38.692666 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e027663-16ba-4d5e-bceb-80484732965d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:38.693282 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e027663-16ba-4d5e-bceb-80484732965d None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:38.693560 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e027663-16ba-4d5e-bceb-80484732965d None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:38.693827 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e027663-16ba-4d5e-bceb-80484732965d None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:38.694502 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e027663-16ba-4d5e-bceb-80484732965d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:38.694800 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e027663-16ba-4d5e-bceb-80484732965d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:38.696281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e027663-16ba-4d5e-bceb-80484732965d None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:38.709400 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 238/474] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:50:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:38.710744 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bb9bb-2b24-420f-8087-d814cc67ac8c None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:38.711009 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bb9bb-2b24-420f-8087-d814cc67ac8c None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:38.711329 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413bb9bb-2b24-420f-8087-d814cc67ac8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:38.726930 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 237/475] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Aug 24 16:50:38 2022] POST /identity/v3/users => generated 248 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:50:38.728400 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a2907-6314-4206-bfd6-090d9ed541c1 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:38.734006 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-413bb9bb-2b24-420f-8087-d814cc67ac8c None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:38.739250 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-413bb9bb-2b24-420f-8087-d814cc67ac8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:38.822562 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:38.863507 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 239/476] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:38.903848 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a2907-6314-4206-bfd6-090d9ed541c1 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:38.943944 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344c29e-0236-4898-8f5e-115fb1014083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:38.944551 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344c29e-0236-4898-8f5e-115fb1014083 None admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:38.944826 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344c29e-0236-4898-8f5e-115fb1014083 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:38.945094 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344c29e-0236-4898-8f5e-115fb1014083 None admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:38.945730 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7344c29e-0236-4898-8f5e-115fb1014083 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:38.947899 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7344c29e-0236-4898-8f5e-115fb1014083 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:39.013749 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 238/477] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Aug 24 16:50:38 2022] POST /identity/v3/users => generated 249 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:50:39.188889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bb9bb-2b24-420f-8087-d814cc67ac8c None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:39.208263 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:39.299256 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413bb9bb-2b24-420f-8087-d814cc67ac8c None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:39.336625 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80c1af-a6bb-4425-b386-9bade7e89dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:39.337246 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80c1af-a6bb-4425-b386-9bade7e89dbf None admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:39.337553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80c1af-a6bb-4425-b386-9bade7e89dbf None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:39.337822 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a80c1af-a6bb-4425-b386-9bade7e89dbf None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:39.338503 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80c1af-a6bb-4425-b386-9bade7e89dbf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:39.339891 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a80c1af-a6bb-4425-b386-9bade7e89dbf None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:39.377548 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.sql.core [None req-7a80c1af-a6bb-4425-b386-9bade7e89dbf None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 16:50:39.377548 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 16:50:39.377548 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [parameters: {'id': '8f5d6e28900b4207834e9a48f8b2c0a4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 16:50:39.377548 dv-cinder-779578-5-smb devstack@keystone.service[81761]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81761) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 16:50:39.396534 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-7a80c1af-a6bb-4425-b386-9bade7e89dbf None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 16:50:39.396534 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:39.396534 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 16:50:39.396534 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 16:50:39.396534 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 16:50:39.396534 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 16:50:39.396534 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 16:50:39.396534 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 16:50:39.396534 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 16:50:39.396534 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application conn.query(q) Aug 24 16:50:39.396534 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 16:50:39.396534 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 16:50:39.396534 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 16:50:39.396534 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application result.read() Aug 24 16:50:39.396534 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 16:50:39.397418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 16:50:39.397418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 16:50:39.397418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 16:50:39.397418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 16:50:39.397418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 16:50:39.397418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 16:50:39.397418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 16:50:39.397418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 16:50:39.397418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:39.397418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 16:50:39.397418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:39.397418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:39.397418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 16:50:39.397418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 16:50:39.397418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 16:50:39.397418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 16:50:39.397418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 16:50:39.397418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application next(self.gen) Aug 24 16:50:39.398304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 16:50:39.398304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application yield resource Aug 24 16:50:39.398304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 16:50:39.398304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application next(self.gen) Aug 24 16:50:39.398304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 16:50:39.398304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 16:50:39.398304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 16:50:39.398304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 16:50:39.398304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 16:50:39.398304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise self.value Aug 24 16:50:39.398304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 16:50:39.398304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 16:50:39.398304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 16:50:39.398304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application session.commit() Aug 24 16:50:39.398304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 16:50:39.398304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 16:50:39.398304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 16:50:39.399533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 16:50:39.399533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 16:50:39.399533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self.session.flush() Aug 24 16:50:39.399533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 16:50:39.399533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 16:50:39.399533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 16:50:39.399533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 16:50:39.399533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 16:50:39.399533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application compat.raise_( Aug 24 16:50:39.399533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 16:50:39.399533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception Aug 24 16:50:39.399533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 16:50:39.399533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 16:50:39.399533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 16:50:39.399533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 16:50:39.399533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 16:50:39.399533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 16:50:39.401514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 16:50:39.401514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 16:50:39.401514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 16:50:39.401514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 16:50:39.401514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 16:50:39.401514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 16:50:39.401514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 16:50:39.401514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 16:50:39.401514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 16:50:39.401514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 16:50:39.401514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 16:50:39.401514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 16:50:39.401514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 16:50:39.401514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 16:50:39.401514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 16:50:39.401514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception Aug 24 16:50:39.403725 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 16:50:39.403725 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 16:50:39.403725 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 16:50:39.403725 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 16:50:39.403725 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 16:50:39.403725 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 16:50:39.403725 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 16:50:39.403725 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application conn.query(q) Aug 24 16:50:39.403725 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 16:50:39.403725 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 16:50:39.403725 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 16:50:39.403725 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application result.read() Aug 24 16:50:39.403725 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 16:50:39.403725 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 16:50:39.403725 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 16:50:39.403725 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 16:50:39.405662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 16:50:39.405662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 16:50:39.405662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 16:50:39.405662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 16:50:39.405662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 16:50:39.405662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 16:50:39.405662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [parameters: {'id': '8f5d6e28900b4207834e9a48f8b2c0a4', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 16:50:39.405662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 16:50:39.405662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:39.405662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:50:39.405662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:39.405662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:39.405662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:39.405662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:39.405662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:39.405662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:39.407662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:39.407662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:39.407662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:39.407662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:39.407662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:39.407662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:39.407662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 16:50:39.407662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 16:50:39.407662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:39.407662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:39.407662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 16:50:39.407662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 16:50:39.407662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 16:50:39.407662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 16:50:39.407662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 16:50:39.407662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:39.412099 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 240/478] 10.222.0.55 () {60 vars in 1131 bytes} [Wed Aug 24 16:50:39 2022] POST /identity/v3/roles => generated 144 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:39.412289 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344c29e-0236-4898-8f5e-115fb1014083 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:39.528603 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344c29e-0236-4898-8f5e-115fb1014083 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:39.543646 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:39.564717 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a90109-749e-419d-b929-d0d72ad9d0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:39.565349 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a90109-749e-419d-b929-d0d72ad9d0ff None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:39.565625 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a90109-749e-419d-b929-d0d72ad9d0ff None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:39.565893 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a90109-749e-419d-b929-d0d72ad9d0ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:39.579257 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a90109-749e-419d-b929-d0d72ad9d0ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:39.584268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-38a90109-749e-419d-b929-d0d72ad9d0ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:50:39.584268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:39.584268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:39.584268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:39.584268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:39.584268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:39.584268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:39.584268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:39.584268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:39.584268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:39.584268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:39.584268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:39.584268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:39.584268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:39.584268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:39.584268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:39.585599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:39.585599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:39.585599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:39.585599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:39.585599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:39.585599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:39.585599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:39.585599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:39.585599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:39.585599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:39.585599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:39.585599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:39.585599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:39.585599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:39.585599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:39.585599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:39.586382 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:39.586382 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:39.586382 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:39.586382 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:39.586382 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:39.586382 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:39.586382 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:39.586382 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:39.586382 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:39.586382 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:39.586382 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 16:50:39.586382 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:39.589937 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 239/479] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Aug 24 16:50:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:39.596418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80c1af-a6bb-4425-b386-9bade7e89dbf None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:39.712660 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:39.731864 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a80c1af-a6bb-4425-b386-9bade7e89dbf None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:39.786560 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97563e-d5a7-44c0-acc4-b8448ee50595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:39.787543 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97563e-d5a7-44c0-acc4-b8448ee50595 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:39.788021 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97563e-d5a7-44c0-acc4-b8448ee50595 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:39.788488 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97563e-d5a7-44c0-acc4-b8448ee50595 None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:39.789374 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97563e-d5a7-44c0-acc4-b8448ee50595 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:39.789870 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97563e-d5a7-44c0-acc4-b8448ee50595 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:39.791755 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97563e-d5a7-44c0-acc4-b8448ee50595 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:39.807251 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 241/480] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:50:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:40.583953 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c99bc-7ad2-4a87-9bd3-c9e4b71c96d0 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:40.584350 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c99bc-7ad2-4a87-9bd3-c9e4b71c96d0 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:40.584905 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c99bc-7ad2-4a87-9bd3-c9e4b71c96d0 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:40.586179 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 240/481] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:40.596987 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b50d7-766c-4980-acea-b0db166ba4a2 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:40.597495 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b50d7-766c-4980-acea-b0db166ba4a2 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:40.597592 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b50d7-766c-4980-acea-b0db166ba4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:40.624147 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-221b50d7-766c-4980-acea-b0db166ba4a2 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:40.625357 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-221b50d7-766c-4980-acea-b0db166ba4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:40.697735 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 242/482] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:40.732390 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37bae9-4ed6-4d29-b8e8-9198ee29f99b None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:40.732660 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37bae9-4ed6-4d29-b8e8-9198ee29f99b None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:40.732927 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37bae9-4ed6-4d29-b8e8-9198ee29f99b None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:40.734490 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 241/483] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:40.739752 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812efef4-363b-4c0a-a928-b37dad613646 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:40.740206 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812efef4-363b-4c0a-a928-b37dad613646 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:40.740623 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812efef4-363b-4c0a-a928-b37dad613646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:40.759929 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-812efef4-363b-4c0a-a928-b37dad613646 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:40.761449 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-812efef4-363b-4c0a-a928-b37dad613646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:40.839298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 243/484] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:41.131523 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37bae9-4ed6-4d29-b8e8-9198ee29f99b None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:41.161018 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812efef4-363b-4c0a-a928-b37dad613646 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:41.168300 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:41.281576 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37bae9-4ed6-4d29-b8e8-9198ee29f99b None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:41.306594 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812efef4-363b-4c0a-a928-b37dad613646 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:41.327756 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f22c9-a42a-4c00-adaa-68ded7b7e7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:41.328386 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f22c9-a42a-4c00-adaa-68ded7b7e7f7 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:41.329177 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f22c9-a42a-4c00-adaa-68ded7b7e7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:41.329450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f22c9-a42a-4c00-adaa-68ded7b7e7f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:41.343642 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136f22c9-a42a-4c00-adaa-68ded7b7e7f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:41.344322 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b354312-4330-4cca-a616-92653455d475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:41.345014 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b354312-4330-4cca-a616-92653455d475 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:41.345293 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b354312-4330-4cca-a616-92653455d475 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:41.345568 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b354312-4330-4cca-a616-92653455d475 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:41.349450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-136f22c9-a42a-4c00-adaa-68ded7b7e7f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:50:41.349450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:41.349450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:41.349450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:41.349450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:41.349450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:41.349450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:41.349450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:41.349450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:41.349450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:41.349450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:41.349450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:41.349450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:41.349450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:41.349450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:41.349450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:41.350325 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:41.350325 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:41.350325 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:41.350325 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:41.350325 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:41.350325 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:41.350325 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:41.350325 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:41.350325 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:41.350325 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:41.350325 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:41.350325 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:41.350325 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:41.350325 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:41.350325 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:41.350325 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:41.351743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:41.351743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:41.351743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:41.351743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:41.351743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:41.351743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:41.351743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:41.351743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:41.351743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:41.351743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:41.351743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:50:41.351743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:41.351743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 242/485] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Aug 24 16:50:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:41.352414 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a7672-25e3-4644-a6f5-d786b3db2459 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:41.352821 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a7672-25e3-4644-a6f5-d786b3db2459 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:41.352821 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a7672-25e3-4644-a6f5-d786b3db2459 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:41.355977 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 243/486] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:41.360398 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a7672-25e3-4644-a6f5-d786b3db2459 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:41.362293 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b354312-4330-4cca-a616-92653455d475 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:41.367332 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-4b354312-4330-4cca-a616-92653455d475 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:50:41.367332 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:41.367332 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:41.367332 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:41.367332 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:41.367332 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:41.367332 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:41.367332 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:41.367332 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:41.367332 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:41.367332 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:41.367332 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:41.367332 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:41.367332 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:41.367332 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:41.367332 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:41.369290 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:41.369290 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:41.369290 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:41.369290 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:41.369290 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:41.369290 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:41.369290 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:41.369290 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:41.369290 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:41.369290 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:41.369290 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:41.369290 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:41.369290 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:41.369290 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:41.369290 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:41.369290 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:41.371239 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:41.371239 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:41.371239 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:41.371239 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:41.371239 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:41.371239 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:41.371239 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:41.371239 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:41.371239 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:41.371239 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:41.371239 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:50:41.371239 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:41.378681 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 244/487] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Aug 24 16:50:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:41.378681 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42340e3-41b4-4363-ab93-5f6d9b21b647 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:41.378681 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42340e3-41b4-4363-ab93-5f6d9b21b647 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:41.378681 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42340e3-41b4-4363-ab93-5f6d9b21b647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:41.393984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-e42340e3-41b4-4363-ab93-5f6d9b21b647 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:41.395283 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-e42340e3-41b4-4363-ab93-5f6d9b21b647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:41.405446 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:41.467767 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:41.483489 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 245/488] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:41.484550 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42340e3-41b4-4363-ab93-5f6d9b21b647 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:41.486423 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a7672-25e3-4644-a6f5-d786b3db2459 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:41.532231 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2aeee2-c247-4f9d-8c51-f2b225bf7e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:41.533082 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2aeee2-c247-4f9d-8c51-f2b225bf7e49 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:41.533366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2aeee2-c247-4f9d-8c51-f2b225bf7e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:41.534046 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2aeee2-c247-4f9d-8c51-f2b225bf7e49 None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:41.534985 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2aeee2-c247-4f9d-8c51-f2b225bf7e49 None admin] RBAC: Adding query filter params (name=service) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:41.535309 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2aeee2-c247-4f9d-8c51-f2b225bf7e49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:41.537383 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2aeee2-c247-4f9d-8c51-f2b225bf7e49 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:41.549291 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 244/489] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Aug 24 16:50:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:41.550610 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4351a-37c0-4925-b16d-649f89cde8f3 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:41.550888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4351a-37c0-4925-b16d-649f89cde8f3 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:41.551177 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4351a-37c0-4925-b16d-649f89cde8f3 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:41.552616 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 245/490] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:41.554034 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4351a-37c0-4925-b16d-649f89cde8f3 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:41.631230 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42340e3-41b4-4363-ab93-5f6d9b21b647 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:41.669441 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:41.671305 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d144a155-ccf6-4044-82f6-35ac85b8276e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:41.671923 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144a155-ccf6-4044-82f6-35ac85b8276e None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:41.672197 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144a155-ccf6-4044-82f6-35ac85b8276e None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:41.672464 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d144a155-ccf6-4044-82f6-35ac85b8276e None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:41.673130 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144a155-ccf6-4044-82f6-35ac85b8276e None admin] RBAC: Adding query filter params (name=service) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:41.673426 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144a155-ccf6-4044-82f6-35ac85b8276e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:41.674790 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d144a155-ccf6-4044-82f6-35ac85b8276e None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:41.676560 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4351a-37c0-4925-b16d-649f89cde8f3 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:41.684031 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 246/491] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Aug 24 16:50:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:41.685591 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9db84-6018-4871-9173-bab2676a8840 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:41.685711 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9db84-6018-4871-9173-bab2676a8840 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:41.685952 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9db84-6018-4871-9173-bab2676a8840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:41.707092 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-bbc9db84-6018-4871-9173-bab2676a8840 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:41.708403 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-bbc9db84-6018-4871-9173-bab2676a8840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:41.719449 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffed67f-1f94-450e-ac8c-4cbc3b38e0e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:41.720389 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffed67f-1f94-450e-ac8c-4cbc3b38e0e3 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:41.720836 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffed67f-1f94-450e-ac8c-4cbc3b38e0e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:41.721286 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffed67f-1f94-450e-ac8c-4cbc3b38e0e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:41.733164 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffed67f-1f94-450e-ac8c-4cbc3b38e0e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:41.735035 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffed67f-1f94-450e-ac8c-4cbc3b38e0e3 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:41.751683 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-8ffed67f-1f94-450e-ac8c-4cbc3b38e0e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:41.751683 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:41.751683 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:41.751683 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:41.751683 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:41.751683 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:41.751683 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:41.751683 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:41.751683 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:41.751683 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:41.751683 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:41.751683 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:41.751683 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:50:41.751683 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:50:41.751683 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:50:41.751683 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:50:41.752805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:41.752805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:41.752805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:41.752805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:41.752805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:41.752805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:41.752805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:41.752805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:41.752805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:41.752805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:41.752805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:41.752805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:41.752805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:41.752805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:41.752805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:41.752805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:41.752805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:50:41.753808 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:50:41.753808 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:41.753808 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:41.760962 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 246/492] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:50:41.762160 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffed67f-1f94-450e-ac8c-4cbc3b38e0e3 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:41.764890 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:41.783271 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 247/493] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:41.792020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9db84-6018-4871-9173-bab2676a8840 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:41.887822 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffed67f-1f94-450e-ac8c-4cbc3b38e0e3 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:41.916981 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9db84-6018-4871-9173-bab2676a8840 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:41.936580 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52f93e-a4b4-428a-bc0e-8e1db67158bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:41.937513 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52f93e-a4b4-428a-bc0e-8e1db67158bb None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:41.937939 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52f93e-a4b4-428a-bc0e-8e1db67158bb None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:41.938605 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52f93e-a4b4-428a-bc0e-8e1db67158bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:41.954891 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f9689-a89d-4873-bf7d-b8556daf5a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:41.955308 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52f93e-a4b4-428a-bc0e-8e1db67158bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:41.955762 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f9689-a89d-4873-bf7d-b8556daf5a42 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:41.956138 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f9689-a89d-4873-bf7d-b8556daf5a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:41.956513 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5f9689-a89d-4873-bf7d-b8556daf5a42 None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:41.957259 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f9689-a89d-4873-bf7d-b8556daf5a42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:41.957651 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f9689-a89d-4873-bf7d-b8556daf5a42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:41.957829 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a52f93e-a4b4-428a-bc0e-8e1db67158bb None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:41.959236 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5f9689-a89d-4873-bf7d-b8556daf5a42 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:41.969450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:41.977217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-4a52f93e-a4b4-428a-bc0e-8e1db67158bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:41.977217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:41.977217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:41.977217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:41.977217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:41.977217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:41.977217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:41.977217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:41.977217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:41.977217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:41.977217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:41.977217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:41.977217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:50:41.977217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:50:41.977217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:50:41.977217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:50:41.978401 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:41.978401 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:41.978401 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:41.978401 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:41.978401 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:41.978401 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:41.978401 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:41.978401 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:41.978401 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:41.978401 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:41.978401 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:41.978401 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:41.978401 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:41.978401 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:41.978401 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:41.978401 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:41.978401 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:50:41.979524 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:50:41.979524 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:41.979524 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:41.979740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 248/494] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:41.980492 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f9689-a89d-4873-bf7d-b8556daf5a42 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:41.986364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 247/495] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:41.988458 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52f93e-a4b4-428a-bc0e-8e1db67158bb None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:42.037071 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:42.102557 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5f9689-a89d-4873-bf7d-b8556daf5a42 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:42.115878 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52f93e-a4b4-428a-bc0e-8e1db67158bb None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:42.143382 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd93ec-fe92-4af3-95c9-fd55ab36372e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:42.144031 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd93ec-fe92-4af3-95c9-fd55ab36372e None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:42.144309 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd93ec-fe92-4af3-95c9-fd55ab36372e None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:42.144588 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd93ec-fe92-4af3-95c9-fd55ab36372e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:42.151322 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724558ae-c61e-4ddf-b5f2-25c8665f3396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:42.151956 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724558ae-c61e-4ddf-b5f2-25c8665f3396 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:42.152242 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724558ae-c61e-4ddf-b5f2-25c8665f3396 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:42.152520 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724558ae-c61e-4ddf-b5f2-25c8665f3396 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:42.156467 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd93ec-fe92-4af3-95c9-fd55ab36372e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:42.160537 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724558ae-c61e-4ddf-b5f2-25c8665f3396 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:42.161997 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724558ae-c61e-4ddf-b5f2-25c8665f3396 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:42.162811 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-59bd93ec-fe92-4af3-95c9-fd55ab36372e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:50:42.162811 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:42.162811 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:42.162811 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:42.162811 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:42.162811 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:42.162811 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:42.162811 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:42.162811 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:42.162811 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:42.162811 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:42.162811 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:42.162811 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:42.162811 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:42.162811 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:42.162811 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:42.163884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:42.163884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:42.163884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:42.163884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:42.163884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:42.163884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:42.163884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:42.163884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:42.163884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:42.163884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:42.163884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:42.163884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:42.163884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:42.163884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:42.163884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:42.163884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:42.164884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:42.164884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:42.164884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:42.164884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:42.164884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:42.164884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:42.164884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:42.164884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:42.164884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:42.164884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:42.164884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:50:42.164884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:42.167335 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 249/496] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Aug 24 16:50:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:42.168360 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd93ec-fe92-4af3-95c9-fd55ab36372e None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:42.175885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-724558ae-c61e-4ddf-b5f2-25c8665f3396 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:50:42.175885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:42.175885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:42.175885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:42.175885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:42.175885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:42.175885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:42.175885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:42.175885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:42.175885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:42.175885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:42.175885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:42.175885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:50:42.175885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:50:42.175885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:50:42.175885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:50:42.177000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:42.177000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:42.177000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:50:42.177000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:50:42.177000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:50:42.177000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:50:42.177000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:42.177000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:42.177000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:42.177000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:42.177000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:42.177000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:42.177000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:42.177000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:42.177000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:42.177000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:42.177000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:42.177000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:42.177928 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:42.177928 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:42.177928 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:50:42.177928 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:50:42.177928 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:50:42.177928 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:50:42.177928 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:50:42.177928 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:50:42.177928 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:50:42.177928 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:42.177928 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 248/497] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Aug 24 16:50:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:42.178491 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724558ae-c61e-4ddf-b5f2-25c8665f3396 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:42.242450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:42.284833 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724558ae-c61e-4ddf-b5f2-25c8665f3396 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:42.285696 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd93ec-fe92-4af3-95c9-fd55ab36372e None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:42.294689 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:42.327083 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fcb872-26b6-4612-9771-1a954c90e9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:42.327308 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee4baf-c03f-410e-a6a3-bbd79ea42ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:42.327738 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcb872-26b6-4612-9771-1a954c90e9d6 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:42.327838 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee4baf-c03f-410e-a6a3-bbd79ea42ab1 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:42.328019 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcb872-26b6-4612-9771-1a954c90e9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:42.328111 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee4baf-c03f-410e-a6a3-bbd79ea42ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:42.328293 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fcb872-26b6-4612-9771-1a954c90e9d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:42.328399 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee4baf-c03f-410e-a6a3-bbd79ea42ab1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:42.328941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fcb872-26b6-4612-9771-1a954c90e9d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:42.329246 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fcb872-26b6-4612-9771-1a954c90e9d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:42.330662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fcb872-26b6-4612-9771-1a954c90e9d6 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:42.339934 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee4baf-c03f-410e-a6a3-bbd79ea42ab1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:42.348065 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 250/498] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:42.348065 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fcb872-26b6-4612-9771-1a954c90e9d6 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:42.348276 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-2aee4baf-c03f-410e-a6a3-bbd79ea42ab1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:50:42.348276 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:42.348276 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:42.348276 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:42.348276 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:42.348276 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:42.348276 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:42.348276 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:42.348276 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:42.348276 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:42.348276 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:42.348276 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:42.348276 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:42.348276 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:42.348276 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:42.348276 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:42.349108 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:42.349108 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:42.349108 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:42.349108 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:42.349108 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:42.349108 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:42.349108 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:42.349108 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:42.349108 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:42.349108 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:42.349108 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:42.349108 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:42.349108 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:42.349108 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:42.349108 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:42.349108 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:42.349956 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:42.349956 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:42.349956 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:42.349956 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:42.349956 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:42.349956 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:42.349956 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:42.349956 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:42.349956 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:42.349956 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:42.349956 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:50:42.349956 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:42.349956 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 249/499] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Aug 24 16:50:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:42.349956 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee4baf-c03f-410e-a6a3-bbd79ea42ab1 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:42.454993 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fcb872-26b6-4612-9771-1a954c90e9d6 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:42.456586 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee4baf-c03f-410e-a6a3-bbd79ea42ab1 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:42.478267 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:42.490857 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a2ebd-98f8-455f-adad-e27b08e2b084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:42.491567 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a2ebd-98f8-455f-adad-e27b08e2b084 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:42.491870 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a2ebd-98f8-455f-adad-e27b08e2b084 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:42.492149 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a2ebd-98f8-455f-adad-e27b08e2b084 None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:42.492865 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a2ebd-98f8-455f-adad-e27b08e2b084 None admin] RBAC: Adding query filter params (name=service) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:42.493023 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27805fc7-1f3a-4152-98d8-0ec0db0dff0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:42.493161 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a2ebd-98f8-455f-adad-e27b08e2b084 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:42.493771 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27805fc7-1f3a-4152-98d8-0ec0db0dff0c None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:42.494343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27805fc7-1f3a-4152-98d8-0ec0db0dff0c None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:42.494617 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a2ebd-98f8-455f-adad-e27b08e2b084 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:42.494745 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27805fc7-1f3a-4152-98d8-0ec0db0dff0c None admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:42.495568 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27805fc7-1f3a-4152-98d8-0ec0db0dff0c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:42.496108 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27805fc7-1f3a-4152-98d8-0ec0db0dff0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:42.497739 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27805fc7-1f3a-4152-98d8-0ec0db0dff0c None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:42.507839 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 251/500] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Aug 24 16:50:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:42.507839 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a2ebd-98f8-455f-adad-e27b08e2b084 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:42.538092 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 250/501] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Aug 24 16:50:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:42.538092 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27805fc7-1f3a-4152-98d8-0ec0db0dff0c None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:42.543434 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:42.617370 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a2ebd-98f8-455f-adad-e27b08e2b084 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:42.645041 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27805fc7-1f3a-4152-98d8-0ec0db0dff0c None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:42.652763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387a518-407b-4c3d-adfc-685c8924879d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:42.653401 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387a518-407b-4c3d-adfc-685c8924879d None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:42.653683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387a518-407b-4c3d-adfc-685c8924879d None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:42.653954 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387a518-407b-4c3d-adfc-685c8924879d None admin] PATH_INFO: `/v3/users/glance` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:42.661162 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387a518-407b-4c3d-adfc-685c8924879d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:42.662624 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c387a518-407b-4c3d-adfc-685c8924879d None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:42.675350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-c387a518-407b-4c3d-adfc-685c8924879d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 16:50:42.675350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:42.675350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:42.675350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:42.675350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:42.675350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:42.675350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:42.675350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:42.675350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:42.675350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:42.675350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:42.675350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:42.675350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:50:42.675350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:50:42.675350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:50:42.675350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:50:42.676271 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:42.676271 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:42.676271 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:50:42.676271 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:50:42.676271 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:50:42.676271 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:50:42.676271 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:42.676271 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:42.676271 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:42.676271 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:42.676271 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:42.676271 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:42.676271 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:42.676271 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:42.676271 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:42.676271 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:42.676271 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:42.676271 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:42.682417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:42.682417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:42.682417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:50:42.682417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:50:42.682417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:50:42.682417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:50:42.682417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:50:42.682417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:50:42.682417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 16:50:42.682417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:42.682417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 252/502] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:50:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:42.683089 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239ca59-f3ba-4e6f-a372-98ad98c5fd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:42.683560 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387a518-407b-4c3d-adfc-685c8924879d None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:42.683645 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239ca59-f3ba-4e6f-a372-98ad98c5fd47 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:42.683645 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239ca59-f3ba-4e6f-a372-98ad98c5fd47 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:42.683645 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239ca59-f3ba-4e6f-a372-98ad98c5fd47 None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:42.683645 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239ca59-f3ba-4e6f-a372-98ad98c5fd47 None admin] RBAC: Adding query filter params (name=service) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:42.683645 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239ca59-f3ba-4e6f-a372-98ad98c5fd47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:42.683645 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239ca59-f3ba-4e6f-a372-98ad98c5fd47 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:42.691547 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 251/503] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Aug 24 16:50:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:42.692231 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239ca59-f3ba-4e6f-a372-98ad98c5fd47 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:42.732750 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:42.772875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:42.784748 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c387a518-407b-4c3d-adfc-685c8924879d None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:42.788384 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239ca59-f3ba-4e6f-a372-98ad98c5fd47 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:42.820022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e7ac3-2004-444c-bf57-a93b306c30b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:42.820648 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e7ac3-2004-444c-bf57-a93b306c30b4 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:42.820924 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e7ac3-2004-444c-bf57-a93b306c30b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:42.821191 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e7ac3-2004-444c-bf57-a93b306c30b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:42.822436 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f54f68-a26f-4082-bfed-577c10b48e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:42.823036 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f54f68-a26f-4082-bfed-577c10b48e61 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:42.823343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f54f68-a26f-4082-bfed-577c10b48e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:42.823610 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f54f68-a26f-4082-bfed-577c10b48e61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:42.831971 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e7ac3-2004-444c-bf57-a93b306c30b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:42.833411 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e7ac3-2004-444c-bf57-a93b306c30b4 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:42.848565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-456e7ac3-2004-444c-bf57-a93b306c30b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:42.848565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:42.848565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:42.848565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:42.848565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:42.848565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:42.848565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:42.848565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:42.848565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:42.848565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:42.848565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:42.848565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:42.848565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:50:42.848565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:50:42.848565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:50:42.848565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:50:42.849603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:42.849603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:42.849603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:42.849603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:42.849603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:42.849603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:42.849603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:42.849603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:42.849603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:42.849603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:42.849603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:42.849603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:42.849603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:42.849603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:42.849603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:42.849603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:42.849603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:50:42.850447 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:50:42.850447 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:42.850447 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:42.850447 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 253/504] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:42.851182 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfef41-c770-4fc8-a3ca-2639d71f4eae None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:42.851449 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfef41-c770-4fc8-a3ca-2639d71f4eae None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:42.851714 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcfef41-c770-4fc8-a3ca-2639d71f4eae None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:42.853487 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 254/505] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:42.858364 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcfef41-c770-4fc8-a3ca-2639d71f4eae None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:42.903103 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f54f68-a26f-4082-bfed-577c10b48e61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:42.904617 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f54f68-a26f-4082-bfed-577c10b48e61 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:42.945345 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:42.958649 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcfef41-c770-4fc8-a3ca-2639d71f4eae None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:42.992537 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0db1e1-0fe5-4e04-aa38-0b990786f8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:42.993146 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0db1e1-0fe5-4e04-aa38-0b990786f8fa None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:42.993431 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0db1e1-0fe5-4e04-aa38-0b990786f8fa None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:42.993760 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0db1e1-0fe5-4e04-aa38-0b990786f8fa None admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:42.994815 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0db1e1-0fe5-4e04-aa38-0b990786f8fa None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:42.995142 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0db1e1-0fe5-4e04-aa38-0b990786f8fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:42.996583 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0db1e1-0fe5-4e04-aa38-0b990786f8fa None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:43.005689 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 252/506] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:50:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:43.006354 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f54f68-a26f-4082-bfed-577c10b48e61 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:43.023921 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:43.036203 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 255/507] 10.222.0.55 () {56 vars in 1137 bytes} [Wed Aug 24 16:50:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:43.037030 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0db1e1-0fe5-4e04-aa38-0b990786f8fa None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:43.107695 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f54f68-a26f-4082-bfed-577c10b48e61 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:43.139991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0db1e1-0fe5-4e04-aa38-0b990786f8fa None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:43.142735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd180ce-e257-48cc-9c02-a1d4a9f9a070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:43.143261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd180ce-e257-48cc-9c02-a1d4a9f9a070 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:43.143539 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd180ce-e257-48cc-9c02-a1d4a9f9a070 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:43.143813 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd180ce-e257-48cc-9c02-a1d4a9f9a070 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:43.152281 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:43.154279 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd180ce-e257-48cc-9c02-a1d4a9f9a070 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:43.155810 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd180ce-e257-48cc-9c02-a1d4a9f9a070 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:43.170723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-dcd180ce-e257-48cc-9c02-a1d4a9f9a070 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:43.170723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:43.170723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:43.170723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:43.170723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:43.170723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:43.170723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:43.170723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:43.170723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:43.170723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:43.170723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:43.170723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:43.170723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:50:43.170723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:50:43.170723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:50:43.170723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:50:43.175418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:43.175418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:43.175418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:43.175418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:43.175418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:43.175418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:43.175418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:43.175418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:43.175418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:43.175418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:43.175418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:43.175418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:43.175418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:43.175418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:43.175418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:43.175418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:43.175418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:50:43.176292 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:50:43.176292 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:43.176292 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:43.176292 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 253/508] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:43.176292 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c54e3e-1994-4d74-87d2-2abf4d4364f2 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:43.176292 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c54e3e-1994-4d74-87d2-2abf4d4364f2 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:43.176292 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c54e3e-1994-4d74-87d2-2abf4d4364f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:43.177329 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de3f09-c414-49b8-9aff-6b5f122b4901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:43.177329 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de3f09-c414-49b8-9aff-6b5f122b4901 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:43.177329 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de3f09-c414-49b8-9aff-6b5f122b4901 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:43.177329 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85de3f09-c414-49b8-9aff-6b5f122b4901 None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:43.177597 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de3f09-c414-49b8-9aff-6b5f122b4901 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:43.177597 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de3f09-c414-49b8-9aff-6b5f122b4901 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:43.178834 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85de3f09-c414-49b8-9aff-6b5f122b4901 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:43.191761 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 256/509] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:43.192603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de3f09-c414-49b8-9aff-6b5f122b4901 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:43.193195 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-41c54e3e-1994-4d74-87d2-2abf4d4364f2 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:43.194383 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-41c54e3e-1994-4d74-87d2-2abf4d4364f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:43.254819 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:43.262533 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 254/510] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:43.263400 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c54e3e-1994-4d74-87d2-2abf4d4364f2 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:43.298782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85de3f09-c414-49b8-9aff-6b5f122b4901 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:43.332594 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec56da-03ff-402b-a266-820896b82d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:43.333224 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec56da-03ff-402b-a266-820896b82d91 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:43.333503 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec56da-03ff-402b-a266-820896b82d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:43.333775 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ec56da-03ff-402b-a266-820896b82d91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:43.345088 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec56da-03ff-402b-a266-820896b82d91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:43.346553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ec56da-03ff-402b-a266-820896b82d91 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:43.361681 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-05ec56da-03ff-402b-a266-820896b82d91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:43.361681 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:43.361681 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:43.361681 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:43.361681 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:43.361681 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:43.361681 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:43.361681 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:43.361681 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:43.361681 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:43.361681 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:43.361681 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:43.361681 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:50:43.361681 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:50:43.361681 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:50:43.361681 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:50:43.362604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:43.362604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:43.362604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:43.362604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:43.362604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:43.362604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:43.362604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:43.362604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:43.362604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:43.362604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:43.362604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:43.362604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:43.362604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:43.362604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:43.362604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:43.362604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:43.362604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:50:43.363465 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:50:43.363465 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:43.363465 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:43.363465 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 257/511] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:43.363694 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec56da-03ff-402b-a266-820896b82d91 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:43.380754 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c54e3e-1994-4d74-87d2-2abf4d4364f2 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:43.404748 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:43.418538 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd0b85-0e2f-420a-8f72-33599b9c6cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:43.419266 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd0b85-0e2f-420a-8f72-33599b9c6cec None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:43.419543 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd0b85-0e2f-420a-8f72-33599b9c6cec None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:43.419810 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bd0b85-0e2f-420a-8f72-33599b9c6cec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:43.476185 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ec56da-03ff-402b-a266-820896b82d91 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:43.488336 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:43.490491 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd0b85-0e2f-420a-8f72-33599b9c6cec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:43.492079 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bd0b85-0e2f-420a-8f72-33599b9c6cec None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:43.516926 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0f426-689d-4baa-bb4d-24f276d9e21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:43.517693 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0f426-689d-4baa-bb4d-24f276d9e21e None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:43.517982 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0f426-689d-4baa-bb4d-24f276d9e21e None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:43.518253 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e0f426-689d-4baa-bb4d-24f276d9e21e None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:43.518947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0f426-689d-4baa-bb4d-24f276d9e21e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:43.519449 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0f426-689d-4baa-bb4d-24f276d9e21e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:43.520992 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e0f426-689d-4baa-bb4d-24f276d9e21e None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:43.534658 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 258/512] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:43.535555 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0f426-689d-4baa-bb4d-24f276d9e21e None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:43.594620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 255/513] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:50:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:43.595401 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd0b85-0e2f-420a-8f72-33599b9c6cec None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:43.618504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:43.637517 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e0f426-689d-4baa-bb4d-24f276d9e21e None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:43.672276 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62635cf0-17e4-49d8-93a2-42f333d4f1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:43.672964 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62635cf0-17e4-49d8-93a2-42f333d4f1cd None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:43.673181 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62635cf0-17e4-49d8-93a2-42f333d4f1cd None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:43.673455 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62635cf0-17e4-49d8-93a2-42f333d4f1cd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:43.680653 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62635cf0-17e4-49d8-93a2-42f333d4f1cd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:43.682446 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62635cf0-17e4-49d8-93a2-42f333d4f1cd None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:43.694113 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-62635cf0-17e4-49d8-93a2-42f333d4f1cd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 16:50:43.694113 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:43.694113 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:43.694113 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:43.694113 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:43.694113 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:43.694113 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:43.694113 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:43.694113 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:43.694113 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:43.694113 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:43.694113 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:43.694113 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:50:43.694113 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:50:43.694113 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:50:43.694113 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:50:43.695059 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:43.695059 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:43.695059 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:50:43.695059 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:50:43.695059 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:50:43.695059 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:50:43.695059 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:43.695059 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:43.695059 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:43.695059 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:43.695059 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:43.695059 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:43.695059 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:43.695059 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:43.695059 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:43.695059 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:43.695059 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:43.695059 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:43.695990 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:43.695990 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:43.695990 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:50:43.695990 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:50:43.695990 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:50:43.695990 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:50:43.695990 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:50:43.695990 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:50:43.695990 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 16:50:43.695990 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:43.697397 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bd0b85-0e2f-420a-8f72-33599b9c6cec None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:43.697884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 259/514] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:50:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:43.697884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62635cf0-17e4-49d8-93a2-42f333d4f1cd None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:43.730103 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:43.731898 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f5338-1880-421a-adbf-037e0d29f9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:43.732504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f5338-1880-421a-adbf-037e0d29f9e6 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:43.732776 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f5338-1880-421a-adbf-037e0d29f9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:43.733041 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556f5338-1880-421a-adbf-037e0d29f9e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:43.733673 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f5338-1880-421a-adbf-037e0d29f9e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:43.733978 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f5338-1880-421a-adbf-037e0d29f9e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:43.735370 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556f5338-1880-421a-adbf-037e0d29f9e6 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:43.747034 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 256/515] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:43.747915 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f5338-1880-421a-adbf-037e0d29f9e6 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:43.804594 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62635cf0-17e4-49d8-93a2-42f333d4f1cd None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:43.830478 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:43.839752 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105e7b3-2b8b-4aec-81ec-ccf8dcb51384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:43.840383 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105e7b3-2b8b-4aec-81ec-ccf8dcb51384 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:43.856062 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105e7b3-2b8b-4aec-81ec-ccf8dcb51384 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:43.856062 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105e7b3-2b8b-4aec-81ec-ccf8dcb51384 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:43.856311 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556f5338-1880-421a-adbf-037e0d29f9e6 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:43.856389 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105e7b3-2b8b-4aec-81ec-ccf8dcb51384 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:43.856389 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0105e7b3-2b8b-4aec-81ec-ccf8dcb51384 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:43.868061 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-0105e7b3-2b8b-4aec-81ec-ccf8dcb51384 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:43.868061 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:43.868061 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:43.868061 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:43.868061 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:43.868061 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:43.868061 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:43.868061 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:43.868061 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:43.868061 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:43.868061 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:43.868061 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:43.868061 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:50:43.868061 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:50:43.868061 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:50:43.868061 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:50:43.869047 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:43.869047 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:43.869047 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:43.869047 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:43.869047 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:43.869047 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:43.869047 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:43.869047 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:43.869047 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:43.869047 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:43.869047 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:43.869047 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:43.869047 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:43.869047 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:43.869047 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:43.869047 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:43.869047 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:50:43.869900 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:50:43.869900 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:43.869900 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:43.870064 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 260/516] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:43.871054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105e7b3-2b8b-4aec-81ec-ccf8dcb51384 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:43.886520 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316fd4a-b56c-474c-bb68-21a63f65ab4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:43.887170 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316fd4a-b56c-474c-bb68-21a63f65ab4b None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:43.887448 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316fd4a-b56c-474c-bb68-21a63f65ab4b None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:43.887715 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316fd4a-b56c-474c-bb68-21a63f65ab4b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:43.895286 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316fd4a-b56c-474c-bb68-21a63f65ab4b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:43.896750 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316fd4a-b56c-474c-bb68-21a63f65ab4b None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:43.908526 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-4316fd4a-b56c-474c-bb68-21a63f65ab4b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 16:50:43.908526 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:43.908526 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:43.908526 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:43.908526 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:43.908526 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:43.908526 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:43.908526 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:43.908526 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:43.908526 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:43.908526 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:43.908526 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:43.908526 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:50:43.908526 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:50:43.908526 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:50:43.908526 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:50:43.909593 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:43.909593 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:43.909593 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:50:43.909593 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:50:43.909593 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:50:43.909593 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:50:43.909593 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:43.909593 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:43.909593 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:43.909593 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:43.909593 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:43.909593 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:43.909593 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:43.909593 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:43.909593 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:43.909593 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:43.909593 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:43.909593 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:43.910497 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:43.910497 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:43.910497 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:50:43.910497 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:50:43.910497 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:50:43.910497 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:50:43.910497 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:50:43.910497 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:50:43.910497 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 16:50:43.910497 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:43.910497 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 257/517] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Aug 24 16:50:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:43.911046 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316fd4a-b56c-474c-bb68-21a63f65ab4b None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:43.963926 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:43.981892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105e7b3-2b8b-4aec-81ec-ccf8dcb51384 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:44.010073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316fd4a-b56c-474c-bb68-21a63f65ab4b None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:44.015677 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689cfe3-9620-486f-85d8-8930a270f44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:44.016301 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689cfe3-9620-486f-85d8-8930a270f44a None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:44.016575 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689cfe3-9620-486f-85d8-8930a270f44a None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:44.016847 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689cfe3-9620-486f-85d8-8930a270f44a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:44.028975 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689cfe3-9620-486f-85d8-8930a270f44a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:44.030447 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d689cfe3-9620-486f-85d8-8930a270f44a None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:44.046319 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85acf0-3d24-4d38-8bde-8f38d74fdd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:44.046574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-d689cfe3-9620-486f-85d8-8930a270f44a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:44.046574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:44.046574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:44.046574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:44.046574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:44.046574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:44.046574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:44.046574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:44.046574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:44.046574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:44.046574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:44.046574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:44.046574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:50:44.046574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:50:44.046574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:50:44.046574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:50:44.047594 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:44.047594 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:44.047594 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:44.047594 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:44.047594 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:44.047594 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:44.047594 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:44.047594 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:44.047594 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:44.047594 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:44.047594 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:44.047594 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:44.047594 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:44.047594 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:44.047594 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:44.047594 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:44.047594 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:50:44.048705 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:50:44.048705 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:44.048705 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:44.048923 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85acf0-3d24-4d38-8bde-8f38d74fdd5a None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:44.048923 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85acf0-3d24-4d38-8bde-8f38d74fdd5a None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:44.048923 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d85acf0-3d24-4d38-8bde-8f38d74fdd5a None admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:44.048923 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85acf0-3d24-4d38-8bde-8f38d74fdd5a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:44.049226 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85acf0-3d24-4d38-8bde-8f38d74fdd5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:44.049540 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 261/518] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:44.050377 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689cfe3-9620-486f-85d8-8930a270f44a None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:44.051183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d85acf0-3d24-4d38-8bde-8f38d74fdd5a None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:44.068464 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:44.073452 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 258/519] 10.222.0.55 () {56 vars in 1137 bytes} [Wed Aug 24 16:50:43 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:44.074379 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85acf0-3d24-4d38-8bde-8f38d74fdd5a None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:44.195410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d689cfe3-9620-486f-85d8-8930a270f44a None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:44.220669 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d85acf0-3d24-4d38-8bde-8f38d74fdd5a None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:44.244832 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856068fe-e3ef-4a8c-a7b7-713c194cd873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:44.245308 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856068fe-e3ef-4a8c-a7b7-713c194cd873 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:44.245586 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856068fe-e3ef-4a8c-a7b7-713c194cd873 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:44.245856 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856068fe-e3ef-4a8c-a7b7-713c194cd873 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:44.247922 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:44.253963 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856068fe-e3ef-4a8c-a7b7-713c194cd873 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:44.255441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856068fe-e3ef-4a8c-a7b7-713c194cd873 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:44.264983 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109ce00-c73f-4ca8-bc18-484f49279b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:44.265603 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109ce00-c73f-4ca8-bc18-484f49279b26 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:44.265883 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109ce00-c73f-4ca8-bc18-484f49279b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:44.266161 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109ce00-c73f-4ca8-bc18-484f49279b26 None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:44.266814 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7109ce00-c73f-4ca8-bc18-484f49279b26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:44.267140 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7109ce00-c73f-4ca8-bc18-484f49279b26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:44.268280 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-856068fe-e3ef-4a8c-a7b7-713c194cd873 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:50:44.268280 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:44.268280 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:44.268280 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:44.268280 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:44.268280 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:44.268280 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:44.268280 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:44.268280 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:44.268280 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:44.268280 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:44.268280 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:44.268280 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:50:44.268280 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:50:44.268280 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:50:44.269878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:50:44.269878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:44.269878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:44.269878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:44.269878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:44.269878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:44.269878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:44.269878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:44.269878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:44.269878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:44.269878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:44.269878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:44.269878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:44.269878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:44.269878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:44.269878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:44.269878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:44.270795 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:50:44.270795 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:50:44.270795 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:50:44.270795 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:50:44.270795 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:50:44.270795 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:50:44.270795 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:50:44.270795 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:44.271385 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7109ce00-c73f-4ca8-bc18-484f49279b26 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:44.271456 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 262/520] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:50:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:44.271456 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856068fe-e3ef-4a8c-a7b7-713c194cd873 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:44.286508 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 259/521] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:44.287396 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109ce00-c73f-4ca8-bc18-484f49279b26 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:44.346761 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:44.377354 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856068fe-e3ef-4a8c-a7b7-713c194cd873 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:44.389689 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109ce00-c73f-4ca8-bc18-484f49279b26 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:44.410754 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086eebf-5a7f-4808-9d82-030ddb43a626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:44.411391 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086eebf-5a7f-4808-9d82-030ddb43a626 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:44.411670 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086eebf-5a7f-4808-9d82-030ddb43a626 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:44.411938 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4086eebf-5a7f-4808-9d82-030ddb43a626 None admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:44.412667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4086eebf-5a7f-4808-9d82-030ddb43a626 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:44.412995 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4086eebf-5a7f-4808-9d82-030ddb43a626 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:44.414427 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4086eebf-5a7f-4808-9d82-030ddb43a626 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:44.423578 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b11ff0-c598-40ab-b7ef-4a05d2da885d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:44.424204 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b11ff0-c598-40ab-b7ef-4a05d2da885d None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:44.424478 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b11ff0-c598-40ab-b7ef-4a05d2da885d None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:44.424748 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b11ff0-c598-40ab-b7ef-4a05d2da885d None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:44.425417 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b11ff0-c598-40ab-b7ef-4a05d2da885d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:44.425718 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b11ff0-c598-40ab-b7ef-4a05d2da885d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:44.427138 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b11ff0-c598-40ab-b7ef-4a05d2da885d None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:44.434456 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 263/522] 10.222.0.55 () {56 vars in 1139 bytes} [Wed Aug 24 16:50:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:44.435355 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086eebf-5a7f-4808-9d82-030ddb43a626 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:44.445306 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 260/523] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:44.446202 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b11ff0-c598-40ab-b7ef-4a05d2da885d None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:44.494975 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:44.542193 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4086eebf-5a7f-4808-9d82-030ddb43a626 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:44.544629 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b11ff0-c598-40ab-b7ef-4a05d2da885d None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:44.564934 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:44.578270 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c42f9d-7a27-4786-afd6-200272ada2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:44.578881 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c42f9d-7a27-4786-afd6-200272ada2ea None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:44.579191 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c42f9d-7a27-4786-afd6-200272ada2ea None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:44.579379 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7270e-5556-4e7b-8f5e-361005892b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:44.579550 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c42f9d-7a27-4786-afd6-200272ada2ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:44.579986 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7270e-5556-4e7b-8f5e-361005892b06 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:44.580260 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7270e-5556-4e7b-8f5e-361005892b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:44.580527 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d7270e-5556-4e7b-8f5e-361005892b06 None admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:44.581265 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d7270e-5556-4e7b-8f5e-361005892b06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:44.581570 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d7270e-5556-4e7b-8f5e-361005892b06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:44.582994 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d7270e-5556-4e7b-8f5e-361005892b06 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:44.601604 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 261/524] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:50:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:44.602403 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7270e-5556-4e7b-8f5e-361005892b06 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:44.649449 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c42f9d-7a27-4786-afd6-200272ada2ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:44.651319 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c42f9d-7a27-4786-afd6-200272ada2ea None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:44.703720 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:44.704598 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d7270e-5556-4e7b-8f5e-361005892b06 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:44.739225 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab79f1f-474c-4ce8-aac9-7186be7743e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:44.739826 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab79f1f-474c-4ce8-aac9-7186be7743e6 None admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:44.740102 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab79f1f-474c-4ce8-aac9-7186be7743e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:44.740370 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab79f1f-474c-4ce8-aac9-7186be7743e6 None admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:44.741000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab79f1f-474c-4ce8-aac9-7186be7743e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:44.742438 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab79f1f-474c-4ce8-aac9-7186be7743e6 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:44.752776 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 264/525] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:50:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:44.753629 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c42f9d-7a27-4786-afd6-200272ada2ea None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:44.822673 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 262/526] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Aug 24 16:50:44 2022] POST /identity/v3/users => generated 247 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:50:44.823324 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab79f1f-474c-4ce8-aac9-7186be7743e6 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:44.857902 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c42f9d-7a27-4786-afd6-200272ada2ea None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:44.873587 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:44.903851 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c0e23-241f-4836-add4-6dc0b63d671b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:44.904759 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c0e23-241f-4836-add4-6dc0b63d671b None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:44.905054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c0e23-241f-4836-add4-6dc0b63d671b None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:44.905299 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c0e23-241f-4836-add4-6dc0b63d671b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:44.930901 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:44.952581 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab79f1f-474c-4ce8-aac9-7186be7743e6 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:44.986364 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c0e23-241f-4836-add4-6dc0b63d671b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:44.987976 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c0e23-241f-4836-add4-6dc0b63d671b None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:44.991136 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d7ab3-a6c6-4e81-8d27-489318a956a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:44.992590 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d7ab3-a6c6-4e81-8d27-489318a956a0 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:44.992590 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d7ab3-a6c6-4e81-8d27-489318a956a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:44.992590 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d7ab3-a6c6-4e81-8d27-489318a956a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:45.000683 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d7ab3-a6c6-4e81-8d27-489318a956a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:45.002136 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d7ab3-a6c6-4e81-8d27-489318a956a0 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:45.014604 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-c34d7ab3-a6c6-4e81-8d27-489318a956a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:50:45.014604 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:45.014604 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:45.014604 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:45.014604 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:45.014604 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:45.014604 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:45.014604 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:45.014604 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:45.014604 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:45.014604 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:45.014604 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:45.014604 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:50:45.014604 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:50:45.014604 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:50:45.015636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:50:45.015636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:45.015636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:45.015636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:45.015636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:45.015636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:45.015636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:45.015636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:45.015636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:45.015636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:45.015636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:45.015636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:45.015636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:45.015636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:45.015636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:45.015636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:45.015636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:45.016482 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:50:45.016482 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:50:45.016482 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:50:45.016482 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:50:45.016482 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:50:45.016482 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:50:45.016482 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:50:45.016482 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:45.016901 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 263/527] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:50:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:45.018172 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d7ab3-a6c6-4e81-8d27-489318a956a0 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:45.101398 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 265/528] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:50:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:45.102514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c0e23-241f-4836-add4-6dc0b63d671b None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:45.131620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:45.137743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d7ab3-a6c6-4e81-8d27-489318a956a0 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:45.163627 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:45.173561 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae629fa1-dbc1-4e7f-8b12-0dfc9484fdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:45.174170 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae629fa1-dbc1-4e7f-8b12-0dfc9484fdab None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:45.174534 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae629fa1-dbc1-4e7f-8b12-0dfc9484fdab None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:45.174834 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae629fa1-dbc1-4e7f-8b12-0dfc9484fdab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:45.175626 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae629fa1-dbc1-4e7f-8b12-0dfc9484fdab None admin] RBAC: Adding query filter params (role.id=494c75ed8f864e3b955fdb043e96c675, scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642, user.id=28a1c617fc264b118e61f2a97ecb3f39) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:45.175917 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae629fa1-dbc1-4e7f-8b12-0dfc9484fdab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:45.178897 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae629fa1-dbc1-4e7f-8b12-0dfc9484fdab None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:45.191150 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 264/529] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:50:45 2022] GET /identity/v3/role_assignments?user.id=28a1c617fc264b118e61f2a97ecb3f39&scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642&role.id=494c75ed8f864e3b955fdb043e96c675 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:45.191150 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae629fa1-dbc1-4e7f-8b12-0dfc9484fdab None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:45.229352 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c0e23-241f-4836-add4-6dc0b63d671b None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:45.277379 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1f4db-9170-480d-8d12-6d3a31ba37e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:45.279068 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1f4db-9170-480d-8d12-6d3a31ba37e1 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:45.279397 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1f4db-9170-480d-8d12-6d3a31ba37e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:45.279675 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c1f4db-9170-480d-8d12-6d3a31ba37e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:45.296804 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1f4db-9170-480d-8d12-6d3a31ba37e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:45.298823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c1f4db-9170-480d-8d12-6d3a31ba37e1 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:45.317011 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae629fa1-dbc1-4e7f-8b12-0dfc9484fdab None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:45.322984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-00c1f4db-9170-480d-8d12-6d3a31ba37e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:45.322984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:45.322984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:45.322984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:45.322984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:45.322984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:45.322984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:45.322984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:45.322984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:45.322984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:45.322984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:45.322984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:45.322984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:50:45.322984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:50:45.322984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:50:45.322984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:50:45.324163 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:45.324163 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:45.324163 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:45.324163 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:45.324163 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:45.324163 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:45.324163 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:45.324163 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:45.324163 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:45.324163 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:45.324163 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:45.324163 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:45.324163 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:45.324163 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:45.324163 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:45.324163 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:45.324163 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:50:45.325035 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:50:45.325035 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:45.325035 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:45.325035 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 266/530] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:45.325892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1f4db-9170-480d-8d12-6d3a31ba37e1 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:45.365139 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706922f-f1f8-4369-b5df-304b7197c703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:45.366004 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706922f-f1f8-4369-b5df-304b7197c703 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:45.366419 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706922f-f1f8-4369-b5df-304b7197c703 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:45.366788 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706922f-f1f8-4369-b5df-304b7197c703 None admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:45.369091 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706922f-f1f8-4369-b5df-304b7197c703 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:45.369347 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706922f-f1f8-4369-b5df-304b7197c703 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:45.370809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f706922f-f1f8-4369-b5df-304b7197c703 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:45.385666 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 265/531] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:50:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:45.386819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706922f-f1f8-4369-b5df-304b7197c703 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:45.410555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:45.448032 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c1f4db-9170-480d-8d12-6d3a31ba37e1 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:45.451870 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:45.485739 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede6b65-e419-4144-bf90-71c56534785f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:45.486442 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede6b65-e419-4144-bf90-71c56534785f None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:45.486727 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede6b65-e419-4144-bf90-71c56534785f None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:45.486998 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ede6b65-e419-4144-bf90-71c56534785f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:45.501138 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede6b65-e419-4144-bf90-71c56534785f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:45.502668 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ede6b65-e419-4144-bf90-71c56534785f None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:45.504193 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706922f-f1f8-4369-b5df-304b7197c703 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:45.519526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-0ede6b65-e419-4144-bf90-71c56534785f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:45.519526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:45.519526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:45.519526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:45.519526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:45.519526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:45.519526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:45.519526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:45.519526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:45.519526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:45.519526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:45.519526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:45.519526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:50:45.519526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:50:45.519526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:50:45.519526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:50:45.520494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:45.520494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:45.520494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:45.520494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:45.520494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:45.520494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:45.520494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:45.520494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:45.520494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:45.520494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:45.520494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:45.520494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:45.520494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:45.520494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:45.520494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:45.520494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:45.520494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:50:45.521341 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:50:45.521341 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:45.521341 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:45.525610 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 267/532] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:45.526650 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede6b65-e419-4144-bf90-71c56534785f None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:45.551540 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214a706-86a3-4f7d-a3f4-442b2623c16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:45.552606 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214a706-86a3-4f7d-a3f4-442b2623c16c None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:45.553096 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214a706-86a3-4f7d-a3f4-442b2623c16c None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:45.553554 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214a706-86a3-4f7d-a3f4-442b2623c16c None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:45.554399 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214a706-86a3-4f7d-a3f4-442b2623c16c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:45.554996 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214a706-86a3-4f7d-a3f4-442b2623c16c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:45.557398 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214a706-86a3-4f7d-a3f4-442b2623c16c None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:45.571443 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 266/533] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:45.573209 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214a706-86a3-4f7d-a3f4-442b2623c16c None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:45.637028 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ede6b65-e419-4144-bf90-71c56534785f None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:45.662954 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:45.673464 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6889812-d649-4da6-8d17-3875746d59ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:45.674081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6889812-d649-4da6-8d17-3875746d59ce None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:45.674362 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6889812-d649-4da6-8d17-3875746d59ce None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:45.676468 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6889812-d649-4da6-8d17-3875746d59ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:45.676468 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6889812-d649-4da6-8d17-3875746d59ce None admin] RBAC: Adding query filter params (role.id=494c75ed8f864e3b955fdb043e96c675, scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642, user.id=3a6aad0e9f5f4a0b9578a31082e726cc) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:45.676468 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6889812-d649-4da6-8d17-3875746d59ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:45.677290 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6889812-d649-4da6-8d17-3875746d59ce None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:45.684310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 268/534] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:50:45 2022] GET /identity/v3/role_assignments?user.id=3a6aad0e9f5f4a0b9578a31082e726cc&scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642&role.id=494c75ed8f864e3b955fdb043e96c675 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:45.685143 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6889812-d649-4da6-8d17-3875746d59ce None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:45.687054 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214a706-86a3-4f7d-a3f4-442b2623c16c None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:45.712879 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:45.730977 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd94041e-25b7-43aa-b028-794e99e5c704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:45.732307 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94041e-25b7-43aa-b028-794e99e5c704 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:45.732801 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94041e-25b7-43aa-b028-794e99e5c704 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:45.733271 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd94041e-25b7-43aa-b028-794e99e5c704 None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:45.734126 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd94041e-25b7-43aa-b028-794e99e5c704 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:45.734615 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd94041e-25b7-43aa-b028-794e99e5c704 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:45.736335 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd94041e-25b7-43aa-b028-794e99e5c704 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:45.751166 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 267/535] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:45.758252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd94041e-25b7-43aa-b028-794e99e5c704 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:45.821235 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6889812-d649-4da6-8d17-3875746d59ce None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:45.896119 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bebc80-3978-464d-aacc-bd16151558c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:45.896771 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bebc80-3978-464d-aacc-bd16151558c5 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:45.897045 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bebc80-3978-464d-aacc-bd16151558c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:45.897310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bebc80-3978-464d-aacc-bd16151558c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:45.912467 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bebc80-3978-464d-aacc-bd16151558c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:45.913945 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bebc80-3978-464d-aacc-bd16151558c5 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:45.937207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-10bebc80-3978-464d-aacc-bd16151558c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:50:45.937207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:45.937207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:45.937207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:45.937207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:45.937207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:45.937207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:45.937207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:45.937207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:45.937207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:45.937207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:45.937207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:45.937207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:50:45.937207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:50:45.937207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:50:45.938532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:50:45.938532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:45.938532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:45.938532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:45.938532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:45.938532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:45.938532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:45.938532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:45.938532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:45.938532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:45.938532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:45.938532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:45.938532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:45.938532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:45.938532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:45.938532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:45.938532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:45.939437 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:50:45.939437 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:50:45.939437 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:50:45.939437 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:50:45.939437 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:50:45.939437 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:50:45.939437 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:50:45.939437 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:45.943583 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 269/536] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:50:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:45.945224 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bebc80-3978-464d-aacc-bd16151558c5 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:45.965334 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd94041e-25b7-43aa-b028-794e99e5c704 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:46.035249 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138081d1-474a-45c7-94fe-6b64104a1f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:46.035873 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138081d1-474a-45c7-94fe-6b64104a1f71 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:46.036148 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138081d1-474a-45c7-94fe-6b64104a1f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:46.036416 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138081d1-474a-45c7-94fe-6b64104a1f71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:46.044001 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138081d1-474a-45c7-94fe-6b64104a1f71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:46.045452 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138081d1-474a-45c7-94fe-6b64104a1f71 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:46.048045 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:46.059739 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-138081d1-474a-45c7-94fe-6b64104a1f71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:50:46.059739 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:46.059739 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:46.059739 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:46.059739 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:46.059739 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:46.059739 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:46.059739 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:46.059739 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:46.059739 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:46.059739 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:46.059739 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:46.059739 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:50:46.059739 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:50:46.059739 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:50:46.062065 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:50:46.062065 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:46.062065 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:46.062065 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:46.062065 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:46.062065 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:46.062065 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:46.062065 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:46.062065 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:46.062065 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:46.062065 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:46.062065 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:46.062065 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:46.062065 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:46.062065 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:46.062065 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:46.062065 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:46.070553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:50:46.070553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:50:46.070553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:50:46.070553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:50:46.070553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:50:46.070553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:50:46.070553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:50:46.070553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:46.070553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 268/537] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:50:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:50:46.070553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138081d1-474a-45c7-94fe-6b64104a1f71 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:46.149423 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:46.185018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138081d1-474a-45c7-94fe-6b64104a1f71 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:46.213295 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bebc80-3978-464d-aacc-bd16151558c5 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:46.224246 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d267441-8ca8-475d-a39e-9f0da2a7f33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:46.224883 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d267441-8ca8-475d-a39e-9f0da2a7f33a None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:46.225652 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d267441-8ca8-475d-a39e-9f0da2a7f33a None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:46.225981 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d267441-8ca8-475d-a39e-9f0da2a7f33a None admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:46.226677 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d267441-8ca8-475d-a39e-9f0da2a7f33a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:46.227027 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d267441-8ca8-475d-a39e-9f0da2a7f33a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:46.229031 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d267441-8ca8-475d-a39e-9f0da2a7f33a None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:46.243736 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 269/538] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:50:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:46.249921 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d267441-8ca8-475d-a39e-9f0da2a7f33a None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:46.284924 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f96acb-b366-4658-a94d-30d039dbc62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:46.285803 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f96acb-b366-4658-a94d-30d039dbc62e None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:46.286315 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f96acb-b366-4658-a94d-30d039dbc62e None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:46.286735 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f96acb-b366-4658-a94d-30d039dbc62e None admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:46.287613 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f96acb-b366-4658-a94d-30d039dbc62e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:46.288053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f96acb-b366-4658-a94d-30d039dbc62e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:46.299136 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f96acb-b366-4658-a94d-30d039dbc62e None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:46.320437 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:46.328628 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 270/539] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:50:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:46.335583 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f96acb-b366-4658-a94d-30d039dbc62e None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:46.377411 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d267441-8ca8-475d-a39e-9f0da2a7f33a None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:46.420421 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3457d28e-d40f-41cb-92b7-a6b9c00d2f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:46.421407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457d28e-d40f-41cb-92b7-a6b9c00d2f0c None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:46.421785 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457d28e-d40f-41cb-92b7-a6b9c00d2f0c None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:46.422152 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3457d28e-d40f-41cb-92b7-a6b9c00d2f0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:46.423148 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457d28e-d40f-41cb-92b7-a6b9c00d2f0c None admin] RBAC: Adding query filter params (role.id=494c75ed8f864e3b955fdb043e96c675, scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642, user.id=88ce8df89a96460ca046f2972321bceb) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:46.423694 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457d28e-d40f-41cb-92b7-a6b9c00d2f0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:46.425233 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3457d28e-d40f-41cb-92b7-a6b9c00d2f0c None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:46.432380 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 270/540] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:50:46 2022] GET /identity/v3/role_assignments?user.id=88ce8df89a96460ca046f2972321bceb&scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642&role.id=494c75ed8f864e3b955fdb043e96c675 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:50:46.523833 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f96acb-b366-4658-a94d-30d039dbc62e None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:46.572804 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8ed39-6867-4ff6-9bd6-c94a714aee8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:46.573784 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8ed39-6867-4ff6-9bd6-c94a714aee8d None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:46.574240 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8ed39-6867-4ff6-9bd6-c94a714aee8d None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:46.574671 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8ed39-6867-4ff6-9bd6-c94a714aee8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:46.575633 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8ed39-6867-4ff6-9bd6-c94a714aee8d None admin] RBAC: Adding query filter params (role.id=494c75ed8f864e3b955fdb043e96c675, scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642, user.id=eb911b8748844a6488811ca03cb8d344) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:46.576107 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8ed39-6867-4ff6-9bd6-c94a714aee8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:46.577793 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8ed39-6867-4ff6-9bd6-c94a714aee8d None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:46.584612 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 271/541] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:50:46 2022] GET /identity/v3/role_assignments?user.id=eb911b8748844a6488811ca03cb8d344&scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642&role.id=494c75ed8f864e3b955fdb043e96c675 => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:46.909256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934885b9-e4c8-4816-8d69-52d0280ddc23 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:46.910250 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934885b9-e4c8-4816-8d69-52d0280ddc23 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:46.910733 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934885b9-e4c8-4816-8d69-52d0280ddc23 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:46.912361 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 271/542] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:46.929024 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017072c-8e11-4068-8d8b-7f12a244419a None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:46.929671 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017072c-8e11-4068-8d8b-7f12a244419a None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:46.929671 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4017072c-8e11-4068-8d8b-7f12a244419a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:46.939462 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:46.955971 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-4017072c-8e11-4068-8d8b-7f12a244419a None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:46.960141 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-4017072c-8e11-4068-8d8b-7f12a244419a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:47.049839 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 272/543] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:47.421736 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25822e-6fe0-483f-9953-a7537bd721ab None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:47.422119 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25822e-6fe0-483f-9953-a7537bd721ab None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:47.422291 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef25822e-6fe0-483f-9953-a7537bd721ab None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:47.423901 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 272/544] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:47.440053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c46865-e8a1-4eff-8774-f627462e1ca0 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:47.440656 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c46865-e8a1-4eff-8774-f627462e1ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:47.441158 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c46865-e8a1-4eff-8774-f627462e1ca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:47.468125 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-45c46865-e8a1-4eff-8774-f627462e1ca0 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:47.469713 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-45c46865-e8a1-4eff-8774-f627462e1ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:47.487730 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25822e-6fe0-483f-9953-a7537bd721ab None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:47.546611 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 273/545] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:47.651751 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef25822e-6fe0-483f-9953-a7537bd721ab None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:47.686610 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:47.698579 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a63d10-511b-4aa7-8da4-05a57e0ad4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:47.699385 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a63d10-511b-4aa7-8da4-05a57e0ad4c3 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:47.699785 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a63d10-511b-4aa7-8da4-05a57e0ad4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:47.700159 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a63d10-511b-4aa7-8da4-05a57e0ad4c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:47.711457 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a63d10-511b-4aa7-8da4-05a57e0ad4c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:47.716718 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-a8a63d10-511b-4aa7-8da4-05a57e0ad4c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:50:47.716718 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:47.716718 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:47.716718 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:47.716718 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:47.716718 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:47.716718 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:47.716718 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:47.716718 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:47.716718 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:47.716718 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:47.716718 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:47.716718 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:47.716718 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:47.716718 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:47.716718 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:47.717636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:47.717636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:47.717636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:47.717636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:47.717636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:47.717636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:47.717636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:47.717636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:47.717636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:47.717636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:47.717636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:47.717636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:47.717636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:47.717636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:47.717636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:47.717636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:47.718765 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:47.718765 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:47.718765 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:47.718765 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:47.718765 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:47.718765 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:47.718765 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:47.718765 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:47.718765 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:47.718765 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:47.718765 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:50:47.718765 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:47.718765 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 273/546] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Aug 24 16:50:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:50:47.724251 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c46865-e8a1-4eff-8774-f627462e1ca0 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:47.802016 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:47.845700 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c46865-e8a1-4eff-8774-f627462e1ca0 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:47.903289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e4a03-407a-4142-9cc6-112d769146a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:47.904255 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e4a03-407a-4142-9cc6-112d769146a5 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:47.904737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e4a03-407a-4142-9cc6-112d769146a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:47.905235 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e4a03-407a-4142-9cc6-112d769146a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:47.906135 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e4a03-407a-4142-9cc6-112d769146a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:47.906641 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e4a03-407a-4142-9cc6-112d769146a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:47.908236 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e4a03-407a-4142-9cc6-112d769146a5 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:47.923906 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 274/547] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Aug 24 16:50:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:47.929757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a63d10-511b-4aa7-8da4-05a57e0ad4c3 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:48.014892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e4a03-407a-4142-9cc6-112d769146a5 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:48.079302 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a63d10-511b-4aa7-8da4-05a57e0ad4c3 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:48.109291 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f07656-369c-4112-9b7a-6a3ae8b709de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:48.111016 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f07656-369c-4112-9b7a-6a3ae8b709de None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:48.111170 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f07656-369c-4112-9b7a-6a3ae8b709de None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:48.111430 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f07656-369c-4112-9b7a-6a3ae8b709de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:48.129819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f07656-369c-4112-9b7a-6a3ae8b709de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:48.131317 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f07656-369c-4112-9b7a-6a3ae8b709de None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:48.146713 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-a8f07656-369c-4112-9b7a-6a3ae8b709de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:48.146713 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:48.146713 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:48.146713 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:48.146713 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:48.146713 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:48.146713 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:48.146713 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:48.146713 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:48.146713 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:48.146713 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:48.146713 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:48.146713 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:50:48.146713 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:50:48.146713 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:50:48.146713 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:50:48.147966 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:48.147966 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:48.147966 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:48.147966 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:48.147966 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:48.147966 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:48.147966 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:48.147966 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:48.147966 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:48.147966 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:48.147966 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:48.147966 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:48.147966 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:48.147966 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:48.147966 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:48.147966 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:48.147966 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:50:48.148866 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:50:48.148866 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:48.148866 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:48.148866 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 274/548] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:48.150109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63813c-09bd-4949-b643-bc670c281a14 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:48.150109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63813c-09bd-4949-b643-bc670c281a14 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:48.150482 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b63813c-09bd-4949-b643-bc670c281a14 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:48.157049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 275/549] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:48.157049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63813c-09bd-4949-b643-bc670c281a14 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:48.199741 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:48.201348 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e4a03-407a-4142-9cc6-112d769146a5 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:48.230008 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:48.238961 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f2c1f-0e98-443f-9a9c-dad4d04b933d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:48.240473 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f2c1f-0e98-443f-9a9c-dad4d04b933d None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:48.240473 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f2c1f-0e98-443f-9a9c-dad4d04b933d None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:48.240473 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f2c1f-0e98-443f-9a9c-dad4d04b933d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:48.252985 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f2c1f-0e98-443f-9a9c-dad4d04b933d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:48.259216 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-617f2c1f-0e98-443f-9a9c-dad4d04b933d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:50:48.259216 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:48.259216 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:48.259216 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:48.259216 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:48.259216 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:48.259216 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:48.259216 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:48.259216 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:48.259216 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:48.259216 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:48.259216 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:48.259216 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:48.259216 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:48.259216 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:48.259216 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:48.260410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:48.260410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:48.260410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:48.260410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:48.260410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:48.260410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:48.260410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:48.260410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:48.260410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:48.260410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:48.260410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:48.260410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:48.260410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:48.260410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:48.260410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:48.260410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:48.261441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:48.261441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:48.261441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:48.261441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:48.261441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:48.261441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:48.261441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:48.261441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:48.261441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:48.261441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:48.261441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:50:48.261441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:48.263047 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 275/550] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Aug 24 16:50:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:50:48.264403 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21451f5-b02a-4519-947a-4edf5da00086 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:48.264756 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21451f5-b02a-4519-947a-4edf5da00086 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:48.265153 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21451f5-b02a-4519-947a-4edf5da00086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:48.280742 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b63813c-09bd-4949-b643-bc670c281a14 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:48.285102 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-e21451f5-b02a-4519-947a-4edf5da00086 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:48.286386 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-e21451f5-b02a-4519-947a-4edf5da00086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:48.320831 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bee7cd-7921-4413-8c46-3e9e7bbf692d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:48.322057 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bee7cd-7921-4413-8c46-3e9e7bbf692d None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:48.322625 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bee7cd-7921-4413-8c46-3e9e7bbf692d None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:48.323178 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bee7cd-7921-4413-8c46-3e9e7bbf692d None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:48.324062 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bee7cd-7921-4413-8c46-3e9e7bbf692d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:48.324565 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bee7cd-7921-4413-8c46-3e9e7bbf692d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:48.326390 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bee7cd-7921-4413-8c46-3e9e7bbf692d None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:48.345426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 276/551] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:48.346721 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bee7cd-7921-4413-8c46-3e9e7bbf692d None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:48.367447 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 276/552] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:48.368784 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21451f5-b02a-4519-947a-4edf5da00086 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:48.491567 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:48.497839 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bee7cd-7921-4413-8c46-3e9e7bbf692d None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:48.558635 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21451f5-b02a-4519-947a-4edf5da00086 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:48.589031 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfcb4e2-0d1c-4fbc-b85f-f8cdab09f3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:48.590002 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcb4e2-0d1c-4fbc-b85f-f8cdab09f3b5 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:48.590490 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcb4e2-0d1c-4fbc-b85f-f8cdab09f3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:48.590941 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfcb4e2-0d1c-4fbc-b85f-f8cdab09f3b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:48.591810 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfcb4e2-0d1c-4fbc-b85f-f8cdab09f3b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:48.592294 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfcb4e2-0d1c-4fbc-b85f-f8cdab09f3b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:48.593854 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfcb4e2-0d1c-4fbc-b85f-f8cdab09f3b5 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:48.597571 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:48.612585 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 277/553] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Aug 24 16:50:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:48.618812 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfcb4e2-0d1c-4fbc-b85f-f8cdab09f3b5 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:48.635614 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2ef77-ca76-4872-987c-f22fb4b96dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:48.636264 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2ef77-ca76-4872-987c-f22fb4b96dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:48.636546 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2ef77-ca76-4872-987c-f22fb4b96dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:48.636872 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a2ef77-ca76-4872-987c-f22fb4b96dd7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:48.650152 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2ef77-ca76-4872-987c-f22fb4b96dd7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:48.651887 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a2ef77-ca76-4872-987c-f22fb4b96dd7 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:48.673911 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-16a2ef77-ca76-4872-987c-f22fb4b96dd7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:50:48.673911 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:48.673911 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:48.673911 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:48.673911 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:48.673911 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:48.673911 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:48.673911 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:48.673911 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:48.673911 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:48.673911 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:48.673911 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:48.673911 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:50:48.673911 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:50:48.673911 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:50:48.673911 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:50:48.674908 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:48.674908 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:48.674908 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:50:48.674908 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:50:48.674908 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:50:48.674908 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:50:48.674908 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:48.674908 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:48.674908 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:48.674908 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:48.674908 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:48.674908 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:48.674908 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:48.674908 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:48.674908 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:48.674908 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:48.674908 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:48.674908 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:48.675957 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:48.675957 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:48.675957 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:50:48.675957 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:50:48.675957 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:50:48.675957 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:50:48.675957 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:50:48.675957 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:50:48.675957 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:50:48.675957 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:48.675957 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 277/554] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:50:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:48.681488 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2ef77-ca76-4872-987c-f22fb4b96dd7 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:48.773272 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfcb4e2-0d1c-4fbc-b85f-f8cdab09f3b5 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:48.811092 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1804b-82b0-4f4f-800d-bc4da7765c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:48.811840 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1804b-82b0-4f4f-800d-bc4da7765c03 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:48.812219 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1804b-82b0-4f4f-800d-bc4da7765c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:48.812590 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b1804b-82b0-4f4f-800d-bc4da7765c03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:48.824842 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b1804b-82b0-4f4f-800d-bc4da7765c03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:48.826489 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b1804b-82b0-4f4f-800d-bc4da7765c03 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:48.830570 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a2ef77-ca76-4872-987c-f22fb4b96dd7 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:48.841572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-b9b1804b-82b0-4f4f-800d-bc4da7765c03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:48.841572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:48.841572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:48.841572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:48.841572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:48.841572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:48.841572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:48.841572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:48.841572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:48.841572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:48.841572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:48.841572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:48.841572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:50:48.841572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:50:48.841572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:50:48.841572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:50:48.842600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:48.842600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:48.842600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:48.842600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:48.842600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:48.842600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:48.842600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:48.842600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:48.842600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:48.842600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:48.842600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:48.842600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:48.842600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:48.842600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:48.842600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:48.842600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:48.842600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:50:48.844136 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:50:48.844136 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:48.844136 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:48.844136 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 278/555] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:48.844136 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1804b-82b0-4f4f-800d-bc4da7765c03 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:48.858578 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:48.884586 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42397ec5-be3e-4913-8dab-35eaf91a8a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:48.885206 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42397ec5-be3e-4913-8dab-35eaf91a8a69 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:48.885485 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42397ec5-be3e-4913-8dab-35eaf91a8a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:48.885759 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42397ec5-be3e-4913-8dab-35eaf91a8a69 None admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:48.886500 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42397ec5-be3e-4913-8dab-35eaf91a8a69 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:48.886805 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42397ec5-be3e-4913-8dab-35eaf91a8a69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:48.888290 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42397ec5-be3e-4913-8dab-35eaf91a8a69 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:48.906518 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 278/556] 10.222.0.55 () {56 vars in 1135 bytes} [Wed Aug 24 16:50:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:48.913643 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42397ec5-be3e-4913-8dab-35eaf91a8a69 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:48.946433 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:48.970579 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b1804b-82b0-4f4f-800d-bc4da7765c03 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:49.011854 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b3300-61e8-4aae-b75e-896e9e0adbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:49.012524 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b3300-61e8-4aae-b75e-896e9e0adbad None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:49.012807 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b3300-61e8-4aae-b75e-896e9e0adbad None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:49.013092 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b3300-61e8-4aae-b75e-896e9e0adbad None admin] PATH_INFO: `/v3/roles/service` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:49.018169 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42397ec5-be3e-4913-8dab-35eaf91a8a69 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:49.025488 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b3300-61e8-4aae-b75e-896e9e0adbad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:49.031701 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-834b3300-61e8-4aae-b75e-896e9e0adbad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:50:49.031701 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:49.031701 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:49.031701 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:49.031701 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:49.031701 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:49.031701 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:49.031701 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:49.031701 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:49.031701 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:49.031701 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:49.031701 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:49.031701 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:49.031701 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:49.031701 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:49.031701 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:49.032805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:49.032805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:49.032805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:49.032805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:49.032805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:49.032805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:49.032805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:49.032805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:49.032805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:49.032805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:49.032805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:49.032805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:49.032805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:49.032805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:49.032805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:49.032805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:49.034209 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:49.034209 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:49.034209 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:49.034209 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:49.034209 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:49.034209 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:49.034209 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:49.034209 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:49.034209 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:49.034209 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:49.034209 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:50:49.034209 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:49.036191 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 279/557] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Aug 24 16:50:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:49.037640 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27447770-68d9-439c-a2f6-0115d3d354e6 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:49.037920 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27447770-68d9-439c-a2f6-0115d3d354e6 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:49.038194 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27447770-68d9-439c-a2f6-0115d3d354e6 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:49.039663 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 280/558] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:49.040844 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27447770-68d9-439c-a2f6-0115d3d354e6 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:49.067418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9de8c7-be59-4a6e-95fa-090a43474fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:49.067948 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9de8c7-be59-4a6e-95fa-090a43474fbf None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:49.068225 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9de8c7-be59-4a6e-95fa-090a43474fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:49.068541 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9de8c7-be59-4a6e-95fa-090a43474fbf None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:49.069129 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9de8c7-be59-4a6e-95fa-090a43474fbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:49.069429 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9de8c7-be59-4a6e-95fa-090a43474fbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:49.070874 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9de8c7-be59-4a6e-95fa-090a43474fbf None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:49.082930 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 279/559] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:49.083801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9de8c7-be59-4a6e-95fa-090a43474fbf None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:49.117814 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:49.150809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27447770-68d9-439c-a2f6-0115d3d354e6 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:49.178891 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:49.185228 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb2dfd-7b04-4c75-823a-784d54e4527f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:49.185453 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9de8c7-be59-4a6e-95fa-090a43474fbf None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:49.190258 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb2dfd-7b04-4c75-823a-784d54e4527f None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:49.190258 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb2dfd-7b04-4c75-823a-784d54e4527f None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:49.190258 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcb2dfd-7b04-4c75-823a-784d54e4527f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:49.221990 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a79c5d4-da85-4d34-90ac-db4a317c3f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:49.222593 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79c5d4-da85-4d34-90ac-db4a317c3f2a None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:49.222870 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79c5d4-da85-4d34-90ac-db4a317c3f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:49.223157 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a79c5d4-da85-4d34-90ac-db4a317c3f2a None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:49.223813 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79c5d4-da85-4d34-90ac-db4a317c3f2a None admin] RBAC: Adding query filter params (name=service) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:49.224134 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79c5d4-da85-4d34-90ac-db4a317c3f2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:49.225531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a79c5d4-da85-4d34-90ac-db4a317c3f2a None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:49.238513 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 280/560] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Aug 24 16:50:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:49.238513 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa54f4b-b29f-4b9c-b534-3190dfb8736c None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:49.238513 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa54f4b-b29f-4b9c-b534-3190dfb8736c None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:49.238513 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa54f4b-b29f-4b9c-b534-3190dfb8736c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:49.253221 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-3fa54f4b-b29f-4b9c-b534-3190dfb8736c None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:49.254408 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-3fa54f4b-b29f-4b9c-b534-3190dfb8736c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:49.261267 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb2dfd-7b04-4c75-823a-784d54e4527f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:49.262746 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcb2dfd-7b04-4c75-823a-784d54e4527f None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:49.327403 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 281/561] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:49.328584 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad7e99-43ad-466d-b04e-3c6585963d0b None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:49.328996 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad7e99-43ad-466d-b04e-3c6585963d0b None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:49.329418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad7e99-43ad-466d-b04e-3c6585963d0b None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:49.330867 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 282/562] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:49.335295 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad7e99-43ad-466d-b04e-3c6585963d0b None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:49.338409 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:49.377597 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 281/563] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:50:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:49.378588 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb2dfd-7b04-4c75-823a-784d54e4527f None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:49.441292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:49.458426 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad7e99-43ad-466d-b04e-3c6585963d0b None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:49.480871 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcb2dfd-7b04-4c75-823a-784d54e4527f None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:49.497593 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7be985-03f0-4e3f-882e-3e930403cfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:49.498440 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7be985-03f0-4e3f-882e-3e930403cfdc None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:49.498905 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7be985-03f0-4e3f-882e-3e930403cfdc None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:49.499294 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7be985-03f0-4e3f-882e-3e930403cfdc None admin] PATH_INFO: `/v3/users/nova` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:49.507291 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7be985-03f0-4e3f-882e-3e930403cfdc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:49.509692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7be985-03f0-4e3f-882e-3e930403cfdc None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:49.515851 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a940c-178e-480a-983d-0f28f9ae1baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:49.516485 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a940c-178e-480a-983d-0f28f9ae1baa None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:49.516772 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a940c-178e-480a-983d-0f28f9ae1baa None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:49.517046 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01a940c-178e-480a-983d-0f28f9ae1baa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:49.525034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-ae7be985-03f0-4e3f-882e-3e930403cfdc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:50:49.525034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:49.525034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:49.525034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:49.525034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:49.525034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:49.525034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:49.525034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:49.525034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:49.525034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:49.525034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:49.525034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:49.525034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:50:49.525034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:50:49.525034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:50:49.525034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:50:49.526201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:49.526201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:49.526201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:50:49.526201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:50:49.526201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:50:49.526201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:50:49.526201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:49.526201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:49.526201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:49.526201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:49.526201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:49.526201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:49.526201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:49.526201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:49.526201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:49.526201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:49.526201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:49.526201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:49.527750 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:49.527750 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:49.527750 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:50:49.527750 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:50:49.527750 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:50:49.527750 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:50:49.527750 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:50:49.527750 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:50:49.527750 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:50:49.527750 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:49.527750 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 283/564] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Aug 24 16:50:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:49.528718 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd572a9a-50fa-43f4-831a-625800554148 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:49.528992 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd572a9a-50fa-43f4-831a-625800554148 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:49.529365 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd572a9a-50fa-43f4-831a-625800554148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:49.533252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a940c-178e-480a-983d-0f28f9ae1baa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:49.534858 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01a940c-178e-480a-983d-0f28f9ae1baa None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:49.547930 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-fd572a9a-50fa-43f4-831a-625800554148 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:49.549117 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-fd572a9a-50fa-43f4-831a-625800554148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:49.553377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-d01a940c-178e-480a-983d-0f28f9ae1baa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:49.553377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:49.553377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:49.553377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:49.553377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:49.553377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:49.553377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:49.553377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:49.553377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:49.553377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:49.553377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:49.553377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:49.553377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:50:49.553377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:50:49.553377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:50:49.553377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:50:49.554486 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:49.554486 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:49.554486 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:49.554486 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:49.554486 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:49.554486 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:49.554486 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:49.554486 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:49.554486 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:49.554486 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:49.554486 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:49.554486 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:49.554486 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:49.554486 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:49.554486 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:49.554486 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:49.554486 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:50:49.555645 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:50:49.555645 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:49.555645 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:49.561461 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 282/565] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:49.561461 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a940c-178e-480a-983d-0f28f9ae1baa None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:49.588056 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:49.623071 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 284/566] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:49.623954 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd572a9a-50fa-43f4-831a-625800554148 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:49.673731 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01a940c-178e-480a-983d-0f28f9ae1baa None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:49.707578 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:49.711706 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdc3d6-a538-497e-8cac-ece4fcef111a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:49.712887 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdc3d6-a538-497e-8cac-ece4fcef111a None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:49.713166 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdc3d6-a538-497e-8cac-ece4fcef111a None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:49.713608 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbdc3d6-a538-497e-8cac-ece4fcef111a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:49.725097 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbdc3d6-a538-497e-8cac-ece4fcef111a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:49.726558 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbdc3d6-a538-497e-8cac-ece4fcef111a None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:49.732201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd572a9a-50fa-43f4-831a-625800554148 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:49.741995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-fbbdc3d6-a538-497e-8cac-ece4fcef111a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:49.741995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:49.741995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:49.741995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:49.741995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:49.741995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:49.741995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:49.741995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:49.741995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:49.741995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:49.741995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:49.741995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:49.741995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:50:49.741995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:50:49.741995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:50:49.741995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:50:49.743828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:49.743828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:49.743828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:49.743828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:49.743828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:49.743828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:49.743828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:49.743828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:49.743828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:49.743828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:49.743828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:49.743828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:49.743828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:49.743828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:49.743828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:49.743828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:49.743828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:50:49.744917 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:50:49.744917 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:49.744917 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:49.748492 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 283/567] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:49.749374 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdc3d6-a538-497e-8cac-ece4fcef111a None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:49.772608 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508c719-11ce-46e4-86fa-e6e98e07ce94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:49.773416 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508c719-11ce-46e4-86fa-e6e98e07ce94 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:49.773783 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508c719-11ce-46e4-86fa-e6e98e07ce94 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:49.774271 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508c719-11ce-46e4-86fa-e6e98e07ce94 None admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:49.775618 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508c719-11ce-46e4-86fa-e6e98e07ce94 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:49.776090 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508c719-11ce-46e4-86fa-e6e98e07ce94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:49.777610 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6508c719-11ce-46e4-86fa-e6e98e07ce94 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:49.797285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 285/568] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Aug 24 16:50:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:49.797285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508c719-11ce-46e4-86fa-e6e98e07ce94 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:49.837821 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:49.871511 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbdc3d6-a538-497e-8cac-ece4fcef111a None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:49.903078 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6508c719-11ce-46e4-86fa-e6e98e07ce94 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:49.910088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d6a05-c5a3-488c-b2ce-4520890fab80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:49.911056 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d6a05-c5a3-488c-b2ce-4520890fab80 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:49.911056 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d6a05-c5a3-488c-b2ce-4520890fab80 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:49.911274 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132d6a05-c5a3-488c-b2ce-4520890fab80 None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:49.911934 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d6a05-c5a3-488c-b2ce-4520890fab80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:49.912241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d6a05-c5a3-488c-b2ce-4520890fab80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:49.913660 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132d6a05-c5a3-488c-b2ce-4520890fab80 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:49.925969 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 284/569] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:49.926869 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d6a05-c5a3-488c-b2ce-4520890fab80 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:49.941519 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5eac50-b205-4621-a628-0ceb0e4e8528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:49.942149 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5eac50-b205-4621-a628-0ceb0e4e8528 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:49.942423 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5eac50-b205-4621-a628-0ceb0e4e8528 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:49.942696 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5eac50-b205-4621-a628-0ceb0e4e8528 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:49.944683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:49.954647 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5eac50-b205-4621-a628-0ceb0e4e8528 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:49.959553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-2d5eac50-b205-4621-a628-0ceb0e4e8528 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:50:49.959553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:49.959553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:49.959553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:49.959553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:49.959553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:49.959553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:49.959553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:49.959553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:49.959553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:49.959553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:49.959553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:49.959553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:49.959553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:49.959553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:49.959553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:49.960520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:49.960520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:49.960520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:49.960520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:49.960520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:49.960520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:49.960520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:49.960520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:49.960520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:49.960520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:49.960520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:49.960520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:49.960520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:49.960520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:49.960520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:49.960520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:49.961350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:49.961350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:49.961350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:49.961350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:49.961350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:49.961350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:49.961350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:49.961350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:49.961350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:49.961350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:49.961350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:50:49.961350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:49.961350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 286/570] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Aug 24 16:50:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:49.962680 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5eac50-b205-4621-a628-0ceb0e4e8528 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:50.035071 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132d6a05-c5a3-488c-b2ce-4520890fab80 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:50.067034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5eac50-b205-4621-a628-0ceb0e4e8528 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:50.069534 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dcaf8a-5ab3-4db4-9d80-fe70952bab59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:50.070139 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcaf8a-5ab3-4db4-9d80-fe70952bab59 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:50.070413 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcaf8a-5ab3-4db4-9d80-fe70952bab59 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:50.070677 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dcaf8a-5ab3-4db4-9d80-fe70952bab59 None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:50.071414 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dcaf8a-5ab3-4db4-9d80-fe70952bab59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:50.071860 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dcaf8a-5ab3-4db4-9d80-fe70952bab59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:50.073222 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dcaf8a-5ab3-4db4-9d80-fe70952bab59 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:50.074856 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:50.085143 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 285/571] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:50.085954 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dcaf8a-5ab3-4db4-9d80-fe70952bab59 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:50.103178 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f83194-6511-40e8-b0fa-420cad763709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:50.104417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f83194-6511-40e8-b0fa-420cad763709 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:50.104696 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f83194-6511-40e8-b0fa-420cad763709 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:50.104964 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f83194-6511-40e8-b0fa-420cad763709 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:50.115433 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f83194-6511-40e8-b0fa-420cad763709 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:50.116866 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f83194-6511-40e8-b0fa-420cad763709 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:50.132044 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-91f83194-6511-40e8-b0fa-420cad763709 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:50.132044 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:50.132044 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:50.132044 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:50.132044 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:50.132044 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:50.132044 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:50.132044 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:50.132044 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:50.132044 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:50.132044 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:50.132044 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:50.132044 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:50:50.132044 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:50:50.132044 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:50:50.132044 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:50:50.133144 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:50.133144 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:50.133144 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:50.133144 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:50.133144 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:50.133144 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:50.133144 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:50.133144 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:50.133144 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:50.133144 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:50.133144 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:50.133144 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:50.133144 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:50.133144 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:50.133144 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:50.133144 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:50.133144 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:50:50.134861 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:50:50.134861 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:50.134861 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:50.134861 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 287/572] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:50.135181 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f83194-6511-40e8-b0fa-420cad763709 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:50.182454 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:50.190563 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dcaf8a-5ab3-4db4-9d80-fe70952bab59 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:50.225060 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88677969-deea-446f-b2fb-2c255f39a631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:50.225688 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88677969-deea-446f-b2fb-2c255f39a631 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:50.225967 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88677969-deea-446f-b2fb-2c255f39a631 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:50.226236 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88677969-deea-446f-b2fb-2c255f39a631 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:50.236650 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88677969-deea-446f-b2fb-2c255f39a631 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:50.238859 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f83194-6511-40e8-b0fa-420cad763709 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:50.241809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-88677969-deea-446f-b2fb-2c255f39a631 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:50:50.241809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:50.241809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:50.241809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:50.241809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:50.241809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:50.241809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:50.241809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:50.241809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:50.241809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:50.241809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:50.241809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:50.241809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:50.241809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:50.241809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:50.241809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:50.242940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:50.242940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:50.242940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:50.242940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:50.242940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:50.242940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:50.242940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:50.242940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:50.242940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:50.242940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:50.242940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:50.242940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:50.242940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:50.242940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:50.242940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:50.242940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:50.244503 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:50.244503 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:50.244503 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:50.244503 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:50.244503 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:50.244503 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:50.244503 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:50.244503 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:50.244503 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:50.244503 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:50.244503 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:50:50.244503 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:50.244503 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 286/573] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Aug 24 16:50:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:50.244503 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88677969-deea-446f-b2fb-2c255f39a631 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:50.278882 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28de687-17f8-441e-9d27-e6f08820bd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:50.279544 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28de687-17f8-441e-9d27-e6f08820bd99 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:50.279815 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28de687-17f8-441e-9d27-e6f08820bd99 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:50.280085 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28de687-17f8-441e-9d27-e6f08820bd99 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:50.287545 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28de687-17f8-441e-9d27-e6f08820bd99 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:50.288970 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28de687-17f8-441e-9d27-e6f08820bd99 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:50.299764 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-d28de687-17f8-441e-9d27-e6f08820bd99 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 16:50:50.299764 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:50.299764 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:50.299764 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:50.299764 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:50.299764 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:50.299764 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:50.299764 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:50.299764 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:50.299764 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:50.299764 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:50.299764 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:50.299764 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:50:50.299764 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:50:50.299764 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:50:50.299764 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:50:50.300720 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:50.300720 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:50.300720 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:50:50.300720 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:50:50.300720 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:50:50.300720 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:50:50.300720 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:50.300720 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:50.300720 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:50.300720 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:50.300720 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:50.300720 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:50.300720 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:50.300720 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:50.300720 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:50.300720 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:50.300720 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:50.300720 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:50.301696 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:50.301696 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:50.301696 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:50:50.301696 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:50:50.301696 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:50:50.301696 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:50:50.301696 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:50:50.301696 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:50:50.301696 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 16:50:50.301696 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:50.301696 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 288/574] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:50:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:50.302298 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:50.302371 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28de687-17f8-441e-9d27-e6f08820bd99 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:50.347650 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88677969-deea-446f-b2fb-2c255f39a631 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:50.385197 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c930578-ce14-4ec7-a151-00923d1b69e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:50.385730 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c930578-ce14-4ec7-a151-00923d1b69e3 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:50.386010 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c930578-ce14-4ec7-a151-00923d1b69e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:50.386285 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c930578-ce14-4ec7-a151-00923d1b69e3 None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:50.386954 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c930578-ce14-4ec7-a151-00923d1b69e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:50.387419 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c930578-ce14-4ec7-a151-00923d1b69e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:50.388946 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c930578-ce14-4ec7-a151-00923d1b69e3 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:50.397033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 287/575] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Aug 24 16:50:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:50.397655 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c930578-ce14-4ec7-a151-00923d1b69e3 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:50.409014 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28de687-17f8-441e-9d27-e6f08820bd99 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:50.416232 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:50.443706 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712d96b-4c72-4398-883f-e8348507f80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:50.444336 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712d96b-4c72-4398-883f-e8348507f80e None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:50.444627 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712d96b-4c72-4398-883f-e8348507f80e None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:50.444896 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2712d96b-4c72-4398-883f-e8348507f80e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:50.452880 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712d96b-4c72-4398-883f-e8348507f80e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:50.454341 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2712d96b-4c72-4398-883f-e8348507f80e None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:50.466032 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-2712d96b-4c72-4398-883f-e8348507f80e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:50:50.466032 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:50.466032 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:50.466032 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:50.466032 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:50.466032 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:50.466032 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:50.466032 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:50.466032 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:50.466032 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:50.466032 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:50.466032 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:50.466032 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:50:50.466032 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:50:50.466032 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:50:50.467012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:50:50.467012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:50.467012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:50.467012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:50.467012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:50.467012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:50.467012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:50.467012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:50.467012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:50.467012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:50.467012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:50.467012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:50.467012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:50.467012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:50.467012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:50.467012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:50.467012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:50.467965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:50:50.467965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:50:50.467965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:50:50.467965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:50:50.467965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:50:50.467965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:50:50.467965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:50:50.467965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:50.467965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 289/576] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:50:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:50.467965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712d96b-4c72-4398-883f-e8348507f80e None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:50.503268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c930578-ce14-4ec7-a151-00923d1b69e3 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:50.519888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:50.538549 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c48d03-4c89-4a26-8965-02526f5d04dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:50.539194 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c48d03-4c89-4a26-8965-02526f5d04dd None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:50.539476 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c48d03-4c89-4a26-8965-02526f5d04dd None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:50.539761 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c48d03-4c89-4a26-8965-02526f5d04dd None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:50.540737 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c48d03-4c89-4a26-8965-02526f5d04dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:50.541097 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c48d03-4c89-4a26-8965-02526f5d04dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:50.542510 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c48d03-4c89-4a26-8965-02526f5d04dd None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:50.556648 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 288/577] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:50.557633 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c48d03-4c89-4a26-8965-02526f5d04dd None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:50.568721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2712d96b-4c72-4398-883f-e8348507f80e None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:50.604606 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a41051-a89a-4a57-885d-d8490b4dc6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:50.605211 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a41051-a89a-4a57-885d-d8490b4dc6da None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:50.605483 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a41051-a89a-4a57-885d-d8490b4dc6da None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:50.605748 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a41051-a89a-4a57-885d-d8490b4dc6da None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:50.606404 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a41051-a89a-4a57-885d-d8490b4dc6da None admin] RBAC: Adding query filter params (name=service) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:50.606702 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a41051-a89a-4a57-885d-d8490b4dc6da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:50.608080 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a41051-a89a-4a57-885d-d8490b4dc6da None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:50.615985 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 290/578] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Aug 24 16:50:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:50.616772 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a41051-a89a-4a57-885d-d8490b4dc6da None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:50.645424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:50.658190 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c48d03-4c89-4a26-8965-02526f5d04dd None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:50.692838 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244fba2-8946-4123-8ed1-147e53dce68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:50.693447 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244fba2-8946-4123-8ed1-147e53dce68d None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:50.693724 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244fba2-8946-4123-8ed1-147e53dce68d None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:50.693992 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244fba2-8946-4123-8ed1-147e53dce68d None admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:50.694720 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244fba2-8946-4123-8ed1-147e53dce68d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:50.695024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244fba2-8946-4123-8ed1-147e53dce68d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:50.697295 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244fba2-8946-4123-8ed1-147e53dce68d None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:50.714471 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 289/579] 10.222.0.55 () {56 vars in 1137 bytes} [Wed Aug 24 16:50:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:50.715422 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244fba2-8946-4123-8ed1-147e53dce68d None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:50.721449 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a41051-a89a-4a57-885d-d8490b4dc6da None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:50.750806 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:50.756837 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66204fc-cb29-4784-a136-ef35a2c68886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:50.757529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66204fc-cb29-4784-a136-ef35a2c68886 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:50.757808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66204fc-cb29-4784-a136-ef35a2c68886 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:50.758081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66204fc-cb29-4784-a136-ef35a2c68886 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:50.769601 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66204fc-cb29-4784-a136-ef35a2c68886 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:50.771046 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66204fc-cb29-4784-a136-ef35a2c68886 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:50.786865 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-a66204fc-cb29-4784-a136-ef35a2c68886 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:50.786865 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:50.786865 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:50.786865 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:50.786865 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:50.786865 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:50.786865 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:50.786865 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:50.786865 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:50.786865 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:50.786865 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:50.786865 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:50.786865 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:50:50.786865 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:50:50.786865 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:50:50.786865 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:50:50.788020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:50.788020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:50.788020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:50.788020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:50.788020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:50.788020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:50.788020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:50.788020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:50.788020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:50.788020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:50.788020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:50.788020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:50.788020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:50.788020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:50.788020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:50.788020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:50.788020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:50:50.788918 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:50:50.788918 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:50.788918 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:50.788918 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 291/580] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:50.788918 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66204fc-cb29-4784-a136-ef35a2c68886 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:50.819630 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244fba2-8946-4123-8ed1-147e53dce68d None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:50.853508 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672b983-3d7b-467d-9236-953b86410be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:50.854102 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672b983-3d7b-467d-9236-953b86410be0 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:50.854393 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672b983-3d7b-467d-9236-953b86410be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:50.854669 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c672b983-3d7b-467d-9236-953b86410be0 None admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:50.855402 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c672b983-3d7b-467d-9236-953b86410be0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:50.855712 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c672b983-3d7b-467d-9236-953b86410be0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:50.857203 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c672b983-3d7b-467d-9236-953b86410be0 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:50.870322 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 290/581] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:50:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:50.871192 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672b983-3d7b-467d-9236-953b86410be0 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:50.877363 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:50.897004 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66204fc-cb29-4784-a136-ef35a2c68886 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:50.932269 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7c3fc-7277-4faa-800b-4da2c5ff0d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:50.932887 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7c3fc-7277-4faa-800b-4da2c5ff0d2f None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:50.933163 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7c3fc-7277-4faa-800b-4da2c5ff0d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:50.933428 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7c3fc-7277-4faa-800b-4da2c5ff0d2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:50.940401 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7c3fc-7277-4faa-800b-4da2c5ff0d2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:50.941855 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a7c3fc-7277-4faa-800b-4da2c5ff0d2f None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:50.952906 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-77a7c3fc-7277-4faa-800b-4da2c5ff0d2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:50:50.952906 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:50.952906 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:50.952906 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:50.952906 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:50.952906 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:50.952906 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:50.952906 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:50.952906 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:50.952906 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:50.952906 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:50.952906 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:50.952906 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:50:50.952906 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:50:50.952906 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:50:50.954030 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:50:50.954030 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:50.954030 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:50.954030 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:50.954030 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:50.954030 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:50.954030 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:50.954030 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:50.954030 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:50.954030 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:50.954030 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:50.954030 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:50.954030 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:50.954030 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:50.954030 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:50.954030 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:50.954030 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:50.955261 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:50:50.955261 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:50:50.955261 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:50:50.955261 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:50:50.955261 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:50:50.955261 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:50:50.955261 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:50:50.955261 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:50.958655 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 292/582] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:50:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:50.959492 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7c3fc-7277-4faa-800b-4da2c5ff0d2f None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:50.969805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:50.976160 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c672b983-3d7b-467d-9236-953b86410be0 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:51.011800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6fb76-649e-420d-8dc8-5abb5b247503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:51.012444 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6fb76-649e-420d-8dc8-5abb5b247503 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:51.012723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6fb76-649e-420d-8dc8-5abb5b247503 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:51.012993 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a6fb76-649e-420d-8dc8-5abb5b247503 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:51.023814 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a6fb76-649e-420d-8dc8-5abb5b247503 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:51.025333 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a6fb76-649e-420d-8dc8-5abb5b247503 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:51.040803 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-c3a6fb76-649e-420d-8dc8-5abb5b247503 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:51.040803 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:51.040803 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:51.040803 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:51.040803 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:51.040803 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:51.040803 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:51.040803 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:51.040803 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:51.040803 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:51.040803 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:51.040803 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:51.040803 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:50:51.040803 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:50:51.040803 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:50:51.040803 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:50:51.042415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:51.042415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:51.042415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:51.042415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:51.042415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:51.042415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:51.042415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:51.042415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:51.042415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:51.042415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:51.042415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:51.042415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:51.042415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:51.042415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:51.042415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:51.042415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:51.042415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:50:51.043343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:50:51.043343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:51.043343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:51.043343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 291/583] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:51.043343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6fb76-649e-420d-8dc8-5abb5b247503 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:51.070696 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a7c3fc-7277-4faa-800b-4da2c5ff0d2f None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:51.104242 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f83594-5a43-47e1-a971-be9b37445139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:51.104876 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f83594-5a43-47e1-a971-be9b37445139 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:51.105151 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f83594-5a43-47e1-a971-be9b37445139 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:51.105420 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f83594-5a43-47e1-a971-be9b37445139 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:51.114011 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:51.116125 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f83594-5a43-47e1-a971-be9b37445139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:51.117563 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f83594-5a43-47e1-a971-be9b37445139 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:51.131458 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-c9f83594-5a43-47e1-a971-be9b37445139 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:51.131458 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:51.131458 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:51.131458 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:51.131458 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:51.131458 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:51.131458 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:51.131458 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:51.131458 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:51.131458 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:51.131458 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:51.131458 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:51.131458 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:50:51.131458 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:50:51.131458 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:50:51.131458 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:50:51.132443 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:51.132443 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:51.132443 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:51.132443 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:51.132443 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:51.132443 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:51.132443 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:51.132443 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:51.132443 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:51.132443 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:51.132443 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:51.132443 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:51.132443 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:51.132443 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:51.132443 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:51.132443 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:51.132443 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:50:51.133326 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:50:51.133326 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:51.133326 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:51.137940 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 293/584] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:51.138750 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f83594-5a43-47e1-a971-be9b37445139 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:51.142932 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a6fb76-649e-420d-8dc8-5abb5b247503 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:51.176982 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ca34e-655f-4086-bb7e-073b56efb52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:51.177507 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ca34e-655f-4086-bb7e-073b56efb52d None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:51.177782 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ca34e-655f-4086-bb7e-073b56efb52d None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:51.178072 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ca34e-655f-4086-bb7e-073b56efb52d None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:51.178705 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ca34e-655f-4086-bb7e-073b56efb52d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:51.179002 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ca34e-655f-4086-bb7e-073b56efb52d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:51.180416 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ca34e-655f-4086-bb7e-073b56efb52d None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:51.192219 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 292/585] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:51.193111 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ca34e-655f-4086-bb7e-073b56efb52d None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:51.201558 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:51.242185 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f83594-5a43-47e1-a971-be9b37445139 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:51.281752 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94722e-c481-4031-a0db-237d0e3522c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:51.282371 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94722e-c481-4031-a0db-237d0e3522c6 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:51.282652 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94722e-c481-4031-a0db-237d0e3522c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:51.282923 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c94722e-c481-4031-a0db-237d0e3522c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:51.283760 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94722e-c481-4031-a0db-237d0e3522c6 None admin] RBAC: Adding query filter params (role.id=494c75ed8f864e3b955fdb043e96c675, scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642, user.id=c067bc2d84b741d08ac47e40adae4b4f) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:51.284071 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94722e-c481-4031-a0db-237d0e3522c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:51.285528 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c94722e-c481-4031-a0db-237d0e3522c6 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:51.290998 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 294/586] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:50:51 2022] GET /identity/v3/role_assignments?user.id=c067bc2d84b741d08ac47e40adae4b4f&scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642&role.id=494c75ed8f864e3b955fdb043e96c675 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:51.291841 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94722e-c481-4031-a0db-237d0e3522c6 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:51.294954 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ca34e-655f-4086-bb7e-073b56efb52d None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:51.336987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82822180-69a1-4ba1-8847-423ed04b4063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:51.337717 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82822180-69a1-4ba1-8847-423ed04b4063 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:51.337817 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82822180-69a1-4ba1-8847-423ed04b4063 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:51.338162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82822180-69a1-4ba1-8847-423ed04b4063 None admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:51.338961 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82822180-69a1-4ba1-8847-423ed04b4063 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:51.339366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82822180-69a1-4ba1-8847-423ed04b4063 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:51.340886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82822180-69a1-4ba1-8847-423ed04b4063 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:51.354284 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 293/587] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:50:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:51.355356 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82822180-69a1-4ba1-8847-423ed04b4063 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:51.374453 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:51.424318 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c94722e-c481-4031-a0db-237d0e3522c6 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:51.434912 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:51.467967 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce41fcd-184e-4b0b-af5b-429a91dde313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:51.468670 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce41fcd-184e-4b0b-af5b-429a91dde313 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:51.469009 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce41fcd-184e-4b0b-af5b-429a91dde313 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:51.469342 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce41fcd-184e-4b0b-af5b-429a91dde313 None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:51.470063 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce41fcd-184e-4b0b-af5b-429a91dde313 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:51.470424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce41fcd-184e-4b0b-af5b-429a91dde313 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:51.471877 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce41fcd-184e-4b0b-af5b-429a91dde313 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:51.481021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82822180-69a1-4ba1-8847-423ed04b4063 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:51.484994 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 295/588] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:51.485818 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce41fcd-184e-4b0b-af5b-429a91dde313 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:51.517825 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bc94d-62d0-429f-b9bd-16fa83a02a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:51.518425 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bc94d-62d0-429f-b9bd-16fa83a02a7d None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:51.518700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bc94d-62d0-429f-b9bd-16fa83a02a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:51.518967 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bc94d-62d0-429f-b9bd-16fa83a02a7d None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:51.519641 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169bc94d-62d0-429f-b9bd-16fa83a02a7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:51.519938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169bc94d-62d0-429f-b9bd-16fa83a02a7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:51.521288 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169bc94d-62d0-429f-b9bd-16fa83a02a7d None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:51.537762 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 294/589] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:51.537762 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bc94d-62d0-429f-b9bd-16fa83a02a7d None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:51.601302 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce41fcd-184e-4b0b-af5b-429a91dde313 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:51.620671 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:51.638154 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bc94d-62d0-429f-b9bd-16fa83a02a7d None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:51.639168 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dfb58-c69c-4e07-b5f8-31d5091e181e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:51.639806 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dfb58-c69c-4e07-b5f8-31d5091e181e None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:51.643934 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dfb58-c69c-4e07-b5f8-31d5091e181e None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:51.643934 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02dfb58-c69c-4e07-b5f8-31d5091e181e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:51.647756 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02dfb58-c69c-4e07-b5f8-31d5091e181e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:51.649251 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02dfb58-c69c-4e07-b5f8-31d5091e181e None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:51.662033 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-b02dfb58-c69c-4e07-b5f8-31d5091e181e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 16:50:51.662033 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:51.662033 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:51.662033 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:51.662033 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:51.662033 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:51.662033 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:51.662033 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:51.662033 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:51.662033 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:51.662033 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:51.662033 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:51.662033 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:50:51.662033 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:50:51.662033 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:50:51.662033 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:50:51.663314 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:51.663314 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:51.663314 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:50:51.663314 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:50:51.663314 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:50:51.663314 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:50:51.663314 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:51.663314 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:51.663314 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:51.663314 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:51.663314 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:51.663314 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:51.663314 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:51.663314 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:51.663314 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:51.663314 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:51.663314 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:51.663314 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:51.664618 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:51.664618 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:51.664618 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:50:51.664618 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:50:51.664618 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:50:51.664618 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:50:51.664618 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:50:51.664618 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:50:51.664618 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 16:50:51.664618 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:51.664618 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 296/590] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Aug 24 16:50:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:51.664618 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dfb58-c69c-4e07-b5f8-31d5091e181e None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:51.671811 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:51.680284 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0f312-a15a-46ee-994a-56b236b04154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:51.681644 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0f312-a15a-46ee-994a-56b236b04154 None admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:51.686304 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0f312-a15a-46ee-994a-56b236b04154 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:51.686304 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0f312-a15a-46ee-994a-56b236b04154 None admin] PATH_INFO: `/v3/projects/ebae6aa9c60343e6ba0ff1cd62619642/users/28a1c617fc264b118e61f2a97ecb3f39/roles/494c75ed8f864e3b955fdb043e96c675` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:51.698069 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0f312-a15a-46ee-994a-56b236b04154 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebae6aa9c60343e6ba0ff1cd62619642, user_id=28a1c617fc264b118e61f2a97ecb3f39, role_id=494c75ed8f864e3b955fdb043e96c675)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:51.699607 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0f312-a15a-46ee-994a-56b236b04154 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:51.767477 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 295/591] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Aug 24 16:50:51 2022] PUT /identity/v3/projects/ebae6aa9c60343e6ba0ff1cd62619642/users/28a1c617fc264b118e61f2a97ecb3f39/roles/494c75ed8f864e3b955fdb043e96c675 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:50:51.768572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0f312-a15a-46ee-994a-56b236b04154 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:51.777553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02dfb58-c69c-4e07-b5f8-31d5091e181e None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:51.822238 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50265ded-ff77-4149-9d1c-427eb3876fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:51.823334 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50265ded-ff77-4149-9d1c-427eb3876fcc None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:51.823812 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50265ded-ff77-4149-9d1c-427eb3876fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:51.824310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50265ded-ff77-4149-9d1c-427eb3876fcc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:51.833191 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50265ded-ff77-4149-9d1c-427eb3876fcc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:51.835081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50265ded-ff77-4149-9d1c-427eb3876fcc None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:51.850276 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-50265ded-ff77-4149-9d1c-427eb3876fcc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 16:50:51.850276 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:51.850276 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:51.850276 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:51.850276 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:51.850276 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:51.850276 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:51.850276 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:51.850276 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:51.850276 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:51.850276 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:51.850276 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:51.850276 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:50:51.850276 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:50:51.850276 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:50:51.850276 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:50:51.851313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:51.851313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:51.851313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:50:51.851313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:50:51.851313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:50:51.851313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:50:51.851313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:51.851313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:51.851313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:51.851313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:51.851313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:51.851313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:51.851313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:51.851313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:51.851313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:51.851313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:51.851313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:51.851313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:51.852298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:51.852298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:51.852298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:50:51.852298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:50:51.852298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:50:51.852298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:50:51.852298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:50:51.852298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:50:51.852298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 16:50:51.852298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:51.858609 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 297/592] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:50:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:51.859915 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50265ded-ff77-4149-9d1c-427eb3876fcc None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:51.905580 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:51.913443 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0f312-a15a-46ee-994a-56b236b04154 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:51.957344 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958503b-c35d-44ff-8334-9f22ae9e17ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:51.958336 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958503b-c35d-44ff-8334-9f22ae9e17ab None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:51.958761 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958503b-c35d-44ff-8334-9f22ae9e17ab None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:51.959268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958503b-c35d-44ff-8334-9f22ae9e17ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:51.969838 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4958503b-c35d-44ff-8334-9f22ae9e17ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:51.971735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4958503b-c35d-44ff-8334-9f22ae9e17ab None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:51.983165 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50265ded-ff77-4149-9d1c-427eb3876fcc None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:51.991381 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-4958503b-c35d-44ff-8334-9f22ae9e17ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:50:51.991381 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:51.991381 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:51.991381 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:51.991381 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:51.991381 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:51.991381 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:51.991381 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:51.991381 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:51.991381 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:51.991381 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:51.991381 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:51.991381 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:50:51.991381 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:50:51.991381 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:50:51.992282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:50:51.992282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:51.992282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:51.992282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:51.992282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:51.992282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:51.992282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:51.992282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:51.992282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:51.992282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:51.992282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:51.992282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:51.992282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:51.992282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:51.992282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:51.992282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:51.992282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:51.994087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:50:51.994087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:50:51.994087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:50:51.994087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:50:51.994087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:50:51.994087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:50:51.994087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:50:51.994087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:51.994087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 296/593] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:50:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:51.994581 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958503b-c35d-44ff-8334-9f22ae9e17ab None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:52.040936 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:52.041557 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5be3f2-e3d6-48c8-bf46-192083387c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:52.042001 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5be3f2-e3d6-48c8-bf46-192083387c08 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:52.042284 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5be3f2-e3d6-48c8-bf46-192083387c08 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:52.042559 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5be3f2-e3d6-48c8-bf46-192083387c08 None admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:52.043393 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5be3f2-e3d6-48c8-bf46-192083387c08 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:52.043718 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5be3f2-e3d6-48c8-bf46-192083387c08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:52.045316 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5be3f2-e3d6-48c8-bf46-192083387c08 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:52.071709 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 298/594] 10.222.0.55 () {56 vars in 1139 bytes} [Wed Aug 24 16:50:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:52.072968 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5be3f2-e3d6-48c8-bf46-192083387c08 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:52.120105 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958503b-c35d-44ff-8334-9f22ae9e17ab None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:52.191031 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61100834-d1fb-4c05-ab5c-486d8208e538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:52.192228 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61100834-d1fb-4c05-ab5c-486d8208e538 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:52.192601 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61100834-d1fb-4c05-ab5c-486d8208e538 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:52.193135 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61100834-d1fb-4c05-ab5c-486d8208e538 None admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:52.193863 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61100834-d1fb-4c05-ab5c-486d8208e538 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:52.194329 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:52.194803 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61100834-d1fb-4c05-ab5c-486d8208e538 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:52.198404 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61100834-d1fb-4c05-ab5c-486d8208e538 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:52.202915 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5be3f2-e3d6-48c8-bf46-192083387c08 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:52.226415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 297/595] 10.222.0.55 () {56 vars in 1137 bytes} [Wed Aug 24 16:50:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:52.226415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61100834-d1fb-4c05-ab5c-486d8208e538 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:52.254133 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758f742-ac56-4234-97c7-2622e211877f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:52.255142 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758f742-ac56-4234-97c7-2622e211877f None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:52.255745 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758f742-ac56-4234-97c7-2622e211877f None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:52.256326 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d758f742-ac56-4234-97c7-2622e211877f None admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:52.257212 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758f742-ac56-4234-97c7-2622e211877f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:52.257725 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758f742-ac56-4234-97c7-2622e211877f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:52.260275 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d758f742-ac56-4234-97c7-2622e211877f None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:52.279232 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 299/596] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:50:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:52.280363 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758f742-ac56-4234-97c7-2622e211877f None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:52.333105 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:52.340438 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61100834-d1fb-4c05-ab5c-486d8208e538 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:52.388257 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d282d-817c-449d-be9e-ba9cb60bc568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:52.389474 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d282d-817c-449d-be9e-ba9cb60bc568 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:52.390106 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d282d-817c-449d-be9e-ba9cb60bc568 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:52.390481 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d282d-817c-449d-be9e-ba9cb60bc568 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:52.406336 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d282d-817c-449d-be9e-ba9cb60bc568 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:52.408447 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d282d-817c-449d-be9e-ba9cb60bc568 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:52.412401 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d758f742-ac56-4234-97c7-2622e211877f None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:52.428337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-1f7d282d-817c-449d-be9e-ba9cb60bc568 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:52.428337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:52.428337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:52.428337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:52.428337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:52.428337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:52.428337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:52.428337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:52.428337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:52.428337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:52.428337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:52.428337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:52.428337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:50:52.428337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:50:52.428337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:50:52.428337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:50:52.429375 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:52.429375 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:52.429375 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:52.429375 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:52.429375 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:52.429375 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:52.429375 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:52.429375 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:52.429375 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:52.429375 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:52.429375 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:52.429375 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:52.429375 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:52.429375 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:52.429375 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:52.429375 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:52.429375 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:50:52.430819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:50:52.430819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:52.430819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:52.430819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 298/597] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:52.435728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d282d-817c-449d-be9e-ba9cb60bc568 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:52.458917 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f3786-df67-4b3a-967e-5ccf273496ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:52.459589 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f3786-df67-4b3a-967e-5ccf273496ae None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:52.459864 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f3786-df67-4b3a-967e-5ccf273496ae None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:52.460667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4f3786-df67-4b3a-967e-5ccf273496ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:52.476618 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f3786-df67-4b3a-967e-5ccf273496ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:52.478845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4f3786-df67-4b3a-967e-5ccf273496ae None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:52.496586 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-1e4f3786-df67-4b3a-967e-5ccf273496ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:52.496586 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:52.496586 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:52.496586 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:52.496586 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:52.496586 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:52.496586 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:52.496586 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:52.496586 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:52.496586 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:52.496586 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:52.496586 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:52.496586 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:50:52.496586 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:50:52.496586 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:50:52.496586 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:50:52.498615 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:52.498615 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:52.498615 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:52.498615 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:52.498615 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:52.498615 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:52.498615 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:52.498615 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:52.498615 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:52.498615 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:52.498615 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:52.498615 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:52.498615 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:52.498615 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:52.498615 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:52.498615 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:52.498615 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:50:52.500540 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:50:52.500540 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:52.500540 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:52.500540 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 300/598] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:52.500540 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f3786-df67-4b3a-967e-5ccf273496ae None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:52.513651 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:52.564491 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d282d-817c-449d-be9e-ba9cb60bc568 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:52.602536 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92dc1b-8443-459e-a5ea-0f202355f42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:52.603828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92dc1b-8443-459e-a5ea-0f202355f42a None admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:52.604251 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92dc1b-8443-459e-a5ea-0f202355f42a None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:52.604764 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92dc1b-8443-459e-a5ea-0f202355f42a None admin] PATH_INFO: `/v3/projects/ebae6aa9c60343e6ba0ff1cd62619642/users/3a6aad0e9f5f4a0b9578a31082e726cc/roles/494c75ed8f864e3b955fdb043e96c675` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:52.610954 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4f3786-df67-4b3a-967e-5ccf273496ae None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:52.622556 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92dc1b-8443-459e-a5ea-0f202355f42a None admin] RBAC: Authorizing `identity:create_grant(project_id=ebae6aa9c60343e6ba0ff1cd62619642, user_id=3a6aad0e9f5f4a0b9578a31082e726cc, role_id=494c75ed8f864e3b955fdb043e96c675)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:52.624392 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92dc1b-8443-459e-a5ea-0f202355f42a None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:52.628023 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:52.647595 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2735cb-d1df-43b5-8fed-9b1447c9d294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:52.648210 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2735cb-d1df-43b5-8fed-9b1447c9d294 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:52.648491 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2735cb-d1df-43b5-8fed-9b1447c9d294 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:52.648766 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2735cb-d1df-43b5-8fed-9b1447c9d294 None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:52.649594 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2735cb-d1df-43b5-8fed-9b1447c9d294 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:52.649902 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2735cb-d1df-43b5-8fed-9b1447c9d294 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:52.651304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2735cb-d1df-43b5-8fed-9b1447c9d294 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:52.663813 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 301/599] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:52.664430 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2735cb-d1df-43b5-8fed-9b1447c9d294 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:52.699138 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 299/600] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Aug 24 16:50:52 2022] PUT /identity/v3/projects/ebae6aa9c60343e6ba0ff1cd62619642/users/3a6aad0e9f5f4a0b9578a31082e726cc/roles/494c75ed8f864e3b955fdb043e96c675 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:50:52.699138 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92dc1b-8443-459e-a5ea-0f202355f42a None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:52.811152 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:52.896698 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2735cb-d1df-43b5-8fed-9b1447c9d294 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:52.913340 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92dc1b-8443-459e-a5ea-0f202355f42a None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:52.950503 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bb519-6958-4207-a1c1-cda35f7c2ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:52.951406 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bb519-6958-4207-a1c1-cda35f7c2ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:52.951749 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bb519-6958-4207-a1c1-cda35f7c2ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:52.952123 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bb519-6958-4207-a1c1-cda35f7c2ec0 None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:52.953021 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bb519-6958-4207-a1c1-cda35f7c2ec0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:52.953393 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bb519-6958-4207-a1c1-cda35f7c2ec0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:52.955953 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bb519-6958-4207-a1c1-cda35f7c2ec0 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:52.958564 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0336cd-b18e-4464-bb3b-1100c7e31c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:52.960133 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0336cd-b18e-4464-bb3b-1100c7e31c11 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:52.960612 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0336cd-b18e-4464-bb3b-1100c7e31c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:52.961066 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0336cd-b18e-4464-bb3b-1100c7e31c11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:52.978598 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0336cd-b18e-4464-bb3b-1100c7e31c11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:52.979291 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 302/601] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:52.980901 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0336cd-b18e-4464-bb3b-1100c7e31c11 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:52.982592 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bb519-6958-4207-a1c1-cda35f7c2ec0 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:52.997389 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-be0336cd-b18e-4464-bb3b-1100c7e31c11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:50:52.997389 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:52.997389 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:52.997389 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:52.997389 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:52.997389 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:52.997389 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:52.997389 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:52.997389 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:52.997389 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:52.997389 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:52.997389 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:52.997389 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:50:52.997389 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:50:52.997389 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:50:52.998373 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:50:52.998373 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:52.998373 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:52.998373 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:52.998373 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:52.998373 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:52.998373 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:52.998373 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:52.998373 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:52.998373 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:52.998373 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:52.998373 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:52.998373 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:52.998373 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:52.998373 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:52.998373 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:52.998373 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:52.999320 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:50:52.999320 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:50:52.999320 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:50:52.999320 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:50:52.999320 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:50:52.999320 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:50:52.999320 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:50:52.999320 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:53.010410 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 300/602] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:50:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:53.010410 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0336cd-b18e-4464-bb3b-1100c7e31c11 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:53.134338 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:53.199595 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bb519-6958-4207-a1c1-cda35f7c2ec0 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:53.230007 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:53.242467 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be409d-3164-4ced-8a1c-e69b8aef41fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:53.245881 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be409d-3164-4ced-8a1c-e69b8aef41fd None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:53.246345 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be409d-3164-4ced-8a1c-e69b8aef41fd None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:53.246630 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73be409d-3164-4ced-8a1c-e69b8aef41fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:53.259474 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0336cd-b18e-4464-bb3b-1100c7e31c11 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:53.259856 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be409d-3164-4ced-8a1c-e69b8aef41fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:53.261198 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73be409d-3164-4ced-8a1c-e69b8aef41fd None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:53.274512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-73be409d-3164-4ced-8a1c-e69b8aef41fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:50:53.274512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:53.274512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:53.274512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:53.274512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:53.274512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:53.274512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:53.274512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:53.274512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:53.274512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:53.274512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:53.274512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:53.274512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:50:53.274512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:50:53.274512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:50:53.275657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:50:53.275657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:53.275657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:53.275657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:53.275657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:53.275657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:53.275657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:53.275657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:53.275657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:53.275657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:53.275657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:53.275657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:53.275657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:53.275657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:53.275657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:53.275657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:53.275657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:53.277179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:50:53.277179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:50:53.277179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:50:53.277179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:50:53.277179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:50:53.277179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:50:53.277179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:50:53.277179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:53.277179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 303/603] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:50:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:50:53.283499 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be409d-3164-4ced-8a1c-e69b8aef41fd None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:53.335687 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43a64b-4874-4c28-9719-816b09f2c7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:53.336311 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43a64b-4874-4c28-9719-816b09f2c7e2 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:53.337114 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43a64b-4874-4c28-9719-816b09f2c7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:53.338046 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43a64b-4874-4c28-9719-816b09f2c7e2 None admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:53.338849 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d43a64b-4874-4c28-9719-816b09f2c7e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:53.339182 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d43a64b-4874-4c28-9719-816b09f2c7e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:53.341743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d43a64b-4874-4c28-9719-816b09f2c7e2 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:53.357755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 301/604] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:50:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:53.359624 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17228d-3ffa-4bad-9122-0ccbc54c6084 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:53.359970 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17228d-3ffa-4bad-9122-0ccbc54c6084 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:53.360254 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17228d-3ffa-4bad-9122-0ccbc54c6084 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:53.366088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 302/605] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:53.366088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17228d-3ffa-4bad-9122-0ccbc54c6084 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:53.439635 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73be409d-3164-4ced-8a1c-e69b8aef41fd None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:53.483528 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85705cdd-3590-4b00-8a89-4bf0b032a496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:53.484200 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85705cdd-3590-4b00-8a89-4bf0b032a496 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:53.484478 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85705cdd-3590-4b00-8a89-4bf0b032a496 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:53.484841 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85705cdd-3590-4b00-8a89-4bf0b032a496 None admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:53.485489 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85705cdd-3590-4b00-8a89-4bf0b032a496 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:53.485797 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85705cdd-3590-4b00-8a89-4bf0b032a496 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:53.487356 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85705cdd-3590-4b00-8a89-4bf0b032a496 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:53.506367 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 304/606] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:50:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:50:53.507899 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f633edb-9b49-464f-8d54-723057e43f3b None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:53.508191 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f633edb-9b49-464f-8d54-723057e43f3b None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:53.508635 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f633edb-9b49-464f-8d54-723057e43f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:53.509220 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17228d-3ffa-4bad-9122-0ccbc54c6084 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:53.530279 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-8f633edb-9b49-464f-8d54-723057e43f3b None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:53.531523 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-8f633edb-9b49-464f-8d54-723057e43f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:53.537823 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:53.565594 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f4d00-a7b9-449c-9ac6-50882989e4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:53.566871 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f4d00-a7b9-449c-9ac6-50882989e4b8 None admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:53.567417 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f4d00-a7b9-449c-9ac6-50882989e4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:53.568260 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f4d00-a7b9-449c-9ac6-50882989e4b8 None admin] PATH_INFO: `/v3/projects/ebae6aa9c60343e6ba0ff1cd62619642/users/88ce8df89a96460ca046f2972321bceb/roles/494c75ed8f864e3b955fdb043e96c675` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:53.585956 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:53.596478 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f4d00-a7b9-449c-9ac6-50882989e4b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebae6aa9c60343e6ba0ff1cd62619642, user_id=88ce8df89a96460ca046f2972321bceb, role_id=494c75ed8f864e3b955fdb043e96c675)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:53.599431 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f4d00-a7b9-449c-9ac6-50882989e4b8 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:53.631216 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 305/607] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:53.631216 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f633edb-9b49-464f-8d54-723057e43f3b None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:53.704161 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 303/608] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Aug 24 16:50:53 2022] PUT /identity/v3/projects/ebae6aa9c60343e6ba0ff1cd62619642/users/88ce8df89a96460ca046f2972321bceb/roles/494c75ed8f864e3b955fdb043e96c675 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:50:53.781448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f633edb-9b49-464f-8d54-723057e43f3b None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:53.838193 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175ea91c-30eb-4ac0-8081-870c6e3a8867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:53.839165 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ea91c-30eb-4ac0-8081-870c6e3a8867 None admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:53.839586 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ea91c-30eb-4ac0-8081-870c6e3a8867 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:53.840001 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175ea91c-30eb-4ac0-8081-870c6e3a8867 None admin] PATH_INFO: `/v3/projects/ebae6aa9c60343e6ba0ff1cd62619642/users/eb911b8748844a6488811ca03cb8d344/roles/494c75ed8f864e3b955fdb043e96c675` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:53.873165 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ea91c-30eb-4ac0-8081-870c6e3a8867 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebae6aa9c60343e6ba0ff1cd62619642, user_id=eb911b8748844a6488811ca03cb8d344, role_id=494c75ed8f864e3b955fdb043e96c675)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:53.875018 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175ea91c-30eb-4ac0-8081-870c6e3a8867 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:53.965839 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f4d00-a7b9-449c-9ac6-50882989e4b8 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:53.967603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 306/609] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Aug 24 16:50:53 2022] PUT /identity/v3/projects/ebae6aa9c60343e6ba0ff1cd62619642/users/eb911b8748844a6488811ca03cb8d344/roles/494c75ed8f864e3b955fdb043e96c675 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:50:54.060203 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20947aa-714f-4345-bfc5-8fa4a1c05917 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:54.061003 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20947aa-714f-4345-bfc5-8fa4a1c05917 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:54.061494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20947aa-714f-4345-bfc5-8fa4a1c05917 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:54.063823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 307/610] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:54.077185 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140b9fc-79a4-44f8-b51c-e079b17c0141 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:54.077852 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140b9fc-79a4-44f8-b51c-e079b17c0141 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:54.078412 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3140b9fc-79a4-44f8-b51c-e079b17c0141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:54.096621 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f4d00-a7b9-449c-9ac6-50882989e4b8 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:54.112396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-3140b9fc-79a4-44f8-b51c-e079b17c0141 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:54.114059 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-3140b9fc-79a4-44f8-b51c-e079b17c0141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:54.143268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13d055-a7e2-405b-b8c0-344baf69d230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:54.143268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13d055-a7e2-405b-b8c0-344baf69d230 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:54.143268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13d055-a7e2-405b-b8c0-344baf69d230 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:54.143268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f13d055-a7e2-405b-b8c0-344baf69d230 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:54.154692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:54.156440 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f13d055-a7e2-405b-b8c0-344baf69d230 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:54.161430 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-7f13d055-a7e2-405b-b8c0-344baf69d230 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:50:54.161430 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:54.161430 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:54.161430 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:54.161430 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:54.161430 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:54.161430 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:54.161430 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:54.161430 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:54.161430 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:54.161430 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:54.161430 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:54.161430 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:54.161430 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:54.161430 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:54.161430 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:54.162494 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:54.162494 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:54.162494 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:54.162494 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:54.162494 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:54.162494 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:54.162494 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:54.162494 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:54.162494 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:54.162494 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:54.162494 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:54.162494 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:54.162494 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:54.162494 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:54.162494 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:54.162494 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:54.163364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:54.163364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:54.163364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:54.163364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:54.163364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:54.163364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:54.163364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:54.163364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:54.163364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:54.163364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:54.163364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:50:54.163364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:54.163364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 304/611] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Aug 24 16:50:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:50:54.170403 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13d055-a7e2-405b-b8c0-344baf69d230 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:54.203008 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:54.225035 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 308/612] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:50:54.296185 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f13d055-a7e2-405b-b8c0-344baf69d230 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:54.349984 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43dbd63-3a01-43d6-ad54-dfae1b1821ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:54.351357 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dbd63-3a01-43d6-ad54-dfae1b1821ae None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:54.353965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dbd63-3a01-43d6-ad54-dfae1b1821ae None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:54.354725 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dbd63-3a01-43d6-ad54-dfae1b1821ae None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:54.355903 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43dbd63-3a01-43d6-ad54-dfae1b1821ae None admin] RBAC: Adding query filter params (name=service) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:54.356406 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43dbd63-3a01-43d6-ad54-dfae1b1821ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:54.357991 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43dbd63-3a01-43d6-ad54-dfae1b1821ae None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:54.374695 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 305/613] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Aug 24 16:50:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:54.380735 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140b9fc-79a4-44f8-b51c-e079b17c0141 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:54.498505 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3140b9fc-79a4-44f8-b51c-e079b17c0141 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:54.517651 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43dbd63-3a01-43d6-ad54-dfae1b1821ae None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:54.543093 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae05e2-1b39-42dd-8a74-9dbda339177f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:54.544025 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae05e2-1b39-42dd-8a74-9dbda339177f None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:54.545363 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae05e2-1b39-42dd-8a74-9dbda339177f None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:54.545825 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae05e2-1b39-42dd-8a74-9dbda339177f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:54.571483 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae05e2-1b39-42dd-8a74-9dbda339177f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:54.573190 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae05e2-1b39-42dd-8a74-9dbda339177f None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:54.599154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-6fae05e2-1b39-42dd-8a74-9dbda339177f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:54.599154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:54.599154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:54.599154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:54.599154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:54.599154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:54.599154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:54.599154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:54.599154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:54.599154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:54.599154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:54.599154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:54.599154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:50:54.599154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:50:54.599154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:50:54.599154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:50:54.600207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:54.600207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:54.600207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:54.600207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:54.600207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:54.600207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:54.600207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:54.600207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:54.600207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:54.600207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:54.600207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:54.600207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:54.600207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:54.600207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:54.600207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:54.600207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:54.600207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:50:54.601111 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:50:54.601111 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:54.601111 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:54.602853 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 309/614] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:54.612177 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae05e2-1b39-42dd-8a74-9dbda339177f None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:54.639357 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:54.655674 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:54.669713 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43dbd63-3a01-43d6-ad54-dfae1b1821ae None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:54.721624 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9eff6f-2c0c-486d-8404-de346df93b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:54.722537 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9eff6f-2c0c-486d-8404-de346df93b2d None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:54.722957 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9eff6f-2c0c-486d-8404-de346df93b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:54.723388 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9eff6f-2c0c-486d-8404-de346df93b2d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:54.743679 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9eff6f-2c0c-486d-8404-de346df93b2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:54.756728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-dd9eff6f-2c0c-486d-8404-de346df93b2d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:50:54.756728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:54.756728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:54.756728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:54.756728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:54.756728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:54.756728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:54.756728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:54.756728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:54.756728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:54.756728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:54.756728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:54.756728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:54.756728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:54.756728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:54.756728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:54.757881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:54.757881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:54.757881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:54.757881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:54.757881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:54.757881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:54.757881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:54.757881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:54.757881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:54.757881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:54.757881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:54.757881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:54.757881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:54.757881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:54.757881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:54.757881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:54.759515 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:54.759515 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:54.759515 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:54.759515 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:54.759515 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:54.759515 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:54.759515 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:54.759515 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:54.759515 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:54.759515 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:54.759515 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:50:54.759515 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:54.761454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 306/615] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Aug 24 16:50:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:50:54.768650 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9eff6f-2c0c-486d-8404-de346df93b2d None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:54.769740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae05e2-1b39-42dd-8a74-9dbda339177f None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:54.831860 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d0e3d-b9c7-4fd8-8c3b-accf40e04c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:54.832488 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d0e3d-b9c7-4fd8-8c3b-accf40e04c17 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:54.832767 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d0e3d-b9c7-4fd8-8c3b-accf40e04c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:54.833045 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d0e3d-b9c7-4fd8-8c3b-accf40e04c17 None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:54.837523 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d0e3d-b9c7-4fd8-8c3b-accf40e04c17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:54.837523 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d0e3d-b9c7-4fd8-8c3b-accf40e04c17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:54.837523 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d0e3d-b9c7-4fd8-8c3b-accf40e04c17 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:54.856257 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 310/616] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:54.860703 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d0e3d-b9c7-4fd8-8c3b-accf40e04c17 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:54.963584 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9eff6f-2c0c-486d-8404-de346df93b2d None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:54.965143 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:55.026377 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d0e3d-b9c7-4fd8-8c3b-accf40e04c17 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:55.041170 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7a944-f2f2-4f58-994d-958641de612a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:55.041794 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7a944-f2f2-4f58-994d-958641de612a None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:55.042067 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7a944-f2f2-4f58-994d-958641de612a None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:55.042333 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef7a944-f2f2-4f58-994d-958641de612a None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:55.043011 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef7a944-f2f2-4f58-994d-958641de612a None admin] RBAC: Adding query filter params (name=service) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:55.043338 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef7a944-f2f2-4f58-994d-958641de612a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:55.044793 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef7a944-f2f2-4f58-994d-958641de612a None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:55.061002 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 307/617] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Aug 24 16:50:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:50:55.066422 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7a944-f2f2-4f58-994d-958641de612a None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:55.091523 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:55.107600 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba61530-0a2f-4624-8a78-916e1935fbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:55.108420 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba61530-0a2f-4624-8a78-916e1935fbf9 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:55.108702 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba61530-0a2f-4624-8a78-916e1935fbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:55.108974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba61530-0a2f-4624-8a78-916e1935fbf9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:55.124058 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba61530-0a2f-4624-8a78-916e1935fbf9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:55.126356 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba61530-0a2f-4624-8a78-916e1935fbf9 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:55.152995 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-4ba61530-0a2f-4624-8a78-916e1935fbf9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:50:55.152995 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:55.152995 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:55.152995 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:55.152995 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:55.152995 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:55.152995 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:55.152995 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:55.152995 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:55.152995 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:55.152995 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:55.152995 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:55.152995 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:50:55.152995 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:50:55.152995 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:50:55.152995 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:50:55.154135 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:55.154135 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:55.154135 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:50:55.154135 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:50:55.154135 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:50:55.154135 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:50:55.154135 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:55.154135 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:55.154135 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:55.154135 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:55.154135 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:55.154135 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:55.154135 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:55.154135 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:55.154135 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:55.154135 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:55.154135 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:55.154135 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:55.155317 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:55.155317 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:55.155317 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:50:55.155317 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:50:55.155317 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:50:55.155317 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:50:55.155317 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:50:55.155317 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:50:55.155317 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:50:55.155317 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:55.155978 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 311/618] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:50:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:55.159793 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba61530-0a2f-4624-8a78-916e1935fbf9 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:55.251274 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef7a944-f2f2-4f58-994d-958641de612a None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:55.297645 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aba516-35bd-4110-8a10-c0f09f6f68e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:55.298837 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aba516-35bd-4110-8a10-c0f09f6f68e1 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:55.299644 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aba516-35bd-4110-8a10-c0f09f6f68e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:55.300045 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aba516-35bd-4110-8a10-c0f09f6f68e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:55.309050 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba61530-0a2f-4624-8a78-916e1935fbf9 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:55.326889 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aba516-35bd-4110-8a10-c0f09f6f68e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:55.328907 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6aba516-35bd-4110-8a10-c0f09f6f68e1 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:55.343239 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:55.351411 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b42dc-adff-4e02-af32-120ff425fc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:55.359281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b42dc-adff-4e02-af32-120ff425fc92 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:55.359281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b42dc-adff-4e02-af32-120ff425fc92 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:55.359465 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-a6aba516-35bd-4110-8a10-c0f09f6f68e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:55.359465 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:55.359465 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:55.359465 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:55.359465 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:55.359465 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:55.359465 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:55.359465 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:55.359465 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:55.359465 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:55.359465 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:55.359465 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:55.359465 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:50:55.359465 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:50:55.359465 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:50:55.359465 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:50:55.361070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:55.361070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:55.361070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:55.361070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:55.361070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:55.361070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:55.361070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:55.361070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:55.361070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:55.361070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:55.361070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:55.361070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:55.361070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:55.361070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:55.361070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:55.361070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:55.361070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:50:55.362545 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:50:55.362545 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:55.362545 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:55.362729 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b42dc-adff-4e02-af32-120ff425fc92 None admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:55.362729 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b42dc-adff-4e02-af32-120ff425fc92 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:55.362729 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b42dc-adff-4e02-af32-120ff425fc92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:55.362927 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 308/619] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:55.362927 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b95fb-b512-4cd5-adb3-b3d8433f34f4 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:55.362927 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b95fb-b512-4cd5-adb3-b3d8433f34f4 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:55.362927 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b95fb-b512-4cd5-adb3-b3d8433f34f4 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:55.362927 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 309/620] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:55.369206 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b42dc-adff-4e02-af32-120ff425fc92 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:55.369454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b95fb-b512-4cd5-adb3-b3d8433f34f4 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:55.384715 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 312/621] 10.222.0.55 () {56 vars in 1135 bytes} [Wed Aug 24 16:50:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:55.386492 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55f958-ca20-4302-b6e6-f9255da706d4 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:55.387074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55f958-ca20-4302-b6e6-f9255da706d4 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:55.387635 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55f958-ca20-4302-b6e6-f9255da706d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:55.408504 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-9f55f958-ca20-4302-b6e6-f9255da706d4 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:55.410061 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-9f55f958-ca20-4302-b6e6-f9255da706d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:55.460874 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:55.495640 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 313/622] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:55.497056 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55f958-ca20-4302-b6e6-f9255da706d4 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:55.518455 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b95fb-b512-4cd5-adb3-b3d8433f34f4 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:55.600595 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab3e5e-d282-4178-9020-eaf92e9d9d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:55.601142 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab3e5e-d282-4178-9020-eaf92e9d9d72 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:55.601426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab3e5e-d282-4178-9020-eaf92e9d9d72 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:55.601700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab3e5e-d282-4178-9020-eaf92e9d9d72 None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:55.602911 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab3e5e-d282-4178-9020-eaf92e9d9d72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:55.603237 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab3e5e-d282-4178-9020-eaf92e9d9d72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:55.608448 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab3e5e-d282-4178-9020-eaf92e9d9d72 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:55.631794 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 310/623] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:55.638310 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab3e5e-d282-4178-9020-eaf92e9d9d72 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:55.675166 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55f958-ca20-4302-b6e6-f9255da706d4 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:55.698072 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:55.724042 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c879e-046f-426c-8bcd-76d78e6aa3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:55.724972 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c879e-046f-426c-8bcd-76d78e6aa3c7 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:55.726765 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c879e-046f-426c-8bcd-76d78e6aa3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:55.727258 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c879e-046f-426c-8bcd-76d78e6aa3c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:55.757266 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c879e-046f-426c-8bcd-76d78e6aa3c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:55.759374 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c879e-046f-426c-8bcd-76d78e6aa3c7 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:55.794151 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-969c879e-046f-426c-8bcd-76d78e6aa3c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:55.794151 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:55.794151 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:55.794151 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:55.794151 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:55.794151 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:55.794151 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:55.794151 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:55.794151 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:55.794151 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:55.794151 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:55.794151 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:55.794151 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:50:55.794151 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:50:55.794151 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:50:55.794151 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:50:55.795529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:55.795529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:55.795529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:55.795529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:55.795529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:55.795529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:55.795529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:55.795529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:55.795529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:55.795529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:55.795529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:55.795529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:55.795529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:55.795529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:55.795529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:55.795529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:55.795529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:50:55.796783 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:50:55.796783 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:55.796783 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:55.802197 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 314/624] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:55.803384 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c879e-046f-426c-8bcd-76d78e6aa3c7 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:55.812738 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab3e5e-d282-4178-9020-eaf92e9d9d72 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:55.843057 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:55.860228 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a1d1d-801e-45a5-a7df-2e27483094bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:55.861168 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a1d1d-801e-45a5-a7df-2e27483094bb None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:55.862185 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a1d1d-801e-45a5-a7df-2e27483094bb None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:55.862601 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a1d1d-801e-45a5-a7df-2e27483094bb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:55.873163 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a1d1d-801e-45a5-a7df-2e27483094bb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:55.875649 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a1d1d-801e-45a5-a7df-2e27483094bb None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:55.893580 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-a71a1d1d-801e-45a5-a7df-2e27483094bb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:50:55.893580 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:55.893580 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:55.893580 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:55.893580 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:55.893580 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:55.893580 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:55.893580 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:55.893580 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:55.893580 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:55.893580 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:55.893580 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:55.893580 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:50:55.893580 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:50:55.893580 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:50:55.893580 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:50:55.894740 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:55.894740 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:55.894740 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:50:55.894740 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:50:55.894740 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:50:55.894740 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:50:55.894740 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:55.894740 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:55.894740 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:55.894740 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:55.894740 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:55.894740 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:55.894740 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:55.894740 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:55.894740 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:55.894740 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:55.894740 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:55.894740 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:55.895982 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:55.895982 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:55.895982 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:50:55.895982 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:50:55.895982 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:50:55.895982 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:50:55.895982 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:50:55.895982 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:50:55.895982 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:50:55.895982 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:55.898475 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 311/625] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Aug 24 16:50:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:50:55.900843 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a1d1d-801e-45a5-a7df-2e27483094bb None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:55.947968 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c879e-046f-426c-8bcd-76d78e6aa3c7 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:55.989628 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2d615-85ae-4876-b4cc-d5e64b459df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:55.990413 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2d615-85ae-4876-b4cc-d5e64b459df4 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:55.990796 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2d615-85ae-4876-b4cc-d5e64b459df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:55.991221 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e2d615-85ae-4876-b4cc-d5e64b459df4 None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:55.992084 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2d615-85ae-4876-b4cc-d5e64b459df4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:55.992633 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2d615-85ae-4876-b4cc-d5e64b459df4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:55.994456 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e2d615-85ae-4876-b4cc-d5e64b459df4 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:56.012668 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 315/626] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:56.012668 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2d615-85ae-4876-b4cc-d5e64b459df4 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:56.040443 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a1d1d-801e-45a5-a7df-2e27483094bb None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:56.056936 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:56.080540 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc12659-793f-4753-9ba7-f494805f0898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:56.081170 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc12659-793f-4753-9ba7-f494805f0898 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:56.081450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc12659-793f-4753-9ba7-f494805f0898 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:56.081718 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc12659-793f-4753-9ba7-f494805f0898 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:56.099124 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc12659-793f-4753-9ba7-f494805f0898 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:56.106262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-bfc12659-793f-4753-9ba7-f494805f0898 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:50:56.106262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:56.106262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:56.106262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:56.106262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:56.106262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:56.106262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:56.106262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:56.106262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:56.106262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:56.106262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:56.106262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:56.106262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:56.106262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:56.106262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:56.106262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:56.107348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:56.107348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:56.107348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:56.107348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:56.107348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:56.107348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:56.107348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:56.107348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:56.107348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:56.107348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:56.107348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:56.107348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:56.107348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:56.107348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:56.107348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:56.107348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:56.108241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:56.108241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:56.108241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:56.108241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:56.108241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:56.108241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:56.108241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:56.108241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:56.108241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:56.108241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:56.108241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:50:56.108241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:56.112684 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 312/627] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Aug 24 16:50:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:56.114070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58299a6-94df-47c8-aea3-42bf7504ba0e None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:56.114394 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58299a6-94df-47c8-aea3-42bf7504ba0e None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:56.114714 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58299a6-94df-47c8-aea3-42bf7504ba0e None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:56.119413 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 313/628] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:56.121500 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58299a6-94df-47c8-aea3-42bf7504ba0e None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:56.162495 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e2d615-85ae-4876-b4cc-d5e64b459df4 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:56.177549 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:56.200913 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a0dca-8510-4221-a171-1ad704c37f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:56.201524 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a0dca-8510-4221-a171-1ad704c37f39 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:56.201800 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a0dca-8510-4221-a171-1ad704c37f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:56.202070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a0dca-8510-4221-a171-1ad704c37f39 None admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:56.202795 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a0dca-8510-4221-a171-1ad704c37f39 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:56.203096 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a0dca-8510-4221-a171-1ad704c37f39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:56.204542 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a0dca-8510-4221-a171-1ad704c37f39 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:56.223175 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 316/629] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Aug 24 16:50:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:56.224082 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a0dca-8510-4221-a171-1ad704c37f39 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:56.248590 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58299a6-94df-47c8-aea3-42bf7504ba0e None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:56.287176 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a0cc5-c940-462f-9ef1-f64ac0f4ec41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:56.287944 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a0cc5-c940-462f-9ef1-f64ac0f4ec41 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:56.288226 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a0cc5-c940-462f-9ef1-f64ac0f4ec41 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:56.288497 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a0cc5-c940-462f-9ef1-f64ac0f4ec41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:56.296592 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a0cc5-c940-462f-9ef1-f64ac0f4ec41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:56.298034 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a0cc5-c940-462f-9ef1-f64ac0f4ec41 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:56.309887 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-be8a0cc5-c940-462f-9ef1-f64ac0f4ec41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:50:56.309887 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:56.309887 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:56.309887 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:56.309887 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:56.309887 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:56.309887 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:56.309887 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:56.309887 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:56.309887 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:56.309887 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:56.309887 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:56.309887 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:50:56.309887 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:50:56.309887 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:50:56.311037 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:50:56.311037 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:56.311037 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:56.311037 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:56.311037 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:56.311037 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:56.311037 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:56.311037 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:56.311037 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:56.311037 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:56.311037 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:56.311037 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:56.311037 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:56.311037 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:56.311037 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:56.311037 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:56.311037 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:56.311940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:50:56.311940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:50:56.311940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:50:56.311940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:50:56.311940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:50:56.311940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:50:56.311940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:50:56.311940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:56.311940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 314/630] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:50:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:56.313095 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce312fda-5bb1-4047-bef8-704a27243fab None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:56.313095 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce312fda-5bb1-4047-bef8-704a27243fab None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:56.313095 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce312fda-5bb1-4047-bef8-704a27243fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:56.325772 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:56.331921 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-ce312fda-5bb1-4047-bef8-704a27243fab None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:56.333123 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-ce312fda-5bb1-4047-bef8-704a27243fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:56.341846 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a0dca-8510-4221-a171-1ad704c37f39 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:56.376591 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8169a67-2f9c-4e9b-bb3f-c33e7d4ea54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:56.377133 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8169a67-2f9c-4e9b-bb3f-c33e7d4ea54a None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:56.377414 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8169a67-2f9c-4e9b-bb3f-c33e7d4ea54a None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:56.377690 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8169a67-2f9c-4e9b-bb3f-c33e7d4ea54a None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:56.378359 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8169a67-2f9c-4e9b-bb3f-c33e7d4ea54a None admin] RBAC: Adding query filter params (name=service) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:56.378661 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8169a67-2f9c-4e9b-bb3f-c33e7d4ea54a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:56.380071 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8169a67-2f9c-4e9b-bb3f-c33e7d4ea54a None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:56.388676 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 317/631] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Aug 24 16:50:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:56.389493 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8169a67-2f9c-4e9b-bb3f-c33e7d4ea54a None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:56.409305 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 315/632] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:56.410576 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9167a-ff01-4bf7-a1f8-d2f485eb43df None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:56.410860 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9167a-ff01-4bf7-a1f8-d2f485eb43df None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:56.411194 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9167a-ff01-4bf7-a1f8-d2f485eb43df None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:56.412580 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 316/633] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:56.416522 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9167a-ff01-4bf7-a1f8-d2f485eb43df None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:56.449907 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:56.504683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8169a67-2f9c-4e9b-bb3f-c33e7d4ea54a None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:56.546426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9167a-ff01-4bf7-a1f8-d2f485eb43df None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:56.553006 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5503d649-5877-44b8-8619-e13916fe35cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:56.553637 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503d649-5877-44b8-8619-e13916fe35cf None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:56.553973 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503d649-5877-44b8-8619-e13916fe35cf None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:56.554376 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5503d649-5877-44b8-8619-e13916fe35cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:56.577260 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:56.586101 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c50dd5-de4c-4bb1-b23e-6c00f62a929c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:56.587406 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c50dd5-de4c-4bb1-b23e-6c00f62a929c None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:56.591517 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c50dd5-de4c-4bb1-b23e-6c00f62a929c None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:56.591517 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c50dd5-de4c-4bb1-b23e-6c00f62a929c None admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:56.591517 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c50dd5-de4c-4bb1-b23e-6c00f62a929c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:56.591517 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c50dd5-de4c-4bb1-b23e-6c00f62a929c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:56.591517 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c50dd5-de4c-4bb1-b23e-6c00f62a929c None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:56.608284 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 317/634] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:50:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:56.608284 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c50dd5-de4c-4bb1-b23e-6c00f62a929c None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:56.645931 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5503d649-5877-44b8-8619-e13916fe35cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:56.647396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5503d649-5877-44b8-8619-e13916fe35cf None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:56.706627 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:56.716588 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c50dd5-de4c-4bb1-b23e-6c00f62a929c None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:56.756482 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 318/635] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:50:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:56.757759 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7e748-f240-4367-b1da-36517173b545 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:56.758692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7e748-f240-4367-b1da-36517173b545 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:56.759146 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7e748-f240-4367-b1da-36517173b545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:56.767976 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64014b2e-e075-4196-a9de-78a37a00014d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:56.768613 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64014b2e-e075-4196-a9de-78a37a00014d None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:56.768913 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64014b2e-e075-4196-a9de-78a37a00014d None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:56.769211 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64014b2e-e075-4196-a9de-78a37a00014d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:56.777575 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-b9d7e748-f240-4367-b1da-36517173b545 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:56.778798 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-b9d7e748-f240-4367-b1da-36517173b545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:56.780983 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64014b2e-e075-4196-a9de-78a37a00014d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:56.782461 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64014b2e-e075-4196-a9de-78a37a00014d None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:56.797167 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-64014b2e-e075-4196-a9de-78a37a00014d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:56.797167 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:56.797167 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:56.797167 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:56.797167 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:56.797167 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:56.797167 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:56.797167 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:56.797167 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:56.797167 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:56.797167 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:56.797167 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:56.797167 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:50:56.797167 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:50:56.797167 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:50:56.797167 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:50:56.798363 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:56.798363 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:56.798363 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:56.798363 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:56.798363 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:56.798363 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:56.798363 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:56.798363 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:56.798363 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:56.798363 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:56.798363 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:56.798363 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:56.798363 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:56.798363 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:56.798363 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:56.798363 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:56.798363 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:50:56.799570 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:50:56.799570 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:56.799570 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:56.799570 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 318/636] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:56.799570 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64014b2e-e075-4196-a9de-78a37a00014d None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:56.834440 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:56.861905 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 319/637] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:56.862764 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7e748-f240-4367-b1da-36517173b545 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:56.921545 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64014b2e-e075-4196-a9de-78a37a00014d None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:56.968851 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03fe12-4bbc-40fe-ba9d-9d6de753b3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:56.970053 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03fe12-4bbc-40fe-ba9d-9d6de753b3db None admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:56.970053 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03fe12-4bbc-40fe-ba9d-9d6de753b3db None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:56.970053 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03fe12-4bbc-40fe-ba9d-9d6de753b3db None admin] PATH_INFO: `/v3/projects/ebae6aa9c60343e6ba0ff1cd62619642/users/c067bc2d84b741d08ac47e40adae4b4f/roles/494c75ed8f864e3b955fdb043e96c675` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:56.988341 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03fe12-4bbc-40fe-ba9d-9d6de753b3db None admin] RBAC: Authorizing `identity:create_grant(project_id=ebae6aa9c60343e6ba0ff1cd62619642, user_id=c067bc2d84b741d08ac47e40adae4b4f, role_id=494c75ed8f864e3b955fdb043e96c675)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:56.990911 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03fe12-4bbc-40fe-ba9d-9d6de753b3db None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:56.993713 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:57.006843 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7e748-f240-4367-b1da-36517173b545 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:57.051418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88029b4f-3998-4a40-9991-2b93ff56698c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:57.060194 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88029b4f-3998-4a40-9991-2b93ff56698c None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:57.060194 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88029b4f-3998-4a40-9991-2b93ff56698c None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:57.060194 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88029b4f-3998-4a40-9991-2b93ff56698c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:57.075785 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88029b4f-3998-4a40-9991-2b93ff56698c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:57.080538 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-88029b4f-3998-4a40-9991-2b93ff56698c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:50:57.080538 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:57.080538 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:57.080538 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:57.080538 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:57.080538 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:57.080538 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:57.080538 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:57.080538 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:57.080538 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:57.080538 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:57.080538 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:57.080538 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:57.080538 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:57.080538 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:57.080538 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:57.081557 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:57.081557 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:57.081557 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:57.081557 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:57.081557 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:57.081557 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:57.081557 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:57.081557 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:57.081557 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:57.081557 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:57.081557 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:57.081557 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:57.081557 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:57.081557 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:57.081557 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:57.081557 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:57.082420 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:57.082420 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:57.082420 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:57.082420 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:57.082420 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:57.082420 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:57.082420 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:57.082420 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:57.082420 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:57.082420 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:57.082420 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:50:57.082420 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:57.082420 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 320/638] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Aug 24 16:50:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:57.082420 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88029b4f-3998-4a40-9991-2b93ff56698c None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:57.107395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 319/639] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Aug 24 16:50:56 2022] PUT /identity/v3/projects/ebae6aa9c60343e6ba0ff1cd62619642/users/c067bc2d84b741d08ac47e40adae4b4f/roles/494c75ed8f864e3b955fdb043e96c675 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:50:57.112358 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03fe12-4bbc-40fe-ba9d-9d6de753b3db None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:57.143618 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:57.215693 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88029b4f-3998-4a40-9991-2b93ff56698c None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:57.233359 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03fe12-4bbc-40fe-ba9d-9d6de753b3db None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:57.260880 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663b0f5-fbc7-4ab1-b93c-87563d3553dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:57.261520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663b0f5-fbc7-4ab1-b93c-87563d3553dd None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:57.261795 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663b0f5-fbc7-4ab1-b93c-87563d3553dd None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:57.262064 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4663b0f5-fbc7-4ab1-b93c-87563d3553dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:57.272710 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663b0f5-fbc7-4ab1-b93c-87563d3553dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:57.274645 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4663b0f5-fbc7-4ab1-b93c-87563d3553dd None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:57.277638 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac9455-a96a-4cf7-a0fa-312b9e56e4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:57.278256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac9455-a96a-4cf7-a0fa-312b9e56e4ce None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:57.278534 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac9455-a96a-4cf7-a0fa-312b9e56e4ce None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:57.278806 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac9455-a96a-4cf7-a0fa-312b9e56e4ce None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:57.279483 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac9455-a96a-4cf7-a0fa-312b9e56e4ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:57.279785 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac9455-a96a-4cf7-a0fa-312b9e56e4ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:57.281140 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac9455-a96a-4cf7-a0fa-312b9e56e4ce None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:57.290802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-4663b0f5-fbc7-4ab1-b93c-87563d3553dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:57.290802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:57.290802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:57.290802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:57.290802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:57.290802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:57.290802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:57.290802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:57.290802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:57.290802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:57.290802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:57.290802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:57.290802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:50:57.290802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:50:57.290802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:50:57.290802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:50:57.292025 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:57.292025 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:57.292025 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:57.292025 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:57.292025 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:57.292025 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:57.292025 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:57.292025 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:57.292025 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:57.292025 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:57.292025 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:57.292025 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:57.292025 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:57.292025 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:57.292025 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:57.292025 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:57.292025 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:50:57.293108 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:50:57.293108 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:57.293108 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:57.293957 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 321/640] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:57.294795 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663b0f5-fbc7-4ab1-b93c-87563d3553dd None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:57.295787 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 320/641] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:57.299220 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac9455-a96a-4cf7-a0fa-312b9e56e4ce None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:57.364998 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:57.402189 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:57.411704 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4663b0f5-fbc7-4ab1-b93c-87563d3553dd None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:57.412111 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac9455-a96a-4cf7-a0fa-312b9e56e4ce None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:57.448428 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc0b6f-fd77-4cfb-92b2-b842c39a2317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:57.448737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221f719-b5ad-4acc-8f5b-1a45c0454371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:57.449265 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc0b6f-fd77-4cfb-92b2-b842c39a2317 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:57.449483 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221f719-b5ad-4acc-8f5b-1a45c0454371 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:57.449675 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc0b6f-fd77-4cfb-92b2-b842c39a2317 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:57.449873 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221f719-b5ad-4acc-8f5b-1a45c0454371 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:57.450074 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc0b6f-fd77-4cfb-92b2-b842c39a2317 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:57.450249 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c221f719-b5ad-4acc-8f5b-1a45c0454371 None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:57.450967 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c221f719-b5ad-4acc-8f5b-1a45c0454371 None admin] RBAC: Adding query filter params (name=service) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:57.451351 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c221f719-b5ad-4acc-8f5b-1a45c0454371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:57.452772 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c221f719-b5ad-4acc-8f5b-1a45c0454371 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:57.460978 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc0b6f-fd77-4cfb-92b2-b842c39a2317 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:50:57.466147 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 322/642] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Aug 24 16:50:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:57.466147 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221f719-b5ad-4acc-8f5b-1a45c0454371 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:57.467270 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-64cc0b6f-fd77-4cfb-92b2-b842c39a2317 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:50:57.467270 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:57.467270 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:57.467270 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:57.467270 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:57.467270 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:57.467270 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:57.467270 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:57.467270 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:57.467270 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:57.467270 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:57.467270 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:57.467270 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:50:57.467270 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:50:57.467270 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:50:57.467270 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:50:57.468411 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:50:57.468411 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:50:57.468411 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:50:57.468411 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:50:57.468411 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:57.468411 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:57.468411 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:57.468411 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:57.468411 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:57.468411 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:57.468411 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:57.468411 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:57.468411 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:57.468411 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:57.468411 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:57.468411 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:57.469454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:57.469454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:57.469454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:57.469454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:57.469454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:50:57.469454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:50:57.469454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:50:57.469454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:50:57.469454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:50:57.469454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:50:57.469454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:50:57.469454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:57.470254 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 321/643] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Aug 24 16:50:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:57.471041 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc0b6f-fd77-4cfb-92b2-b842c39a2317 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:57.576408 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c221f719-b5ad-4acc-8f5b-1a45c0454371 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:57.576795 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc0b6f-fd77-4cfb-92b2-b842c39a2317 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:57.592944 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:57.612490 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db17ca-8716-4123-b864-076239185617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:57.613360 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db17ca-8716-4123-b864-076239185617 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:57.613797 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db17ca-8716-4123-b864-076239185617 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:57.614222 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db17ca-8716-4123-b864-076239185617 None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:57.614709 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4e8fb-5a6e-41d4-9336-6d7e2f259870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:57.615245 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db17ca-8716-4123-b864-076239185617 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:57.615379 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4e8fb-5a6e-41d4-9336-6d7e2f259870 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:57.615635 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4e8fb-5a6e-41d4-9336-6d7e2f259870 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:57.615904 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f4e8fb-5a6e-41d4-9336-6d7e2f259870 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:57.616097 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db17ca-8716-4123-b864-076239185617 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:57.617652 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1db17ca-8716-4123-b864-076239185617 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:57.623692 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4e8fb-5a6e-41d4-9336-6d7e2f259870 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:57.625147 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f4e8fb-5a6e-41d4-9336-6d7e2f259870 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:57.637117 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 323/644] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:57.637723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-30f4e8fb-5a6e-41d4-9336-6d7e2f259870 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 16:50:57.637723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:57.637723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:57.637723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:57.637723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:57.637723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:57.637723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:57.637723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:57.637723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:57.637723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:57.637723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:57.637723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:57.637723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:50:57.637723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:50:57.637723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:50:57.637723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:50:57.638744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:57.638744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:57.638744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:50:57.638744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:50:57.638744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:50:57.638744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:50:57.638744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:57.638744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:57.638744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:57.638744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:57.638744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:57.638744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:57.638744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:57.638744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:57.638744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:57.638744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:57.638744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:57.638744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:57.640163 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:57.640163 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:57.640163 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:50:57.640163 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:50:57.640163 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:50:57.640163 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:50:57.640163 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:50:57.640163 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:50:57.640163 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 16:50:57.640163 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:57.641065 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db17ca-8716-4123-b864-076239185617 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:57.643351 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 322/645] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:50:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:57.644163 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4e8fb-5a6e-41d4-9336-6d7e2f259870 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:57.659474 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:57.755004 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f4e8fb-5a6e-41d4-9336-6d7e2f259870 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:57.755674 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db17ca-8716-4123-b864-076239185617 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:57.797538 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be19e5-d391-44cd-8b1c-c68cee56d53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:57.798332 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be19e5-d391-44cd-8b1c-c68cee56d53d None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:57.798614 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be19e5-d391-44cd-8b1c-c68cee56d53d None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:57.798966 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be19e5-d391-44cd-8b1c-c68cee56d53d None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:57.799863 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be19e5-d391-44cd-8b1c-c68cee56d53d None admin] RBAC: Adding query filter params (name=service) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:57.800163 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be19e5-d391-44cd-8b1c-c68cee56d53d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:57.801191 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828df0cc-451d-4045-b75e-61698a93f0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:57.801700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be19e5-d391-44cd-8b1c-c68cee56d53d None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:57.801950 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828df0cc-451d-4045-b75e-61698a93f0a7 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:57.802290 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828df0cc-451d-4045-b75e-61698a93f0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:57.802622 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828df0cc-451d-4045-b75e-61698a93f0a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:57.811360 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 323/646] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Aug 24 16:50:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:57.814894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be19e5-d391-44cd-8b1c-c68cee56d53d None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:57.816429 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828df0cc-451d-4045-b75e-61698a93f0a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:57.817894 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828df0cc-451d-4045-b75e-61698a93f0a7 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:57.834724 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-828df0cc-451d-4045-b75e-61698a93f0a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:57.834724 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:57.834724 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:57.834724 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:57.834724 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:57.834724 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:57.834724 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:57.834724 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:57.834724 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:57.834724 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:57.834724 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:57.834724 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:57.834724 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:50:57.834724 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:50:57.834724 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:50:57.834724 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:50:57.835801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:57.835801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:57.835801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:57.835801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:57.835801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:57.835801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:57.835801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:57.835801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:57.835801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:57.835801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:57.835801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:57.835801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:57.835801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:57.835801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:57.835801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:57.835801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:57.835801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:50:57.837285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:50:57.837285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:57.837285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:57.837285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 324/647] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:57.837529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828df0cc-451d-4045-b75e-61698a93f0a7 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:57.862628 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:57.910038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:57.929702 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be19e5-d391-44cd-8b1c-c68cee56d53d None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:57.951515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828df0cc-451d-4045-b75e-61698a93f0a7 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:57.967854 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3be363-6085-4cb8-b0be-7dab515a928c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:57.968685 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3be363-6085-4cb8-b0be-7dab515a928c None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:57.969049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3be363-6085-4cb8-b0be-7dab515a928c None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:57.969449 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3be363-6085-4cb8-b0be-7dab515a928c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:57.976597 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3be363-6085-4cb8-b0be-7dab515a928c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:57.978957 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3be363-6085-4cb8-b0be-7dab515a928c None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:57.987317 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7ea0c-4db7-4777-ad86-effa82f271d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:57.988004 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7ea0c-4db7-4777-ad86-effa82f271d8 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:57.988354 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7ea0c-4db7-4777-ad86-effa82f271d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:57.988695 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7ea0c-4db7-4777-ad86-effa82f271d8 None admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:57.989500 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7ea0c-4db7-4777-ad86-effa82f271d8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:57.989878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7ea0c-4db7-4777-ad86-effa82f271d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:57.991396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7ea0c-4db7-4777-ad86-effa82f271d8 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:57.991521 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-6a3be363-6085-4cb8-b0be-7dab515a928c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:50:57.991521 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:57.991521 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:57.991521 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:57.991521 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:57.991521 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:57.991521 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:57.991521 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:57.991521 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:57.991521 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:57.991521 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:57.991521 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:57.991521 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:50:57.991521 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:50:57.991521 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:50:57.992702 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:50:57.992702 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:57.992702 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:57.992702 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:57.992702 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:57.992702 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:57.992702 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:57.992702 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:57.992702 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:57.992702 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:57.992702 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:57.992702 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:57.992702 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:57.992702 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:57.992702 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:57.992702 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:57.992702 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:57.993926 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:50:57.993926 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:50:57.993926 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:50:57.993926 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:50:57.993926 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:50:57.993926 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:50:57.993926 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:50:57.993926 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:57.993926 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 324/648] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:50:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:57.994541 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3be363-6085-4cb8-b0be-7dab515a928c None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:58.020166 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 325/649] 10.222.0.55 () {56 vars in 1137 bytes} [Wed Aug 24 16:50:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:58.020166 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7ea0c-4db7-4777-ad86-effa82f271d8 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:58.108206 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:58.114314 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3be363-6085-4cb8-b0be-7dab515a928c None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:58.132332 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7ea0c-4db7-4777-ad86-effa82f271d8 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:58.148905 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0357e-8cc6-48d7-ba58-e2bca02a07ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:58.149573 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0357e-8cc6-48d7-ba58-e2bca02a07ca None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:58.149856 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0357e-8cc6-48d7-ba58-e2bca02a07ca None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:58.150129 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0357e-8cc6-48d7-ba58-e2bca02a07ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:58.158646 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:58.162041 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c0357e-8cc6-48d7-ba58-e2bca02a07ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:58.163559 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c0357e-8cc6-48d7-ba58-e2bca02a07ca None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:58.170092 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53dc88-0545-4996-9cef-40e379887392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:58.173553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53dc88-0545-4996-9cef-40e379887392 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:58.173553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53dc88-0545-4996-9cef-40e379887392 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:58.173553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f53dc88-0545-4996-9cef-40e379887392 None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:58.173553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53dc88-0545-4996-9cef-40e379887392 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:58.173553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53dc88-0545-4996-9cef-40e379887392 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:58.173967 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f53dc88-0545-4996-9cef-40e379887392 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:58.181188 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-00c0357e-8cc6-48d7-ba58-e2bca02a07ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:58.181188 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:58.181188 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:58.181188 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:58.181188 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:58.181188 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:58.181188 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:58.181188 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:58.181188 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:58.181188 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:58.181188 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:58.181188 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:58.181188 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:50:58.181188 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:50:58.181188 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:50:58.181188 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:50:58.182333 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:58.182333 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:58.182333 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:58.182333 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:58.182333 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:58.182333 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:58.182333 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:58.182333 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:58.182333 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:58.182333 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:58.182333 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:58.182333 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:58.182333 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:58.182333 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:58.182333 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:58.182333 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:58.182333 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:50:58.183410 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:50:58.183410 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:58.183410 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:58.183410 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 325/650] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:58.183635 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0357e-8cc6-48d7-ba58-e2bca02a07ca None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:58.195394 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 326/651] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:58.197842 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53dc88-0545-4996-9cef-40e379887392 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:58.298341 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0357e-8cc6-48d7-ba58-e2bca02a07ca None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:58.306240 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f53dc88-0545-4996-9cef-40e379887392 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:58.337072 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea292e0-9cc8-4ec1-99c0-4cc5e98b053a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:58.337685 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea292e0-9cc8-4ec1-99c0-4cc5e98b053a None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:58.337961 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea292e0-9cc8-4ec1-99c0-4cc5e98b053a None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:58.338223 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea292e0-9cc8-4ec1-99c0-4cc5e98b053a None admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:58.338918 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea292e0-9cc8-4ec1-99c0-4cc5e98b053a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:58.339252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea292e0-9cc8-4ec1-99c0-4cc5e98b053a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:58.340696 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea292e0-9cc8-4ec1-99c0-4cc5e98b053a None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:58.341294 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3a14d-3fb7-4e47-ba27-ef91bdd28d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:58.341900 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3a14d-3fb7-4e47-ba27-ef91bdd28d11 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:58.342218 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3a14d-3fb7-4e47-ba27-ef91bdd28d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:58.342488 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb3a14d-3fb7-4e47-ba27-ef91bdd28d11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:58.359256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 326/652] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:50:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:58.359256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea292e0-9cc8-4ec1-99c0-4cc5e98b053a None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:58.369064 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:58.401268 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:58.420946 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb3a14d-3fb7-4e47-ba27-ef91bdd28d11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:58.422536 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb3a14d-3fb7-4e47-ba27-ef91bdd28d11 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:58.468201 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea292e0-9cc8-4ec1-99c0-4cc5e98b053a None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:58.507036 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c4843-fe22-49cf-9a8d-6b3c1f12435f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:58.507835 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c4843-fe22-49cf-9a8d-6b3c1f12435f None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:58.508121 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c4843-fe22-49cf-9a8d-6b3c1f12435f None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:58.508396 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c4843-fe22-49cf-9a8d-6b3c1f12435f None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:58.509522 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c4843-fe22-49cf-9a8d-6b3c1f12435f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:58.509795 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c4843-fe22-49cf-9a8d-6b3c1f12435f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:58.511162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c4843-fe22-49cf-9a8d-6b3c1f12435f None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:58.523343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 327/653] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:58.524664 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c4843-fe22-49cf-9a8d-6b3c1f12435f None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:58.532956 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 327/654] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:50:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:58.533672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3a14d-3fb7-4e47-ba27-ef91bdd28d11 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:58.599901 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:58.622082 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:58.636854 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c4843-fe22-49cf-9a8d-6b3c1f12435f None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:58.642136 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb3a14d-3fb7-4e47-ba27-ef91bdd28d11 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:58.679726 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97226b60-0c1a-48cf-9671-9b3aaa66f358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:58.680321 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5005e-4369-4709-a4a6-ee0cf54205b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:58.680447 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97226b60-0c1a-48cf-9671-9b3aaa66f358 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:58.680695 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97226b60-0c1a-48cf-9671-9b3aaa66f358 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:58.680962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97226b60-0c1a-48cf-9671-9b3aaa66f358 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:58.681305 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5005e-4369-4709-a4a6-ee0cf54205b9 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:58.681672 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5005e-4369-4709-a4a6-ee0cf54205b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:58.681772 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97226b60-0c1a-48cf-9671-9b3aaa66f358 None admin] RBAC: Adding query filter params (role.id=494c75ed8f864e3b955fdb043e96c675, scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642, user.id=28a1c617fc264b118e61f2a97ecb3f39) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:58.681977 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97226b60-0c1a-48cf-9671-9b3aaa66f358 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:58.682175 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5005e-4369-4709-a4a6-ee0cf54205b9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:58.683444 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97226b60-0c1a-48cf-9671-9b3aaa66f358 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:58.689971 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 328/655] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:50:58 2022] GET /identity/v3/role_assignments?user.id=28a1c617fc264b118e61f2a97ecb3f39&scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642&role.id=494c75ed8f864e3b955fdb043e96c675 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:58.690951 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97226b60-0c1a-48cf-9671-9b3aaa66f358 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:58.701926 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5005e-4369-4709-a4a6-ee0cf54205b9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:58.704741 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5005e-4369-4709-a4a6-ee0cf54205b9 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:58.722506 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-73b5005e-4369-4709-a4a6-ee0cf54205b9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 16:50:58.722506 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:58.722506 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:58.722506 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:58.722506 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:58.722506 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:58.722506 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:58.722506 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:58.722506 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:58.722506 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:58.722506 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:58.722506 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:58.722506 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:50:58.722506 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:50:58.722506 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:50:58.722506 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:50:58.723720 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:58.723720 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:58.723720 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:50:58.723720 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:50:58.723720 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:50:58.723720 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:50:58.723720 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:58.723720 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:58.723720 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:58.723720 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:58.723720 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:58.723720 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:58.723720 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:58.723720 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:58.723720 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:58.723720 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:58.723720 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:58.723720 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:58.724918 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:58.724918 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:58.724918 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:50:58.724918 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:50:58.724918 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:50:58.724918 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:50:58.724918 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:50:58.724918 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:50:58.724918 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 16:50:58.724918 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:58.732624 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 328/656] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Aug 24 16:50:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:58.732624 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5005e-4369-4709-a4a6-ee0cf54205b9 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:58.830551 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97226b60-0c1a-48cf-9671-9b3aaa66f358 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:58.875408 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5005e-4369-4709-a4a6-ee0cf54205b9 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:58.887361 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b20bb4-8ca5-4023-be2e-f307816f340e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:58.888270 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b20bb4-8ca5-4023-be2e-f307816f340e None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:58.888696 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b20bb4-8ca5-4023-be2e-f307816f340e None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:58.889127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b20bb4-8ca5-4023-be2e-f307816f340e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:58.897604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b20bb4-8ca5-4023-be2e-f307816f340e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:58.899325 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b20bb4-8ca5-4023-be2e-f307816f340e None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:58.907262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:58.911829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-e1b20bb4-8ca5-4023-be2e-f307816f340e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 16:50:58.911829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:58.911829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:58.911829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:58.911829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:58.911829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:58.911829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:58.911829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:58.911829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:58.911829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:58.911829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:58.911829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:58.911829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:50:58.911829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:50:58.911829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:50:58.911829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:50:58.912944 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:58.912944 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:58.912944 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:50:58.912944 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:50:58.912944 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:50:58.912944 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:50:58.912944 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:58.912944 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:58.912944 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:58.912944 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:58.912944 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:58.912944 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:58.912944 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:58.912944 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:58.912944 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:58.912944 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:58.912944 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:58.912944 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:58.914690 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:58.914690 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:58.914690 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:50:58.914690 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:50:58.914690 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:50:58.914690 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:50:58.914690 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:50:58.914690 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:50:58.914690 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 16:50:58.914690 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:58.914690 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 329/657] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:50:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:58.914690 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b20bb4-8ca5-4023-be2e-f307816f340e None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:58.925504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b987725-0e7a-4357-b59f-6aa11bd3b72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:58.926127 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b987725-0e7a-4357-b59f-6aa11bd3b72e None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:58.926403 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b987725-0e7a-4357-b59f-6aa11bd3b72e None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:58.926672 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b987725-0e7a-4357-b59f-6aa11bd3b72e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:58.929029 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:58.942013 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b987725-0e7a-4357-b59f-6aa11bd3b72e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:58.943523 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b987725-0e7a-4357-b59f-6aa11bd3b72e None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:58.964516 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-3b987725-0e7a-4357-b59f-6aa11bd3b72e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:58.964516 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:58.964516 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:58.964516 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:58.964516 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:58.964516 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:58.964516 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:58.964516 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:58.964516 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:58.964516 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:58.964516 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:58.964516 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:58.964516 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:50:58.964516 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:50:58.964516 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:50:58.964516 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:50:58.965651 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:58.965651 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:58.965651 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:58.965651 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:58.965651 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:58.965651 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:58.965651 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:58.965651 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:58.965651 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:58.965651 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:58.965651 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:58.965651 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:58.965651 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:58.965651 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:58.965651 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:58.965651 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:58.965651 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:50:58.966739 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:50:58.966739 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:58.966739 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:58.966739 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 329/658] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:58.966739 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b987725-0e7a-4357-b59f-6aa11bd3b72e None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:59.048305 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b20bb4-8ca5-4023-be2e-f307816f340e None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:59.088099 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663149d-6c90-4954-bbab-b94a1e760bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:59.089026 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663149d-6c90-4954-bbab-b94a1e760bcc None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:59.089316 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663149d-6c90-4954-bbab-b94a1e760bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:59.089592 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663149d-6c90-4954-bbab-b94a1e760bcc None admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:59.090335 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663149d-6c90-4954-bbab-b94a1e760bcc None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:59.090644 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663149d-6c90-4954-bbab-b94a1e760bcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:59.092133 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663149d-6c90-4954-bbab-b94a1e760bcc None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:59.106699 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b987725-0e7a-4357-b59f-6aa11bd3b72e None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:59.113161 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 330/659] 10.222.0.55 () {56 vars in 1139 bytes} [Wed Aug 24 16:50:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:59.114337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663149d-6c90-4954-bbab-b94a1e760bcc None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:59.146773 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726c75f-43ba-47af-87a4-da7502923319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:59.147673 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726c75f-43ba-47af-87a4-da7502923319 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:59.148097 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726c75f-43ba-47af-87a4-da7502923319 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:59.148632 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726c75f-43ba-47af-87a4-da7502923319 None admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:59.150010 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b726c75f-43ba-47af-87a4-da7502923319 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:59.150482 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b726c75f-43ba-47af-87a4-da7502923319 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:59.151947 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b726c75f-43ba-47af-87a4-da7502923319 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:59.171765 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 330/660] 10.222.0.55 () {56 vars in 1137 bytes} [Wed Aug 24 16:50:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:59.173083 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee295b-f08e-41f8-91a2-6a0995273d67 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:59.173374 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee295b-f08e-41f8-91a2-6a0995273d67 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:59.173648 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee295b-f08e-41f8-91a2-6a0995273d67 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:59.179144 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 331/661] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:50:59.179144 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee295b-f08e-41f8-91a2-6a0995273d67 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:59.190638 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:59.223474 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:59.231919 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663149d-6c90-4954-bbab-b94a1e760bcc None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:59.267809 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b060c-c7ed-416c-bc35-b4251bb4203d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:59.268422 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b060c-c7ed-416c-bc35-b4251bb4203d None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:59.268697 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b060c-c7ed-416c-bc35-b4251bb4203d None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:59.268964 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b060c-c7ed-416c-bc35-b4251bb4203d None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:59.269608 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b060c-c7ed-416c-bc35-b4251bb4203d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:50:59.269907 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b060c-c7ed-416c-bc35-b4251bb4203d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:59.271285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b060c-c7ed-416c-bc35-b4251bb4203d None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:59.283795 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 331/662] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:50:59.284619 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b060c-c7ed-416c-bc35-b4251bb4203d None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:59.296122 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee295b-f08e-41f8-91a2-6a0995273d67 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:59.332378 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a96459b-6c28-4b97-8bb8-be75bbe6accd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:59.333049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96459b-6c28-4b97-8bb8-be75bbe6accd None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:59.333292 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96459b-6c28-4b97-8bb8-be75bbe6accd None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:59.333545 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96459b-6c28-4b97-8bb8-be75bbe6accd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:59.395364 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b060c-c7ed-416c-bc35-b4251bb4203d None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:59.409498 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96459b-6c28-4b97-8bb8-be75bbe6accd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:59.410965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a96459b-6c28-4b97-8bb8-be75bbe6accd None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:59.422061 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:59.434043 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5e1f1-76d8-43af-97bc-e1d20382044b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:59.434653 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5e1f1-76d8-43af-97bc-e1d20382044b None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:59.448471 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5e1f1-76d8-43af-97bc-e1d20382044b None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:59.448471 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f5e1f1-76d8-43af-97bc-e1d20382044b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:59.455057 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:59.509207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5e1f1-76d8-43af-97bc-e1d20382044b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:59.511164 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f5e1f1-76d8-43af-97bc-e1d20382044b None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:59.527965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 332/663] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:50:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:59.529239 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2509f-393d-4deb-8442-1fa687a7d58a None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:59.529520 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2509f-393d-4deb-8442-1fa687a7d58a None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:59.529794 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2509f-393d-4deb-8442-1fa687a7d58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:59.549457 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-fbf2509f-393d-4deb-8442-1fa687a7d58a None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:50:59.550664 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-fbf2509f-393d-4deb-8442-1fa687a7d58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:50:59.624299 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 333/664] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:50:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:50:59.625149 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2509f-393d-4deb-8442-1fa687a7d58a None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:59.630417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 332/665] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:50:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:50:59.631615 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5e1f1-76d8-43af-97bc-e1d20382044b None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:59.662416 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:59.733053 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:59.769023 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f5e1f1-76d8-43af-97bc-e1d20382044b None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:59.771521 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2509f-393d-4deb-8442-1fa687a7d58a None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:59.810226 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53213c6-c56c-47f9-a7e8-447224551ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:59.810998 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53213c6-c56c-47f9-a7e8-447224551ddc None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:59.811327 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53213c6-c56c-47f9-a7e8-447224551ddc None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:59.811671 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53213c6-c56c-47f9-a7e8-447224551ddc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:59.819763 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d7b2e-e6db-432b-a591-475016dee970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:50:59.821576 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d7b2e-e6db-432b-a591-475016dee970 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:50:59.822043 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d7b2e-e6db-432b-a591-475016dee970 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:50:59.822974 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d7b2e-e6db-432b-a591-475016dee970 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:50:59.824772 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53213c6-c56c-47f9-a7e8-447224551ddc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:59.826348 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53213c6-c56c-47f9-a7e8-447224551ddc None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:59.832081 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d7b2e-e6db-432b-a591-475016dee970 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:50:59.834357 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d7b2e-e6db-432b-a591-475016dee970 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:50:59.842672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-e53213c6-c56c-47f9-a7e8-447224551ddc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:59.842672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:59.842672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:59.842672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:59.842672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:59.842672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:59.842672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:59.842672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:59.842672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:59.842672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:59.842672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:59.842672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:59.842672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:50:59.842672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:50:59.842672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:50:59.842672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:50:59.843741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:59.843741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:59.843741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:59.843741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:59.843741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:59.843741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:59.843741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:59.843741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:59.843741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:59.843741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:59.843741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:59.843741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:59.843741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:59.843741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:59.843741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:59.843741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:59.843741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:50:59.844657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:50:59.844657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:50:59.844657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:50:59.844657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 333/666] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:59.845425 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53213c6-c56c-47f9-a7e8-447224551ddc None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:59.852330 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-a45d7b2e-e6db-432b-a591-475016dee970 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:50:59.852330 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:50:59.852330 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:50:59.852330 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:50:59.852330 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:50:59.852330 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:50:59.852330 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:50:59.852330 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:50:59.852330 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:50:59.852330 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:50:59.852330 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:50:59.852330 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:50:59.852330 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:50:59.852330 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:50:59.852330 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:50:59.853291 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:50:59.853291 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:50:59.853291 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:50:59.853291 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:50:59.853291 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:50:59.853291 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:50:59.853291 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:50:59.853291 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:50:59.853291 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:50:59.853291 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:50:59.853291 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:50:59.853291 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:50:59.853291 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:50:59.853291 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:50:59.853291 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:50:59.853291 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:50:59.853291 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:50:59.854250 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:50:59.854250 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:50:59.854250 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:50:59.854250 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:50:59.854250 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:50:59.854250 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:50:59.854250 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:50:59.854250 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:50:59.858872 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 334/667] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:50:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:50:59.860045 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d7b2e-e6db-432b-a591-475016dee970 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:50:59.956356 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:50:59.985486 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53213c6-c56c-47f9-a7e8-447224551ddc None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:50:59.987661 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d7b2e-e6db-432b-a591-475016dee970 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:00.015716 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:00.025725 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92162a46-a4fe-4322-bbd4-d9a973af4522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:00.031895 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92162a46-a4fe-4322-bbd4-d9a973af4522 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:00.031895 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92162a46-a4fe-4322-bbd4-d9a973af4522 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:00.031895 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92162a46-a4fe-4322-bbd4-d9a973af4522 None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:00.031895 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92162a46-a4fe-4322-bbd4-d9a973af4522 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:00.031895 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92162a46-a4fe-4322-bbd4-d9a973af4522 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:00.031895 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92162a46-a4fe-4322-bbd4-d9a973af4522 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:00.032340 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e210466-26d4-4595-ab25-17b9cf8963ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:00.032340 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e210466-26d4-4595-ab25-17b9cf8963ad None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:00.032340 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e210466-26d4-4595-ab25-17b9cf8963ad None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:00.032340 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e210466-26d4-4595-ab25-17b9cf8963ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:00.047949 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 335/668] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:00.048147 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e210466-26d4-4595-ab25-17b9cf8963ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:00.048230 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92162a46-a4fe-4322-bbd4-d9a973af4522 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:00.048303 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e210466-26d4-4595-ab25-17b9cf8963ad None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:00.063422 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-8e210466-26d4-4595-ab25-17b9cf8963ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:00.063422 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:00.063422 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:00.063422 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:00.063422 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:00.063422 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:00.063422 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:00.063422 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:00.063422 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:00.063422 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:00.063422 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:00.063422 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:00.063422 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:00.063422 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:00.063422 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:00.063422 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:00.064406 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:00.064406 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:00.064406 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:00.064406 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:00.064406 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:00.064406 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:00.064406 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:00.064406 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:00.064406 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:00.064406 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:00.064406 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:00.064406 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:00.064406 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:00.064406 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:00.064406 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:00.064406 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:00.064406 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:00.065322 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:00.065322 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:00.065322 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:00.065322 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 334/669] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:50:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:00.065548 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e210466-26d4-4595-ab25-17b9cf8963ad None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:00.153504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92162a46-a4fe-4322-bbd4-d9a973af4522 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:00.172681 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e210466-26d4-4595-ab25-17b9cf8963ad None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:00.190650 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712a38c-f7e3-48d6-812b-af767e45f158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:00.191294 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712a38c-f7e3-48d6-812b-af767e45f158 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:00.191576 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712a38c-f7e3-48d6-812b-af767e45f158 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:00.191849 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712a38c-f7e3-48d6-812b-af767e45f158 None admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:00.192541 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e712a38c-f7e3-48d6-812b-af767e45f158 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:00.192971 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e712a38c-f7e3-48d6-812b-af767e45f158 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:00.194389 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e712a38c-f7e3-48d6-812b-af767e45f158 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:00.200002 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:00.208327 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 336/670] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:51:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:00.208700 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ff644-c249-4213-bce7-19c976d1010f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:00.209086 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712a38c-f7e3-48d6-812b-af767e45f158 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:00.209864 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ff644-c249-4213-bce7-19c976d1010f None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:00.210347 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ff644-c249-4213-bce7-19c976d1010f None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:00.210820 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ff644-c249-4213-bce7-19c976d1010f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:00.227469 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ff644-c249-4213-bce7-19c976d1010f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:51:00.232904 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-781ff644-c249-4213-bce7-19c976d1010f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:51:00.232904 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:00.232904 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:00.232904 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:00.232904 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:00.232904 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:00.232904 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:00.232904 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:00.232904 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:00.232904 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:00.232904 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:00.232904 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:00.232904 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:51:00.232904 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:51:00.232904 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:51:00.232904 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:51:00.233820 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:51:00.233820 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:51:00.233820 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:51:00.233820 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:51:00.233820 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:00.233820 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:00.233820 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:00.233820 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:00.233820 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:00.233820 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:00.233820 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:00.233820 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:00.233820 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:00.233820 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:00.233820 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:00.233820 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:00.234678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:00.234678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:00.234678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:00.234678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:00.234678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:51:00.234678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:51:00.234678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:51:00.234678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:51:00.234678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:51:00.234678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:51:00.234678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:51:00.234678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:00.236545 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 335/671] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Aug 24 16:51:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:00.237467 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ff644-c249-4213-bce7-19c976d1010f None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:00.278691 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:00.334248 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712a38c-f7e3-48d6-812b-af767e45f158 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:00.359691 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ff644-c249-4213-bce7-19c976d1010f None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:00.372769 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc9baf-add3-4ba3-b3f6-27f6421821be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:00.373474 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc9baf-add3-4ba3-b3f6-27f6421821be None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:00.373682 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc9baf-add3-4ba3-b3f6-27f6421821be None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:00.373955 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc9baf-add3-4ba3-b3f6-27f6421821be None admin] PATH_INFO: `/v3/projects/service` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:00.380923 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc9baf-add3-4ba3-b3f6-27f6421821be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:00.382366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc9baf-add3-4ba3-b3f6-27f6421821be None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:00.394216 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-39cc9baf-add3-4ba3-b3f6-27f6421821be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:00.394216 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:00.394216 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:00.394216 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:00.394216 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:00.394216 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:00.394216 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:00.394216 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:00.394216 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:00.394216 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:00.394216 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:00.394216 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:00.394216 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:51:00.394216 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:51:00.394216 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:51:00.395169 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:51:00.395169 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:00.395169 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:00.395169 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:00.395169 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:00.395169 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:00.395169 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:00.395169 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:00.395169 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:00.395169 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:00.395169 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:00.395169 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:00.395169 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:00.395169 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:00.395169 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:00.395169 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:00.395169 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:00.396067 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:51:00.396067 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:51:00.396067 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:51:00.396067 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:51:00.396067 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:51:00.396067 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:51:00.396067 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:00.396067 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:00.396067 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 337/672] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:51:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:00.396067 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc9baf-add3-4ba3-b3f6-27f6421821be None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:00.403637 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0daab2-8cd5-4525-945b-eb4babb60cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:00.404260 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0daab2-8cd5-4525-945b-eb4babb60cce None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:00.404540 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0daab2-8cd5-4525-945b-eb4babb60cce None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:00.404813 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0daab2-8cd5-4525-945b-eb4babb60cce None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:00.405463 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0daab2-8cd5-4525-945b-eb4babb60cce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:00.405772 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0daab2-8cd5-4525-945b-eb4babb60cce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:00.407183 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0daab2-8cd5-4525-945b-eb4babb60cce None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:00.420036 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 336/673] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:00.420851 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0daab2-8cd5-4525-945b-eb4babb60cce None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:00.476466 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:00.515233 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc9baf-add3-4ba3-b3f6-27f6421821be None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:00.527916 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0daab2-8cd5-4525-945b-eb4babb60cce None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:00.528788 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:00.558019 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baab710-3ca2-47aa-9045-82e43329f9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:00.558653 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baab710-3ca2-47aa-9045-82e43329f9b5 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:00.558909 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baab710-3ca2-47aa-9045-82e43329f9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:00.559210 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baab710-3ca2-47aa-9045-82e43329f9b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:00.559940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baab710-3ca2-47aa-9045-82e43329f9b5 None admin] RBAC: Adding query filter params (role.id=494c75ed8f864e3b955fdb043e96c675, scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642, user.id=3a6aad0e9f5f4a0b9578a31082e726cc) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:00.560249 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baab710-3ca2-47aa-9045-82e43329f9b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:00.561685 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baab710-3ca2-47aa-9045-82e43329f9b5 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:00.568166 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a8fa9-818c-4866-baf3-1e05829b0881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:00.568336 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 338/674] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:51:00 2022] GET /identity/v3/role_assignments?user.id=3a6aad0e9f5f4a0b9578a31082e726cc&scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642&role.id=494c75ed8f864e3b955fdb043e96c675 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:00.568970 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baab710-3ca2-47aa-9045-82e43329f9b5 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:00.569383 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a8fa9-818c-4866-baf3-1e05829b0881 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:00.569726 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a8fa9-818c-4866-baf3-1e05829b0881 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:00.570091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a8fa9-818c-4866-baf3-1e05829b0881 None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:00.570889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a8fa9-818c-4866-baf3-1e05829b0881 None admin] RBAC: Adding query filter params (name=service) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:00.571284 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a8fa9-818c-4866-baf3-1e05829b0881 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:00.572790 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a8fa9-818c-4866-baf3-1e05829b0881 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:00.593148 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 337/675] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Aug 24 16:51:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:00.594240 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a8fa9-818c-4866-baf3-1e05829b0881 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:00.704501 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baab710-3ca2-47aa-9045-82e43329f9b5 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:00.728227 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a8fa9-818c-4866-baf3-1e05829b0881 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:00.741974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:00.760620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d68b18-8aa9-4e4e-9c69-93f8a4fe81dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:00.761611 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d68b18-8aa9-4e4e-9c69-93f8a4fe81dd None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:00.762114 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d68b18-8aa9-4e4e-9c69-93f8a4fe81dd None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:00.762578 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d68b18-8aa9-4e4e-9c69-93f8a4fe81dd None admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:00.763383 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d68b18-8aa9-4e4e-9c69-93f8a4fe81dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:00.763692 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d68b18-8aa9-4e4e-9c69-93f8a4fe81dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:00.765244 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d68b18-8aa9-4e4e-9c69-93f8a4fe81dd None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:00.770683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f274686-d40f-43f4-938d-3e48a45ea984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:00.771363 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f274686-d40f-43f4-938d-3e48a45ea984 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:00.771643 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f274686-d40f-43f4-938d-3e48a45ea984 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:00.771914 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f274686-d40f-43f4-938d-3e48a45ea984 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:00.781259 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 339/676] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:51:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:00.782108 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d68b18-8aa9-4e4e-9c69-93f8a4fe81dd None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:00.787073 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f274686-d40f-43f4-938d-3e48a45ea984 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:00.788646 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f274686-d40f-43f4-938d-3e48a45ea984 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:00.802684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-6f274686-d40f-43f4-938d-3e48a45ea984 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:00.802684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:00.802684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:00.802684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:00.802684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:00.802684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:00.802684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:00.802684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:00.802684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:00.802684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:00.802684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:00.802684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:00.802684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:51:00.802684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:51:00.802684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:51:00.803684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:51:00.803684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:00.803684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:00.803684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:00.803684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:00.803684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:00.803684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:00.803684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:00.803684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:00.803684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:00.803684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:00.803684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:00.803684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:00.803684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:00.803684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:00.803684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:00.803684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:00.804601 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:51:00.804601 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:51:00.804601 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:51:00.804601 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:51:00.804601 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:51:00.804601 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:51:00.804601 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:00.804601 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:00.806481 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 338/677] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:51:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:00.806481 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0ace8-1df5-42cf-a877-8a666c613ef0 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:00.807237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0ace8-1df5-42cf-a877-8a666c613ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:00.807237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0ace8-1df5-42cf-a877-8a666c613ef0 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:00.808499 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 339/678] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:00.809208 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d0ace8-1df5-42cf-a877-8a666c613ef0 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:00.823155 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:00.906642 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d68b18-8aa9-4e4e-9c69-93f8a4fe81dd None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:00.926029 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d0ace8-1df5-42cf-a877-8a666c613ef0 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:00.942880 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28bccf9-9109-4e36-8f3e-618ccd72626e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:00.943631 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28bccf9-9109-4e36-8f3e-618ccd72626e None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:00.943981 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28bccf9-9109-4e36-8f3e-618ccd72626e None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:00.944324 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28bccf9-9109-4e36-8f3e-618ccd72626e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:00.956184 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28bccf9-9109-4e36-8f3e-618ccd72626e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:00.957640 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28bccf9-9109-4e36-8f3e-618ccd72626e None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:00.962162 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dcf943-3d98-4d22-8e94-a234da1aa54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:00.962901 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcf943-3d98-4d22-8e94-a234da1aa54f None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:00.963208 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcf943-3d98-4d22-8e94-a234da1aa54f None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:00.963487 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dcf943-3d98-4d22-8e94-a234da1aa54f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:00.964215 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dcf943-3d98-4d22-8e94-a234da1aa54f None admin] RBAC: Adding query filter params (role.id=494c75ed8f864e3b955fdb043e96c675, scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642, user.id=88ce8df89a96460ca046f2972321bceb) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:00.964519 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dcf943-3d98-4d22-8e94-a234da1aa54f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:00.965937 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dcf943-3d98-4d22-8e94-a234da1aa54f None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:00.979233 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 340/679] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:51:00 2022] GET /identity/v3/role_assignments?user.id=88ce8df89a96460ca046f2972321bceb&scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642&role.id=494c75ed8f864e3b955fdb043e96c675 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:00.979233 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dcf943-3d98-4d22-8e94-a234da1aa54f None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:00.979505 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-d28bccf9-9109-4e36-8f3e-618ccd72626e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:00.979505 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:00.979505 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:00.979505 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:00.979505 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:00.979505 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:00.979505 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:00.979505 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:00.979505 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:00.979505 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:00.979505 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:00.979505 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:00.979505 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:00.979505 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:00.979505 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:00.979505 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:00.980391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:00.980391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:00.980391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:00.980391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:00.980391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:00.980391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:00.980391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:00.980391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:00.980391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:00.980391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:00.980391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:00.980391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:00.980391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:00.980391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:00.980391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:00.980391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:00.980391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:00.981287 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:00.981287 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:00.981287 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:00.981287 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 340/680] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:00.981287 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2b79e-ca95-425d-887d-1df26793db21 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:00.981287 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2b79e-ca95-425d-887d-1df26793db21 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:00.981287 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2b79e-ca95-425d-887d-1df26793db21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:01.003687 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-a0f2b79e-ca95-425d-887d-1df26793db21 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:01.004917 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-a0f2b79e-ca95-425d-887d-1df26793db21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:01.026157 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:01.107707 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 341/681] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:51:01.108737 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2b79e-ca95-425d-887d-1df26793db21 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:01.113701 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dcf943-3d98-4d22-8e94-a234da1aa54f None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:01.137831 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:01.160743 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15b2cc-39d1-4c10-a945-40ce3301e54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:01.161364 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15b2cc-39d1-4c10-a945-40ce3301e54f None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:01.161644 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15b2cc-39d1-4c10-a945-40ce3301e54f None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:01.161918 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb15b2cc-39d1-4c10-a945-40ce3301e54f None admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:01.167132 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb15b2cc-39d1-4c10-a945-40ce3301e54f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:01.167132 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb15b2cc-39d1-4c10-a945-40ce3301e54f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:01.167132 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb15b2cc-39d1-4c10-a945-40ce3301e54f None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:01.183292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 341/682] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:51:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:01.191458 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15b2cc-39d1-4c10-a945-40ce3301e54f None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:01.278317 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2b79e-ca95-425d-887d-1df26793db21 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:01.308191 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:01.315505 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb15b2cc-39d1-4c10-a945-40ce3301e54f None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:01.317911 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ebc90-1024-46b0-a801-305615fdcc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:01.319062 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ebc90-1024-46b0-a801-305615fdcc32 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:01.319552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ebc90-1024-46b0-a801-305615fdcc32 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:01.320006 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60ebc90-1024-46b0-a801-305615fdcc32 None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:01.322109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ebc90-1024-46b0-a801-305615fdcc32 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:01.324164 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ebc90-1024-46b0-a801-305615fdcc32 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:01.324503 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60ebc90-1024-46b0-a801-305615fdcc32 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:01.342440 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 342/683] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:01.344381 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ebc90-1024-46b0-a801-305615fdcc32 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:01.355256 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fdb09-09c5-454a-93cb-a635c6cdbab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:01.355876 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fdb09-09c5-454a-93cb-a635c6cdbab0 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:01.356156 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fdb09-09c5-454a-93cb-a635c6cdbab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:01.356543 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fdb09-09c5-454a-93cb-a635c6cdbab0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:01.357754 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2fdb09-09c5-454a-93cb-a635c6cdbab0 None admin] RBAC: Adding query filter params (role.id=494c75ed8f864e3b955fdb043e96c675, scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642, user.id=eb911b8748844a6488811ca03cb8d344) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:01.357754 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2fdb09-09c5-454a-93cb-a635c6cdbab0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:01.359023 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2fdb09-09c5-454a-93cb-a635c6cdbab0 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:01.371148 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 342/684] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:51:01 2022] GET /identity/v3/role_assignments?user.id=eb911b8748844a6488811ca03cb8d344&scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642&role.id=494c75ed8f864e3b955fdb043e96c675 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:01.428088 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fdb09-09c5-454a-93cb-a635c6cdbab0 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:01.455540 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:01.484054 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60ebc90-1024-46b0-a801-305615fdcc32 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:01.535699 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef9fc2-5174-4598-ba89-ac8c61e12e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:01.536260 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef9fc2-5174-4598-ba89-ac8c61e12e75 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:01.536541 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef9fc2-5174-4598-ba89-ac8c61e12e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:01.536812 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef9fc2-5174-4598-ba89-ac8c61e12e75 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:01.544562 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fdb09-09c5-454a-93cb-a635c6cdbab0 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:01.548853 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef9fc2-5174-4598-ba89-ac8c61e12e75 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:01.550531 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef9fc2-5174-4598-ba89-ac8c61e12e75 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:01.567752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-7cef9fc2-5174-4598-ba89-ac8c61e12e75 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:51:01.567752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:01.567752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:01.567752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:01.567752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:01.567752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:01.567752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:01.567752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:01.567752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:01.567752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:01.567752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:01.567752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:01.567752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:51:01.567752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:51:01.567752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:51:01.567752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:51:01.568783 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:01.568783 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:01.568783 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:51:01.568783 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:01.568783 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:51:01.568783 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:01.568783 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:01.568783 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:01.568783 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:01.568783 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:01.568783 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:01.568783 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:01.568783 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:01.568783 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:01.568783 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:01.568783 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:01.568783 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:01.568783 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:01.569735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:01.569735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:01.569735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:51:01.569735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:51:01.569735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:51:01.569735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:51:01.569735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:51:01.569735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:51:01.569735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:51:01.569735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:01.574954 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 343/685] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:51:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:01.576564 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef9fc2-5174-4598-ba89-ac8c61e12e75 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:01.629850 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390a29c-e69d-404d-a829-d528f1bb9e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:01.630800 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390a29c-e69d-404d-a829-d528f1bb9e83 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:01.631317 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390a29c-e69d-404d-a829-d528f1bb9e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:01.631771 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c390a29c-e69d-404d-a829-d528f1bb9e83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:01.647417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c390a29c-e69d-404d-a829-d528f1bb9e83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:51:01.654926 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-c390a29c-e69d-404d-a829-d528f1bb9e83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:51:01.654926 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:01.654926 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:01.654926 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:01.654926 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:01.654926 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:01.654926 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:01.654926 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:01.654926 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:01.654926 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:01.654926 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:01.654926 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:01.654926 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:51:01.654926 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:51:01.654926 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:51:01.654926 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:51:01.656892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:51:01.656892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:51:01.656892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:51:01.656892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:51:01.656892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:01.656892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:01.656892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:01.656892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:01.656892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:01.656892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:01.656892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:01.656892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:01.656892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:01.656892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:01.656892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:01.656892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:01.657782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:01.657782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:01.657782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:01.657782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:01.657782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:51:01.657782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:51:01.657782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:51:01.657782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:51:01.657782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:51:01.657782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:51:01.657782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:51:01.657782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:01.660636 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 343/686] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:51:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:51:01.667149 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390a29c-e69d-404d-a829-d528f1bb9e83 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:01.693034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:01.703100 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef9fc2-5174-4598-ba89-ac8c61e12e75 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:01.751845 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bcf8f-fae4-46c2-bff0-7c63bee27fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:01.752812 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bcf8f-fae4-46c2-bff0-7c63bee27fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:01.753477 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bcf8f-fae4-46c2-bff0-7c63bee27fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:01.754009 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bcf8f-fae4-46c2-bff0-7c63bee27fe0 None admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:01.755517 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217bcf8f-fae4-46c2-bff0-7c63bee27fe0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:01.756289 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217bcf8f-fae4-46c2-bff0-7c63bee27fe0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:01.758216 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217bcf8f-fae4-46c2-bff0-7c63bee27fe0 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:01.767492 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:01.783089 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 344/687] 10.222.0.55 () {56 vars in 1135 bytes} [Wed Aug 24 16:51:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:01.789060 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bcf8f-fae4-46c2-bff0-7c63bee27fe0 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:01.803580 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c390a29c-e69d-404d-a829-d528f1bb9e83 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:01.861122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35336a4-5a60-4024-84c3-b0f7ed3860cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:01.861763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35336a4-5a60-4024-84c3-b0f7ed3860cd None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:01.862046 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35336a4-5a60-4024-84c3-b0f7ed3860cd None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:01.862318 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35336a4-5a60-4024-84c3-b0f7ed3860cd None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:01.863648 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35336a4-5a60-4024-84c3-b0f7ed3860cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:01.863962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35336a4-5a60-4024-84c3-b0f7ed3860cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:01.865930 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35336a4-5a60-4024-84c3-b0f7ed3860cd None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:01.880570 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 344/688] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:51:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:01.887473 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35336a4-5a60-4024-84c3-b0f7ed3860cd None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:01.930135 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bcf8f-fae4-46c2-bff0-7c63bee27fe0 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:01.998564 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7695e-0164-4d78-bcf5-bef5a3a17403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:01.999208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7695e-0164-4d78-bcf5-bef5a3a17403 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:01.999494 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7695e-0164-4d78-bcf5-bef5a3a17403 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:01.999757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7695e-0164-4d78-bcf5-bef5a3a17403 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:02.049979 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:02.065294 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:02.076240 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c7695e-0164-4d78-bcf5-bef5a3a17403 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:02.077717 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c7695e-0164-4d78-bcf5-bef5a3a17403 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:02.102048 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35336a4-5a60-4024-84c3-b0f7ed3860cd None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:02.183853 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa6d75-f513-40ab-8c16-bb3c29b0d36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:02.184566 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa6d75-f513-40ab-8c16-bb3c29b0d36a None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:02.184849 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa6d75-f513-40ab-8c16-bb3c29b0d36a None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:02.185123 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa6d75-f513-40ab-8c16-bb3c29b0d36a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:02.188200 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 345/689] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:51:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:02.201393 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7695e-0164-4d78-bcf5-bef5a3a17403 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:02.205530 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa6d75-f513-40ab-8c16-bb3c29b0d36a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:02.206984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa6d75-f513-40ab-8c16-bb3c29b0d36a None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:02.236962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-0cfa6d75-f513-40ab-8c16-bb3c29b0d36a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:02.236962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:02.236962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:02.236962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:02.236962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:02.236962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:02.236962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:02.236962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:02.236962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:02.236962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:02.236962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:02.236962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:02.236962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:02.236962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:02.236962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:02.236962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:02.237991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:02.237991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:02.237991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:02.237991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:02.237991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:02.237991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:02.237991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:02.237991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:02.237991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:02.237991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:02.237991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:02.237991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:02.237991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:02.237991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:02.237991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:02.237991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:02.237991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:02.238893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:02.238893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:02.238893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:02.242310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 345/690] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:02.252762 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa6d75-f513-40ab-8c16-bb3c29b0d36a None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:02.386664 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:02.397551 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7695e-0164-4d78-bcf5-bef5a3a17403 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:02.446995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbad46-e66f-46bd-8efa-443267e7894c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:02.447683 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbad46-e66f-46bd-8efa-443267e7894c None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:02.447864 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa6d75-f513-40ab-8c16-bb3c29b0d36a None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:02.447976 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbad46-e66f-46bd-8efa-443267e7894c None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:02.448227 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbad46-e66f-46bd-8efa-443267e7894c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:02.467054 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbad46-e66f-46bd-8efa-443267e7894c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:02.468562 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbad46-e66f-46bd-8efa-443267e7894c None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:02.479709 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:02.489249 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1157bb1-9c57-400d-b46e-3044283fa4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:02.497647 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1157bb1-9c57-400d-b46e-3044283fa4b4 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:02.497647 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1157bb1-9c57-400d-b46e-3044283fa4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:02.497647 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1157bb1-9c57-400d-b46e-3044283fa4b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:02.497647 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1157bb1-9c57-400d-b46e-3044283fa4b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:02.497647 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1157bb1-9c57-400d-b46e-3044283fa4b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:02.497647 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1157bb1-9c57-400d-b46e-3044283fa4b4 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:02.500504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-4cfbad46-e66f-46bd-8efa-443267e7894c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:02.500504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:02.500504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:02.500504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:02.500504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:02.500504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:02.500504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:02.500504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:02.500504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:02.500504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:02.500504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:02.500504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:02.500504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:02.500504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:02.500504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:02.500504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:02.501496 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:02.501496 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:02.501496 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:02.501496 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:02.501496 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:02.501496 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:02.501496 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:02.501496 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:02.501496 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:02.501496 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:02.501496 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:02.501496 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:02.501496 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:02.501496 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:02.501496 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:02.501496 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:02.501496 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:02.502398 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:02.502398 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:02.502398 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:02.502398 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 346/691] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:51:02.512143 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbad46-e66f-46bd-8efa-443267e7894c None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:02.518980 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 346/692] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:02.532061 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1157bb1-9c57-400d-b46e-3044283fa4b4 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:02.649510 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1157bb1-9c57-400d-b46e-3044283fa4b4 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:02.688163 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c378742-5171-4b86-a79f-3e6a7462506b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:02.689200 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c378742-5171-4b86-a79f-3e6a7462506b None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:02.689686 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c378742-5171-4b86-a79f-3e6a7462506b None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:02.690163 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c378742-5171-4b86-a79f-3e6a7462506b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:02.698763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c378742-5171-4b86-a79f-3e6a7462506b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:02.700631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c378742-5171-4b86-a79f-3e6a7462506b None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:02.713751 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-3c378742-5171-4b86-a79f-3e6a7462506b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:51:02.713751 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:02.713751 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:02.713751 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:02.713751 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:02.713751 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:02.713751 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:02.713751 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:02.713751 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:02.713751 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:02.713751 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:02.713751 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:02.713751 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:51:02.713751 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:51:02.713751 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:51:02.713751 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:51:02.714747 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:02.714747 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:02.714747 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:51:02.714747 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:02.714747 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:51:02.714747 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:02.714747 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:02.714747 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:02.714747 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:02.714747 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:02.714747 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:02.714747 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:02.714747 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:02.714747 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:02.714747 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:02.714747 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:02.714747 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:02.714747 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:02.715749 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:02.715749 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:02.715749 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:51:02.715749 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:51:02.715749 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:51:02.715749 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:51:02.715749 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:51:02.715749 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:51:02.715749 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:51:02.715749 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:02.718291 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 347/693] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Aug 24 16:51:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:51:02.724236 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c378742-5171-4b86-a79f-3e6a7462506b None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:02.759779 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbad46-e66f-46bd-8efa-443267e7894c None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:02.825813 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de1264-8e74-4985-9a63-6730785209f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:02.827414 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:02.828465 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de1264-8e74-4985-9a63-6730785209f2 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:02.828958 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de1264-8e74-4985-9a63-6730785209f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:02.829587 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de1264-8e74-4985-9a63-6730785209f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:02.830448 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de1264-8e74-4985-9a63-6730785209f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:02.830974 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de1264-8e74-4985-9a63-6730785209f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:02.832584 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15de1264-8e74-4985-9a63-6730785209f2 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:02.847051 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 347/694] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:02.854490 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de1264-8e74-4985-9a63-6730785209f2 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:02.872799 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:02.939023 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c378742-5171-4b86-a79f-3e6a7462506b None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:02.987384 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993d4a88-4ea8-4902-916a-554c19f4c89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:02.988101 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d4a88-4ea8-4902-916a-554c19f4c89e None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:02.988415 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d4a88-4ea8-4902-916a-554c19f4c89e None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:02.988763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993d4a88-4ea8-4902-916a-554c19f4c89e None admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:02.989509 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d4a88-4ea8-4902-916a-554c19f4c89e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:02.989814 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d4a88-4ea8-4902-916a-554c19f4c89e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:02.991302 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993d4a88-4ea8-4902-916a-554c19f4c89e None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:03.015941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 348/695] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Aug 24 16:51:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:03.020544 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de77c0-6a2e-4d2b-a199-3fdd9bd845d7 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:03.020832 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de77c0-6a2e-4d2b-a199-3fdd9bd845d7 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:03.021108 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de77c0-6a2e-4d2b-a199-3fdd9bd845d7 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:03.028110 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de1264-8e74-4985-9a63-6730785209f2 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:03.029870 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 349/696] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:03.030825 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de77c0-6a2e-4d2b-a199-3fdd9bd845d7 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:03.066077 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77717a1-c9b9-443e-bd19-56054ec3c0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:03.066761 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77717a1-c9b9-443e-bd19-56054ec3c0c2 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:03.067041 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77717a1-c9b9-443e-bd19-56054ec3c0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:03.067351 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77717a1-c9b9-443e-bd19-56054ec3c0c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:03.075282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77717a1-c9b9-443e-bd19-56054ec3c0c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:03.076819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77717a1-c9b9-443e-bd19-56054ec3c0c2 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:03.088531 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-d77717a1-c9b9-443e-bd19-56054ec3c0c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:03.088531 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:03.088531 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:03.088531 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:03.088531 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:03.088531 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:03.088531 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:03.088531 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:03.088531 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:03.088531 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:03.088531 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:03.088531 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:03.088531 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:51:03.088531 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:51:03.088531 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:51:03.089446 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:51:03.089446 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:03.089446 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:03.089446 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:03.089446 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:03.089446 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:03.089446 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:03.089446 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:03.089446 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:03.089446 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:03.089446 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:03.089446 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:03.089446 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:03.089446 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:03.089446 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:03.089446 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:03.089446 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:03.090329 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:51:03.090329 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:51:03.090329 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:51:03.090329 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:51:03.090329 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:51:03.090329 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:51:03.090329 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:03.090329 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:03.090329 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 348/697] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:51:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:51:03.091288 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d52aa-8c63-4924-804c-84fe7374e7f8 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:03.091460 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d52aa-8c63-4924-804c-84fe7374e7f8 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:03.096034 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d52aa-8c63-4924-804c-84fe7374e7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:03.111369 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-547d52aa-8c63-4924-804c-84fe7374e7f8 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:03.112565 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-547d52aa-8c63-4924-804c-84fe7374e7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:03.154466 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de77c0-6a2e-4d2b-a199-3fdd9bd845d7 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:03.167905 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:03.180682 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:03.195743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 349/698] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:51:03.195743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d52aa-8c63-4924-804c-84fe7374e7f8 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:03.210616 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11775326-3899-4650-b859-ba6335d86587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:03.212146 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11775326-3899-4650-b859-ba6335d86587 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:03.212423 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11775326-3899-4650-b859-ba6335d86587 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:03.212692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11775326-3899-4650-b859-ba6335d86587 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:03.344137 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11775326-3899-4650-b859-ba6335d86587 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:03.347969 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11775326-3899-4650-b859-ba6335d86587 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:03.405316 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d52aa-8c63-4924-804c-84fe7374e7f8 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:03.482660 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 350/699] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:51:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:03.489953 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11775326-3899-4650-b859-ba6335d86587 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:03.495414 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c232b-257e-41f2-bc64-4694e7be2581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:03.496342 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c232b-257e-41f2-bc64-4694e7be2581 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:03.496823 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c232b-257e-41f2-bc64-4694e7be2581 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:03.497288 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c232b-257e-41f2-bc64-4694e7be2581 None admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:03.498182 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c232b-257e-41f2-bc64-4694e7be2581 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:03.498712 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c232b-257e-41f2-bc64-4694e7be2581 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:03.500437 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c232b-257e-41f2-bc64-4694e7be2581 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:03.509904 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:03.516973 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 350/700] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:51:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:03.518090 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c232b-257e-41f2-bc64-4694e7be2581 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:03.580109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:03.613548 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11775326-3899-4650-b859-ba6335d86587 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:03.627388 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c232b-257e-41f2-bc64-4694e7be2581 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:03.650748 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fab38-9240-4cff-b3f6-3081750d3067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:03.652094 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fab38-9240-4cff-b3f6-3081750d3067 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:03.652583 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fab38-9240-4cff-b3f6-3081750d3067 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:03.652916 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fab38-9240-4cff-b3f6-3081750d3067 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:03.663462 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb5273f-4da5-4a45-a730-fbac19803855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:03.664180 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5273f-4da5-4a45-a730-fbac19803855 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:03.664453 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5273f-4da5-4a45-a730-fbac19803855 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:03.664723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb5273f-4da5-4a45-a730-fbac19803855 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:03.665816 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264fab38-9240-4cff-b3f6-3081750d3067 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:03.667735 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264fab38-9240-4cff-b3f6-3081750d3067 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:03.676549 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb5273f-4da5-4a45-a730-fbac19803855 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:03.678018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb5273f-4da5-4a45-a730-fbac19803855 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:03.684994 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-264fab38-9240-4cff-b3f6-3081750d3067 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:03.684994 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:03.684994 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:03.684994 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:03.684994 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:03.684994 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:03.684994 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:03.684994 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:03.684994 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:03.684994 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:03.684994 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:03.684994 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:03.684994 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:03.684994 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:03.684994 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:03.684994 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:03.685965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:03.685965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:03.685965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:03.685965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:03.685965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:03.685965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:03.685965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:03.685965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:03.685965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:03.685965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:03.685965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:03.685965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:03.685965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:03.685965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:03.685965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:03.685965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:03.685965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:03.687667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:03.687667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:03.687667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:03.687667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 351/701] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:03.687667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fab38-9240-4cff-b3f6-3081750d3067 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:03.699255 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-3eb5273f-4da5-4a45-a730-fbac19803855 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:03.699255 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:03.699255 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:03.699255 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:03.699255 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:03.699255 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:03.699255 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:03.699255 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:03.699255 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:03.699255 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:03.699255 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:03.699255 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:03.699255 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:03.699255 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:03.699255 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:03.699255 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:03.706221 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:03.706221 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:03.706221 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:03.706221 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:03.706221 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:03.706221 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:03.706221 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:03.706221 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:03.706221 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:03.706221 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:03.706221 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:03.706221 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:03.706221 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:03.706221 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:03.706221 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:03.706221 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:03.706221 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:03.707556 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:03.707556 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:03.707556 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:03.707556 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 351/702] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:03.707556 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b651ad2-30c1-4ef0-8900-d9cba155066d None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:03.707556 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b651ad2-30c1-4ef0-8900-d9cba155066d None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:03.707556 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b651ad2-30c1-4ef0-8900-d9cba155066d None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:03.707556 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 352/703] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:03.707556 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b651ad2-30c1-4ef0-8900-d9cba155066d None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:03.764757 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:03.806719 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fab38-9240-4cff-b3f6-3081750d3067 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:03.814569 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b651ad2-30c1-4ef0-8900-d9cba155066d None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:03.823433 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:03.841738 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd2c10-d9fc-471b-af96-29dac5180b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:03.842338 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd2c10-d9fc-471b-af96-29dac5180b30 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:03.842905 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd2c10-d9fc-471b-af96-29dac5180b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:03.843038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd2c10-d9fc-471b-af96-29dac5180b30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:03.843739 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd2c10-d9fc-471b-af96-29dac5180b30 None admin] RBAC: Adding query filter params (role.id=494c75ed8f864e3b955fdb043e96c675, scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642, user.id=c067bc2d84b741d08ac47e40adae4b4f) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:03.844018 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd2c10-d9fc-471b-af96-29dac5180b30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:03.845426 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd2c10-d9fc-471b-af96-29dac5180b30 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:03.850311 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3188655-54da-4881-a4e8-5454e2a9c056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:03.850908 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3188655-54da-4881-a4e8-5454e2a9c056 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:03.851213 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3188655-54da-4881-a4e8-5454e2a9c056 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:03.851357 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 352/704] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:51:03 2022] GET /identity/v3/role_assignments?user.id=c067bc2d84b741d08ac47e40adae4b4f&scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642&role.id=494c75ed8f864e3b955fdb043e96c675 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:03.851770 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3188655-54da-4881-a4e8-5454e2a9c056 None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:03.852223 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd2c10-d9fc-471b-af96-29dac5180b30 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:03.852578 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3188655-54da-4881-a4e8-5454e2a9c056 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:03.852808 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3188655-54da-4881-a4e8-5454e2a9c056 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:03.857162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3188655-54da-4881-a4e8-5454e2a9c056 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:03.874905 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 353/705] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:03.876308 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113df96a-a556-4609-b89d-8200b0040259 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:03.876592 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113df96a-a556-4609-b89d-8200b0040259 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:03.876887 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113df96a-a556-4609-b89d-8200b0040259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:03.896111 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-113df96a-a556-4609-b89d-8200b0040259 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:03.897331 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-113df96a-a556-4609-b89d-8200b0040259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:03.979209 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 354/706] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:51:03.980552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688873a-f1a2-478c-b06d-1ab2f212c531 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:03.980875 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688873a-f1a2-478c-b06d-1ab2f212c531 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:03.981103 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688873a-f1a2-478c-b06d-1ab2f212c531 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:03.982543 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 355/707] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:03.983089 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688873a-f1a2-478c-b06d-1ab2f212c531 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:03.996827 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd2c10-d9fc-471b-af96-29dac5180b30 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:04.032769 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:04.048455 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1dbd2c-5c00-4b49-b3ce-ec28966d787b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:04.048681 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1dbd2c-5c00-4b49-b3ce-ec28966d787b None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:04.048904 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1dbd2c-5c00-4b49-b3ce-ec28966d787b None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:04.049191 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1dbd2c-5c00-4b49-b3ce-ec28966d787b None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:04.049852 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1dbd2c-5c00-4b49-b3ce-ec28966d787b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:04.050136 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1dbd2c-5c00-4b49-b3ce-ec28966d787b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:04.051699 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1dbd2c-5c00-4b49-b3ce-ec28966d787b None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:04.067731 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 353/708] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:04.069463 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15ab5b-27fe-4492-8eee-e930383e3d27 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:04.069967 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15ab5b-27fe-4492-8eee-e930383e3d27 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:04.071710 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15ab5b-27fe-4492-8eee-e930383e3d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:04.091725 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-8e15ab5b-27fe-4492-8eee-e930383e3d27 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:04.093256 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-8e15ab5b-27fe-4492-8eee-e930383e3d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:04.108271 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:04.115843 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688873a-f1a2-478c-b06d-1ab2f212c531 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:04.158585 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca46ea-5b7a-42ce-92b5-d4434c13a333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:04.159253 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca46ea-5b7a-42ce-92b5-d4434c13a333 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:04.159533 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca46ea-5b7a-42ce-92b5-d4434c13a333 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:04.159800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffca46ea-5b7a-42ce-92b5-d4434c13a333 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:04.170706 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca46ea-5b7a-42ce-92b5-d4434c13a333 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:04.172898 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffca46ea-5b7a-42ce-92b5-d4434c13a333 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:04.176806 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 354/709] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:51:04.177638 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15ab5b-27fe-4492-8eee-e930383e3d27 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:04.188774 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-ffca46ea-5b7a-42ce-92b5-d4434c13a333 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:04.188774 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:04.188774 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:04.188774 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:04.188774 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:04.188774 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:04.188774 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:04.188774 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:04.188774 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:04.188774 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:04.188774 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:04.188774 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:04.188774 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:51:04.188774 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:51:04.188774 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:51:04.189709 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:51:04.189709 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:04.189709 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:04.189709 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:04.189709 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:04.189709 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:04.189709 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:04.189709 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:04.189709 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:04.189709 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:04.189709 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:04.189709 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:04.189709 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:04.189709 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:04.189709 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:04.189709 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:04.189709 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:04.190599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:51:04.190599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:51:04.190599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:51:04.190599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:51:04.190599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:51:04.190599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:51:04.190599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:04.190599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:04.191062 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 356/710] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:51:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:04.195760 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca46ea-5b7a-42ce-92b5-d4434c13a333 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:04.291510 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15ab5b-27fe-4492-8eee-e930383e3d27 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:04.314936 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:04.335721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43cb948-5911-4fbf-9890-106e88ff3010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:04.336837 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cb948-5911-4fbf-9890-106e88ff3010 None admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:04.337325 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cb948-5911-4fbf-9890-106e88ff3010 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:04.337515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43cb948-5911-4fbf-9890-106e88ff3010 None admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:04.338261 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43cb948-5911-4fbf-9890-106e88ff3010 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:04.338781 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffca46ea-5b7a-42ce-92b5-d4434c13a333 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:04.339823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43cb948-5911-4fbf-9890-106e88ff3010 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:04.379531 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1767200-79c9-43c7-8e3e-f966b86e28b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:04.380162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1767200-79c9-43c7-8e3e-f966b86e28b5 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:04.380445 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1767200-79c9-43c7-8e3e-f966b86e28b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:04.380719 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1767200-79c9-43c7-8e3e-f966b86e28b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:04.381422 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1767200-79c9-43c7-8e3e-f966b86e28b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:04.381731 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1767200-79c9-43c7-8e3e-f966b86e28b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:04.383845 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1767200-79c9-43c7-8e3e-f966b86e28b5 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:04.405235 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 357/711] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:51:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:04.405235 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1767200-79c9-43c7-8e3e-f966b86e28b5 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:04.427066 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 355/712] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Aug 24 16:51:04 2022] POST /identity/v3/users => generated 254 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:51:04.435839 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43cb948-5911-4fbf-9890-106e88ff3010 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:04.446023 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:04.575352 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1767200-79c9-43c7-8e3e-f966b86e28b5 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:04.601406 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43cb948-5911-4fbf-9890-106e88ff3010 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:04.627080 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37755057-f77f-4c0f-9590-4d44e40ee55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:04.628007 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37755057-f77f-4c0f-9590-4d44e40ee55b None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:04.628284 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37755057-f77f-4c0f-9590-4d44e40ee55b None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:04.628556 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37755057-f77f-4c0f-9590-4d44e40ee55b None admin] PATH_INFO: `/v3/services/network` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:04.629142 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37755057-f77f-4c0f-9590-4d44e40ee55b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:04.630499 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37755057-f77f-4c0f-9590-4d44e40ee55b None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:04.645540 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-37755057-f77f-4c0f-9590-4d44e40ee55b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 16:51:04.645540 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:04.645540 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:51:04.645540 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:51:04.645540 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:51:04.645540 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:51:04.645540 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:51:04.645540 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:04.645540 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 16:51:04.645540 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:04.645540 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:51:04.645540 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:04.645540 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:04.645540 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:04.645540 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:04.645540 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:04.645540 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:04.646652 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:04.646652 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:04.646652 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:04.646652 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:04.646652 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:04.646652 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:04.646652 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:51:04.646652 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:51:04.646652 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:51:04.646652 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:51:04.646652 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:04.646652 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:04.646652 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:04.646652 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:04.646652 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:04.646652 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:04.648364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:04.648364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:04.648364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:04.648364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:04.648364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:04.648364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:04.648364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:04.648364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:04.648364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:04.648364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:04.648364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:51:04.648364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:04.648364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 16:51:04.648364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:04.648364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 358/713] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:51:04 2022] GET /identity/v3/services/network => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:04.649739 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37755057-f77f-4c0f-9590-4d44e40ee55b None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:04.654369 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893691d1-ccb6-4ec0-afb7-de91e34ef5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:04.654988 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893691d1-ccb6-4ec0-afb7-de91e34ef5ea None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:04.655315 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893691d1-ccb6-4ec0-afb7-de91e34ef5ea None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:04.655594 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893691d1-ccb6-4ec0-afb7-de91e34ef5ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:04.657352 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893691d1-ccb6-4ec0-afb7-de91e34ef5ea None admin] RBAC: Adding query filter params (role.id=99f0ace9fc4d4d028ca52fa9730cab4b, scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642, user.id=28a1c617fc264b118e61f2a97ecb3f39) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:04.657670 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893691d1-ccb6-4ec0-afb7-de91e34ef5ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:04.659143 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893691d1-ccb6-4ec0-afb7-de91e34ef5ea None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:04.670391 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 356/714] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:51:04 2022] GET /identity/v3/role_assignments?user.id=28a1c617fc264b118e61f2a97ecb3f39&scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642&role.id=99f0ace9fc4d4d028ca52fa9730cab4b => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:04.670865 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893691d1-ccb6-4ec0-afb7-de91e34ef5ea None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:04.746463 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:04.775888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:04.799069 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37755057-f77f-4c0f-9590-4d44e40ee55b None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:04.852878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893691d1-ccb6-4ec0-afb7-de91e34ef5ea None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:04.859269 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85041be2-9b76-47f0-9187-d3a129973dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:04.860427 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85041be2-9b76-47f0-9187-d3a129973dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:04.860427 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85041be2-9b76-47f0-9187-d3a129973dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:04.860597 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85041be2-9b76-47f0-9187-d3a129973dd3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:04.861662 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85041be2-9b76-47f0-9187-d3a129973dd3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:04.862572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85041be2-9b76-47f0-9187-d3a129973dd3 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:04.877493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-85041be2-9b76-47f0-9187-d3a129973dd3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 16:51:04.877493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:04.877493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:51:04.877493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:51:04.877493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:51:04.877493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:51:04.877493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:51:04.877493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:04.877493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 16:51:04.877493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:04.877493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:51:04.877493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:04.877493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:04.877493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:04.877493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:04.877493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:04.877493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:04.878691 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:04.878691 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:04.878691 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:04.878691 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:04.878691 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:04.878691 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:04.878691 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:51:04.878691 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:51:04.878691 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:51:04.878691 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:51:04.878691 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:04.878691 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:04.878691 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:04.878691 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:04.878691 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:04.878691 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:04.879592 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:04.879592 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:04.879592 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:04.879592 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:04.879592 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:04.879592 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:04.879592 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:04.879592 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:04.879592 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:04.879592 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:04.879592 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:51:04.879592 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:04.879592 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 16:51:04.879592 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:04.883412 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 359/715] 10.222.0.55 () {56 vars in 1129 bytes} [Wed Aug 24 16:51:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:04.886004 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85041be2-9b76-47f0-9187-d3a129973dd3 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:04.906892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d86eb9-b91d-4591-a811-690b46465698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:04.907915 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d86eb9-b91d-4591-a811-690b46465698 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:04.908375 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d86eb9-b91d-4591-a811-690b46465698 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:04.908881 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d86eb9-b91d-4591-a811-690b46465698 None admin] PATH_INFO: `/v3/services` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:04.909786 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d86eb9-b91d-4591-a811-690b46465698 None admin] RBAC: Adding query filter params (name=network) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:04.910270 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d86eb9-b91d-4591-a811-690b46465698 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:04.912029 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d86eb9-b91d-4591-a811-690b46465698 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:04.924840 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 357/716] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Aug 24 16:51:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:04.930984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d86eb9-b91d-4591-a811-690b46465698 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:05.015461 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85041be2-9b76-47f0-9187-d3a129973dd3 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:05.051645 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe97626-912c-4708-a38d-1cc94e01ba5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:05.052289 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe97626-912c-4708-a38d-1cc94e01ba5e None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:05.052528 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe97626-912c-4708-a38d-1cc94e01ba5e None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:05.052795 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe97626-912c-4708-a38d-1cc94e01ba5e None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:05.053516 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe97626-912c-4708-a38d-1cc94e01ba5e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:05.053825 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe97626-912c-4708-a38d-1cc94e01ba5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:05.055771 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe97626-912c-4708-a38d-1cc94e01ba5e None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:05.065394 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 360/717] 10.222.0.55 () {56 vars in 1124 bytes} [Wed Aug 24 16:51:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:05.066868 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe97626-912c-4708-a38d-1cc94e01ba5e None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:05.078985 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:05.171597 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:05.174650 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe97626-912c-4708-a38d-1cc94e01ba5e None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:05.175753 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d86eb9-b91d-4591-a811-690b46465698 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:05.227673 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254ca49-ac58-4224-8692-32348214182b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:05.228675 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254ca49-ac58-4224-8692-32348214182b None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:05.229162 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254ca49-ac58-4224-8692-32348214182b None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:05.229640 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254ca49-ac58-4224-8692-32348214182b None admin] PATH_INFO: `/v3/services` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:05.230599 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3254ca49-ac58-4224-8692-32348214182b None admin] RBAC: Adding query filter params (type=network) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:05.231354 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3254ca49-ac58-4224-8692-32348214182b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:05.234061 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3254ca49-ac58-4224-8692-32348214182b None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:05.247258 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 358/718] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Aug 24 16:51:04 2022] GET /identity/v3/services?type=network => generated 124 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:05.252572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da9c0f-bd9b-49ea-a183-17611632eccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:05.253636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da9c0f-bd9b-49ea-a183-17611632eccf None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:05.254124 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da9c0f-bd9b-49ea-a183-17611632eccf None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:05.254691 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da9c0f-bd9b-49ea-a183-17611632eccf None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:05.255725 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da9c0f-bd9b-49ea-a183-17611632eccf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:05.256328 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da9c0f-bd9b-49ea-a183-17611632eccf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:05.258223 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da9c0f-bd9b-49ea-a183-17611632eccf None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:05.265568 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 361/719] 10.222.0.55 () {56 vars in 1124 bytes} [Wed Aug 24 16:51:05 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:06.146327 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e85f3c-6bb6-457f-a21a-5c4e0e57816c None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:06.147370 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e85f3c-6bb6-457f-a21a-5c4e0e57816c None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:06.147942 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e85f3c-6bb6-457f-a21a-5c4e0e57816c None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:06.150579 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 359/720] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:06.162343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082a28a-154a-41b5-88a9-b2038361c34b None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:06.163339 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082a28a-154a-41b5-88a9-b2038361c34b None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:06.164432 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082a28a-154a-41b5-88a9-b2038361c34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:06.187663 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-b082a28a-154a-41b5-88a9-b2038361c34b None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:06.195210 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-b082a28a-154a-41b5-88a9-b2038361c34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:06.269334 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 362/721] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:51:06.772175 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e85f3c-6bb6-457f-a21a-5c4e0e57816c None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:06.816928 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21a115-2486-42d5-b362-e02c433fd64f None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:06.817284 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21a115-2486-42d5-b362-e02c433fd64f None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:06.817485 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21a115-2486-42d5-b362-e02c433fd64f None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:06.819221 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 363/722] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:51:06.825186 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded66d50-f844-4657-9a73-fc4da97572e4 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:06.825489 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded66d50-f844-4657-9a73-fc4da97572e4 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:06.825723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded66d50-f844-4657-9a73-fc4da97572e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:06.839133 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:06.861818 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-ded66d50-f844-4657-9a73-fc4da97572e4 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:06.870802 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-ded66d50-f844-4657-9a73-fc4da97572e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:06.924453 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e85f3c-6bb6-457f-a21a-5c4e0e57816c None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:06.966974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562677df-979d-4a24-a242-632942b3c9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:06.967656 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562677df-979d-4a24-a242-632942b3c9dc None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:06.967932 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562677df-979d-4a24-a242-632942b3c9dc None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:06.968201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562677df-979d-4a24-a242-632942b3c9dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:06.983445 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562677df-979d-4a24-a242-632942b3c9dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:51:06.989392 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 364/723] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 16:51:06.989526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-562677df-979d-4a24-a242-632942b3c9dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:51:06.989526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:06.989526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:06.989526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:06.989526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:06.989526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:06.989526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:06.989526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:06.989526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:06.989526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:06.989526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:06.989526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:06.989526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:51:06.989526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:51:06.989526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:51:06.989526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:51:06.990398 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:51:06.990398 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:51:06.990398 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:51:06.990398 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:51:06.990398 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:06.990398 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:06.990398 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:06.990398 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:06.990398 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:06.990398 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:06.990398 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:06.990398 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:06.990398 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:06.990398 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:06.990398 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:06.990398 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:06.991312 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:06.991312 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:06.991312 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:06.991312 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:06.991312 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:51:06.991312 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:51:06.991312 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:51:06.991312 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:51:06.991312 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:51:06.991312 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:51:06.991312 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:51:06.991312 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:06.991312 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 360/724] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:51:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:06.996813 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562677df-979d-4a24-a242-632942b3c9dc None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:07.023702 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:07.076872 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3cb4f-b061-4b02-8047-5708a2fea6b6 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:07.077198 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3cb4f-b061-4b02-8047-5708a2fea6b6 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:07.077413 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3cb4f-b061-4b02-8047-5708a2fea6b6 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:07.079022 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 365/725] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:51:07.088437 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aeed86-f163-428f-b56c-e79854b0d67c None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:07.088722 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aeed86-f163-428f-b56c-e79854b0d67c None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:07.088983 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aeed86-f163-428f-b56c-e79854b0d67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:07.105098 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562677df-979d-4a24-a242-632942b3c9dc None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:07.139038 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-a2aeed86-f163-428f-b56c-e79854b0d67c None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:07.140252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-a2aeed86-f163-428f-b56c-e79854b0d67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:07.150077 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb124ee-df09-4ab0-bd19-14c80839c414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:07.150708 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb124ee-df09-4ab0-bd19-14c80839c414 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:07.150964 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb124ee-df09-4ab0-bd19-14c80839c414 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:07.151302 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb124ee-df09-4ab0-bd19-14c80839c414 None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:07.151974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb124ee-df09-4ab0-bd19-14c80839c414 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:07.152331 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb124ee-df09-4ab0-bd19-14c80839c414 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:07.155471 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb124ee-df09-4ab0-bd19-14c80839c414 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:07.180917 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 361/726] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:51:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:07.195412 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb124ee-df09-4ab0-bd19-14c80839c414 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:07.313237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb124ee-df09-4ab0-bd19-14c80839c414 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:07.335525 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:07.345238 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 366/727] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:51:07.350506 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621745bc-d40d-40b7-a90a-4ad04e938a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:07.351821 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621745bc-d40d-40b7-a90a-4ad04e938a75 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:07.352287 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621745bc-d40d-40b7-a90a-4ad04e938a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:07.352840 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621745bc-d40d-40b7-a90a-4ad04e938a75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:07.364393 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621745bc-d40d-40b7-a90a-4ad04e938a75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:07.365868 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621745bc-d40d-40b7-a90a-4ad04e938a75 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:07.383873 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-621745bc-d40d-40b7-a90a-4ad04e938a75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:07.383873 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:07.383873 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:07.383873 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:07.383873 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:07.383873 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:07.383873 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:07.383873 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:07.383873 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:07.383873 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:07.383873 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:07.383873 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:07.383873 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:07.383873 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:07.383873 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:07.383873 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:07.384875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:07.384875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:07.384875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:07.384875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:07.384875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:07.384875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:07.384875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:07.384875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:07.384875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:07.384875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:07.384875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:07.384875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:07.384875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:07.384875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:07.384875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:07.384875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:07.384875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:07.385771 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:07.385771 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:07.385771 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:07.385771 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 362/728] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:51:07.391001 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aeed86-f163-428f-b56c-e79854b0d67c None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:07.403080 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621745bc-d40d-40b7-a90a-4ad04e938a75 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:07.530228 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:07.599810 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621745bc-d40d-40b7-a90a-4ad04e938a75 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:07.611610 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aeed86-f163-428f-b56c-e79854b0d67c None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:07.663097 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf202b-9a22-4592-a84b-f62ad4824849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:07.664268 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf202b-9a22-4592-a84b-f62ad4824849 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:07.664782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf202b-9a22-4592-a84b-f62ad4824849 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:07.665065 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cf202b-9a22-4592-a84b-f62ad4824849 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:07.667819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58249a40-68a0-4ea0-8bc1-88501d1c816e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:07.668433 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58249a40-68a0-4ea0-8bc1-88501d1c816e None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:07.668709 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58249a40-68a0-4ea0-8bc1-88501d1c816e None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:07.668976 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58249a40-68a0-4ea0-8bc1-88501d1c816e None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:07.669620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58249a40-68a0-4ea0-8bc1-88501d1c816e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:07.669919 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58249a40-68a0-4ea0-8bc1-88501d1c816e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:07.671325 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58249a40-68a0-4ea0-8bc1-88501d1c816e None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:07.672292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:07.676955 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cf202b-9a22-4592-a84b-f62ad4824849 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:51:07.684507 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-f2cf202b-9a22-4592-a84b-f62ad4824849 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:51:07.684507 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:07.684507 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:07.684507 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:07.684507 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:07.684507 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:07.684507 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:07.684507 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:07.684507 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:07.684507 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:07.684507 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:07.684507 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:07.684507 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:51:07.684507 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:51:07.684507 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:51:07.684507 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:51:07.687975 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:51:07.687975 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:51:07.687975 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:51:07.687975 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:51:07.687975 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:07.687975 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:07.687975 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:07.687975 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:07.687975 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:07.687975 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:07.687975 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:07.687975 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:07.687975 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:07.687975 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:07.687975 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:07.687975 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:07.689053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:07.689053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:07.689053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:07.689053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:07.689053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:51:07.689053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:51:07.689053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:51:07.689053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:51:07.689053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:51:07.689053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:51:07.689053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:51:07.689053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:07.689053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 363/729] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Aug 24 16:51:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:07.689053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf202b-9a22-4592-a84b-f62ad4824849 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:07.690142 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 367/730] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:07.692157 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58249a40-68a0-4ea0-8bc1-88501d1c816e None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:07.803158 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58249a40-68a0-4ea0-8bc1-88501d1c816e None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:07.810221 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cf202b-9a22-4592-a84b-f62ad4824849 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:07.826921 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:07.838574 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708f81f-665e-4ed1-b243-039eec65f665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:07.839206 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708f81f-665e-4ed1-b243-039eec65f665 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:07.840001 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708f81f-665e-4ed1-b243-039eec65f665 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:07.840001 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708f81f-665e-4ed1-b243-039eec65f665 None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:07.840408 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708f81f-665e-4ed1-b243-039eec65f665 None admin] RBAC: Adding query filter params (name=service) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:07.840696 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708f81f-665e-4ed1-b243-039eec65f665 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:07.842102 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708f81f-665e-4ed1-b243-039eec65f665 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:07.846951 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da91855e-3c2c-4f15-83fb-0cf68a03c140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:07.847789 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91855e-3c2c-4f15-83fb-0cf68a03c140 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:07.848165 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91855e-3c2c-4f15-83fb-0cf68a03c140 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:07.848530 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da91855e-3c2c-4f15-83fb-0cf68a03c140 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:07.851866 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 368/731] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Aug 24 16:51:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:07.853034 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708f81f-665e-4ed1-b243-039eec65f665 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:07.863847 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da91855e-3c2c-4f15-83fb-0cf68a03c140 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:51:07.870074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-da91855e-3c2c-4f15-83fb-0cf68a03c140 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:51:07.870074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:07.870074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:07.870074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:07.870074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:07.870074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:07.870074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:07.870074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:07.870074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:07.870074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:07.870074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:07.870074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:07.870074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:51:07.870074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:51:07.870074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:51:07.870074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:51:07.871081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:51:07.871081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:51:07.871081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:51:07.871081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:51:07.871081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:07.871081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:07.871081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:07.871081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:07.871081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:07.871081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:07.871081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:07.871081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:07.871081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:07.871081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:07.871081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:07.871081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:07.872631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:07.872631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:07.872631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:07.872631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:07.872631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:51:07.872631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:51:07.872631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:51:07.872631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:51:07.872631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:51:07.872631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:51:07.872631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:51:07.872631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:07.872631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 364/732] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:51:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:07.874011 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95926690-9264-467e-8c13-2f2acfcc20b7 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:07.874011 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95926690-9264-467e-8c13-2f2acfcc20b7 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:07.874011 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95926690-9264-467e-8c13-2f2acfcc20b7 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:07.874613 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 365/733] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:07.875457 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e231f5c-4cc2-4382-b015-9efdc06ccd15 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:07.875731 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e231f5c-4cc2-4382-b015-9efdc06ccd15 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:07.876001 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e231f5c-4cc2-4382-b015-9efdc06ccd15 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:07.877408 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 366/734] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:07.878128 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e231f5c-4cc2-4382-b015-9efdc06ccd15 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:07.940291 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:07.965067 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708f81f-665e-4ed1-b243-039eec65f665 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:07.982154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e231f5c-4cc2-4382-b015-9efdc06ccd15 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:08.000084 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e349ee-eb4f-4b44-800a-51b8ff7c1956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:08.000711 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e349ee-eb4f-4b44-800a-51b8ff7c1956 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:08.000992 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e349ee-eb4f-4b44-800a-51b8ff7c1956 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:08.001291 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e349ee-eb4f-4b44-800a-51b8ff7c1956 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:08.009152 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e349ee-eb4f-4b44-800a-51b8ff7c1956 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:08.010593 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e349ee-eb4f-4b44-800a-51b8ff7c1956 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:08.016441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6258df8-b156-4118-a1da-6f9be514f266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:08.017064 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6258df8-b156-4118-a1da-6f9be514f266 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:08.017339 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6258df8-b156-4118-a1da-6f9be514f266 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:08.017608 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6258df8-b156-4118-a1da-6f9be514f266 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:08.022085 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-31e349ee-eb4f-4b44-800a-51b8ff7c1956 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:51:08.022085 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:08.022085 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:08.022085 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:08.022085 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:08.022085 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:08.022085 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:08.022085 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:08.022085 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:08.022085 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:08.022085 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:08.022085 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:08.022085 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:51:08.022085 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:51:08.022085 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:51:08.022085 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:51:08.023353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:08.023353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:08.023353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:51:08.023353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:08.023353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:51:08.023353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:08.023353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:08.023353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:08.023353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:08.023353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:08.023353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:08.023353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:08.023353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:08.023353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:08.023353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:08.023353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:08.023353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:08.023353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:08.024303 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:08.024303 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:08.024303 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:51:08.024303 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:51:08.024303 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:51:08.024303 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:51:08.024303 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:51:08.024303 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:51:08.024303 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:51:08.024303 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:08.024303 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 369/735] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:51:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:08.024892 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e349ee-eb4f-4b44-800a-51b8ff7c1956 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:08.029951 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6258df8-b156-4118-a1da-6f9be514f266 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:08.031444 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6258df8-b156-4118-a1da-6f9be514f266 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:08.045980 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-d6258df8-b156-4118-a1da-6f9be514f266 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:08.045980 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:08.045980 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:08.045980 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:08.045980 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:08.045980 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:08.045980 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:08.045980 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:08.045980 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:08.045980 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:08.045980 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:08.045980 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:08.045980 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:08.045980 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:08.045980 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:08.045980 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:08.046983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:08.046983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:08.046983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:08.046983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:08.046983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:08.046983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:08.046983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:08.046983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:08.046983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:08.046983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:08.046983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:08.046983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:08.046983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:08.046983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:08.046983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:08.046983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:08.046983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:08.047916 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:08.047916 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:08.047916 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:08.047916 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 367/736] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:08.048575 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95c67f-624e-405d-b7e1-51a7508dfe75 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:08.048575 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95c67f-624e-405d-b7e1-51a7508dfe75 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:08.048750 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba95c67f-624e-405d-b7e1-51a7508dfe75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:08.066933 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-ba95c67f-624e-405d-b7e1-51a7508dfe75 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:08.068154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-ba95c67f-624e-405d-b7e1-51a7508dfe75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:08.077241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:08.134482 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 368/737] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:51:08.135482 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e349ee-eb4f-4b44-800a-51b8ff7c1956 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:08.135698 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382662fd-38bd-49fe-ae94-e4af13d76d81 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:08.135976 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382662fd-38bd-49fe-ae94-e4af13d76d81 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:08.136252 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382662fd-38bd-49fe-ae94-e4af13d76d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:08.154073 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-382662fd-38bd-49fe-ae94-e4af13d76d81 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:08.155311 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-382662fd-38bd-49fe-ae94-e4af13d76d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:08.183075 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df89ef1-6879-49f5-a8f1-5037049d5310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:08.183617 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df89ef1-6879-49f5-a8f1-5037049d5310 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:08.183893 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df89ef1-6879-49f5-a8f1-5037049d5310 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:08.184160 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df89ef1-6879-49f5-a8f1-5037049d5310 None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:08.184984 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df89ef1-6879-49f5-a8f1-5037049d5310 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:08.185284 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df89ef1-6879-49f5-a8f1-5037049d5310 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:08.186896 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df89ef1-6879-49f5-a8f1-5037049d5310 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:08.199818 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 370/738] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:51:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:08.199818 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df89ef1-6879-49f5-a8f1-5037049d5310 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:08.200101 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:08.235464 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 369/739] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 16:51:08.236320 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382662fd-38bd-49fe-ae94-e4af13d76d81 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:08.343983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382662fd-38bd-49fe-ae94-e4af13d76d81 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:08.351939 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df89ef1-6879-49f5-a8f1-5037049d5310 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:08.362820 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:08.382442 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699f72f-ccc2-4272-9443-31af7009200f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:08.382907 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699f72f-ccc2-4272-9443-31af7009200f None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:08.383158 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699f72f-ccc2-4272-9443-31af7009200f None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:08.383372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699f72f-ccc2-4272-9443-31af7009200f None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:08.384023 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699f72f-ccc2-4272-9443-31af7009200f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:08.384329 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699f72f-ccc2-4272-9443-31af7009200f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:08.385835 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699f72f-ccc2-4272-9443-31af7009200f None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:08.403553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 370/740] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:08.404511 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699f72f-ccc2-4272-9443-31af7009200f None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:08.406995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba5a6d-6514-40fc-97ef-fc0e086913fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:08.407942 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba5a6d-6514-40fc-97ef-fc0e086913fd None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:08.409174 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba5a6d-6514-40fc-97ef-fc0e086913fd None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:08.409463 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba5a6d-6514-40fc-97ef-fc0e086913fd None admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:08.410209 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba5a6d-6514-40fc-97ef-fc0e086913fd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:08.410520 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba5a6d-6514-40fc-97ef-fc0e086913fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:08.411968 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba5a6d-6514-40fc-97ef-fc0e086913fd None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:08.436425 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:08.441638 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 371/741] 10.222.0.55 () {56 vars in 1135 bytes} [Wed Aug 24 16:51:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:08.441638 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba5a6d-6514-40fc-97ef-fc0e086913fd None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:08.510648 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699f72f-ccc2-4272-9443-31af7009200f None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:08.545979 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676bdb6-38de-48e0-b974-03acf4a46ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:08.546613 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676bdb6-38de-48e0-b974-03acf4a46ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:08.546886 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676bdb6-38de-48e0-b974-03acf4a46ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:08.547178 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676bdb6-38de-48e0-b974-03acf4a46ec0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:08.551764 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba5a6d-6514-40fc-97ef-fc0e086913fd None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:08.558226 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676bdb6-38de-48e0-b974-03acf4a46ec0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:08.559692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676bdb6-38de-48e0-b974-03acf4a46ec0 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:08.575561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-e676bdb6-38de-48e0-b974-03acf4a46ec0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:08.575561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:08.575561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:08.575561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:08.575561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:08.575561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:08.575561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:08.575561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:08.575561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:08.575561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:08.575561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:08.575561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:08.575561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:08.575561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:08.575561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:08.575561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:08.576735 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:08.576735 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:08.576735 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:08.576735 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:08.576735 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:08.576735 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:08.576735 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:08.576735 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:08.576735 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:08.576735 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:08.576735 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:08.576735 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:08.576735 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:08.576735 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:08.576735 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:08.576735 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:08.576735 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:08.577685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:08.577685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:08.577685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:08.577685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 371/742] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:08.577918 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676bdb6-38de-48e0-b974-03acf4a46ec0 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:08.591262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10edd3-14ec-45a2-962f-41de24705ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:08.591915 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10edd3-14ec-45a2-962f-41de24705ba5 None admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:08.592144 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10edd3-14ec-45a2-962f-41de24705ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:08.592416 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10edd3-14ec-45a2-962f-41de24705ba5 None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:08.593059 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10edd3-14ec-45a2-962f-41de24705ba5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:08.594420 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10edd3-14ec-45a2-962f-41de24705ba5 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:08.660136 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:08.677726 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676bdb6-38de-48e0-b974-03acf4a46ec0 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:08.701597 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 372/743] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Aug 24 16:51:08 2022] POST /identity/v3/services => generated 240 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:51:08.702513 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10edd3-14ec-45a2-962f-41de24705ba5 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:08.725459 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d27de9-599f-4e2e-84d9-871722c08450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:08.727511 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d27de9-599f-4e2e-84d9-871722c08450 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:08.728045 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d27de9-599f-4e2e-84d9-871722c08450 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:08.728531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d27de9-599f-4e2e-84d9-871722c08450 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:08.734792 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:08.738892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d27de9-599f-4e2e-84d9-871722c08450 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:08.740261 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d27de9-599f-4e2e-84d9-871722c08450 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:08.753441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-61d27de9-599f-4e2e-84d9-871722c08450 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:51:08.753441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:08.753441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:08.753441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:08.753441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:08.753441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:08.753441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:08.753441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:08.753441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:08.753441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:08.753441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:08.753441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:08.753441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:51:08.753441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:51:08.753441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:51:08.753441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:51:08.754532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:08.754532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:08.754532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:51:08.754532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:08.754532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:51:08.754532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:08.754532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:08.754532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:08.754532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:08.754532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:08.754532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:08.754532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:08.754532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:08.754532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:08.754532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:08.754532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:08.754532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:08.754532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:08.755976 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:08.755976 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:08.755976 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:51:08.755976 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:51:08.755976 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:51:08.755976 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:51:08.755976 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:51:08.755976 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:51:08.755976 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:51:08.755976 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:08.755976 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 372/744] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Aug 24 16:51:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:08.755976 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d27de9-599f-4e2e-84d9-871722c08450 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:08.832663 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10edd3-14ec-45a2-962f-41de24705ba5 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:08.875729 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1a94b-4227-4f3f-8321-6fb78cc43b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:08.876354 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1a94b-4227-4f3f-8321-6fb78cc43b7a None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:08.876873 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1a94b-4227-4f3f-8321-6fb78cc43b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:08.876873 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1a94b-4227-4f3f-8321-6fb78cc43b7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:08.884683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d27de9-599f-4e2e-84d9-871722c08450 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:08.922088 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fdc49-fa8d-4ff1-805a-3db6f2047313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:08.922627 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fdc49-fa8d-4ff1-805a-3db6f2047313 None admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:08.922914 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fdc49-fa8d-4ff1-805a-3db6f2047313 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:08.923226 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fdc49-fa8d-4ff1-805a-3db6f2047313 None admin] PATH_INFO: `/v3/services` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:08.923896 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4fdc49-fa8d-4ff1-805a-3db6f2047313 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:08.925305 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4fdc49-fa8d-4ff1-805a-3db6f2047313 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:08.954888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1a94b-4227-4f3f-8321-6fb78cc43b7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:08.956487 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1a94b-4227-4f3f-8321-6fb78cc43b7a None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:08.982138 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:08.998900 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:09.006661 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 373/745] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Aug 24 16:51:08 2022] POST /identity/v3/services => generated 251 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:51:09.011318 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fdc49-fa8d-4ff1-805a-3db6f2047313 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:09.078145 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 373/746] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:51:08 2022] GET /identity/v3/auth/tokens => generated 898 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 16:51:09.079086 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1a94b-4227-4f3f-8321-6fb78cc43b7a None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:09.132462 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fdc49-fa8d-4ff1-805a-3db6f2047313 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:09.178421 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ebb1f-9450-4914-bf6c-73e5af583336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:09.179754 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ebb1f-9450-4914-bf6c-73e5af583336 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:09.180033 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ebb1f-9450-4914-bf6c-73e5af583336 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:09.180325 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ebb1f-9450-4914-bf6c-73e5af583336 None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:09.180981 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ebb1f-9450-4914-bf6c-73e5af583336 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:09.181273 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ebb1f-9450-4914-bf6c-73e5af583336 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:09.182636 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ebb1f-9450-4914-bf6c-73e5af583336 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:09.199228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 374/747] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:09.200652 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ebb1f-9450-4914-bf6c-73e5af583336 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:09.210163 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1a94b-4227-4f3f-8321-6fb78cc43b7a None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:09.239987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:09.252081 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855cf1d-4c28-4278-b9c5-f65a1103d5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:09.252854 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855cf1d-4c28-4278-b9c5-f65a1103d5c7 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:09.253334 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855cf1d-4c28-4278-b9c5-f65a1103d5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:09.253717 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855cf1d-4c28-4278-b9c5-f65a1103d5c7 None admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:09.265269 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2855cf1d-4c28-4278-b9c5-f65a1103d5c7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:09.265269 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2855cf1d-4c28-4278-b9c5-f65a1103d5c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:09.265269 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2855cf1d-4c28-4278-b9c5-f65a1103d5c7 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:09.276712 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 374/748] 10.222.0.55 () {56 vars in 1149 bytes} [Wed Aug 24 16:51:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:09.277755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855cf1d-4c28-4278-b9c5-f65a1103d5c7 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:09.285943 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:09.347521 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ebb1f-9450-4914-bf6c-73e5af583336 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:09.388947 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855cf1d-4c28-4278-b9c5-f65a1103d5c7 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:09.394401 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9940db8-facf-4972-8712-a35321c3c4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:09.395050 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9940db8-facf-4972-8712-a35321c3c4d5 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:09.395377 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9940db8-facf-4972-8712-a35321c3c4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:09.395649 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9940db8-facf-4972-8712-a35321c3c4d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:09.409683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9940db8-facf-4972-8712-a35321c3c4d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:09.411156 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9940db8-facf-4972-8712-a35321c3c4d5 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:09.426943 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524afae-d437-4286-95b4-a9bbd1bb8544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:09.427753 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524afae-d437-4286-95b4-a9bbd1bb8544 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:09.428121 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524afae-d437-4286-95b4-a9bbd1bb8544 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:09.428543 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524afae-d437-4286-95b4-a9bbd1bb8544 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:09.431909 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-f9940db8-facf-4972-8712-a35321c3c4d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:09.431909 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:09.431909 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:09.431909 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:09.431909 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:09.431909 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:09.431909 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:09.431909 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:09.431909 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:09.431909 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:09.431909 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:09.431909 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:09.431909 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:09.431909 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:09.431909 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:09.431909 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:09.433053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:09.433053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:09.433053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:09.433053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:09.433053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:09.433053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:09.433053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:09.433053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:09.433053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:09.433053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:09.433053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:09.433053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:09.433053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:09.433053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:09.433053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:09.433053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:09.433053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:09.434166 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:09.434166 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:09.434166 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:09.434166 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 375/749] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:09.435239 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9940db8-facf-4972-8712-a35321c3c4d5 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:09.439597 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524afae-d437-4286-95b4-a9bbd1bb8544 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:09.441206 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524afae-d437-4286-95b4-a9bbd1bb8544 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:09.454183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-c524afae-d437-4286-95b4-a9bbd1bb8544 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:51:09.454183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:09.454183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:09.454183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:09.454183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:09.454183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:09.454183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:09.454183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:09.454183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:09.454183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:09.454183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:09.454183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:09.454183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:51:09.454183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:51:09.454183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:51:09.454183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:51:09.455575 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:09.455575 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:09.455575 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:51:09.455575 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:09.455575 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:51:09.455575 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:09.455575 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:09.455575 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:09.455575 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:09.455575 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:09.455575 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:09.455575 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:09.455575 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:09.455575 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:09.455575 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:09.455575 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:09.455575 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:09.455575 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:09.457478 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:09.457478 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:09.457478 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:51:09.457478 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:51:09.457478 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:51:09.457478 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:51:09.457478 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:51:09.457478 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:51:09.457478 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:51:09.457478 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:09.462013 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 375/750] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Aug 24 16:51:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:09.462911 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524afae-d437-4286-95b4-a9bbd1bb8544 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:09.510156 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:09.563262 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9940db8-facf-4972-8712-a35321c3c4d5 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:09.572944 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:09.586311 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524afae-d437-4286-95b4-a9bbd1bb8544 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:09.609416 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec395095-568c-4f4f-90b5-2f0e353ce50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:09.610175 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec395095-568c-4f4f-90b5-2f0e353ce50a None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:09.610596 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec395095-568c-4f4f-90b5-2f0e353ce50a None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:09.610879 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec395095-568c-4f4f-90b5-2f0e353ce50a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:09.633600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cbc98-9b5a-4406-a10c-c2f9856c3e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:09.633600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cbc98-9b5a-4406-a10c-c2f9856c3e22 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:09.633600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cbc98-9b5a-4406-a10c-c2f9856c3e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:09.633600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cbc98-9b5a-4406-a10c-c2f9856c3e22 None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:09.634015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020cbc98-9b5a-4406-a10c-c2f9856c3e22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:09.634015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020cbc98-9b5a-4406-a10c-c2f9856c3e22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:09.634015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020cbc98-9b5a-4406-a10c-c2f9856c3e22 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:09.646688 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 376/751] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:09.647808 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cbc98-9b5a-4406-a10c-c2f9856c3e22 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:09.694441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec395095-568c-4f4f-90b5-2f0e353ce50a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:09.695941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec395095-568c-4f4f-90b5-2f0e353ce50a None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:09.778271 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cbc98-9b5a-4406-a10c-c2f9856c3e22 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:09.781158 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:09.817340 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 376/752] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:51:09 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:51:09.818389 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec395095-568c-4f4f-90b5-2f0e353ce50a None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:09.828292 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e3060-7737-4ed4-9359-43733a01fc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:09.828958 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e3060-7737-4ed4-9359-43733a01fc99 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:09.829245 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e3060-7737-4ed4-9359-43733a01fc99 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:09.829522 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e3060-7737-4ed4-9359-43733a01fc99 None admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:09.829978 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:09.830270 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e3060-7737-4ed4-9359-43733a01fc99 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:09.830582 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e3060-7737-4ed4-9359-43733a01fc99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:09.836765 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1e3060-7737-4ed4-9359-43733a01fc99 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:09.864947 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 377/753] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Aug 24 16:51:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:09.864947 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e3060-7737-4ed4-9359-43733a01fc99 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:09.944738 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec395095-568c-4f4f-90b5-2f0e353ce50a None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:09.969852 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1e3060-7737-4ed4-9359-43733a01fc99 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:09.985529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da8e97-14a0-4314-9bac-3d06f42b97b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:09.986511 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da8e97-14a0-4314-9bac-3d06f42b97b6 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:09.986997 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da8e97-14a0-4314-9bac-3d06f42b97b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:09.987465 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da8e97-14a0-4314-9bac-3d06f42b97b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:09.995185 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da8e97-14a0-4314-9bac-3d06f42b97b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:09.997297 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48da8e97-14a0-4314-9bac-3d06f42b97b6 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:10.008091 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579b14e-adbc-4eac-aca3-1b557d0f489c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:10.008731 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579b14e-adbc-4eac-aca3-1b557d0f489c None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:10.009066 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579b14e-adbc-4eac-aca3-1b557d0f489c None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:10.009392 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579b14e-adbc-4eac-aca3-1b557d0f489c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:10.021228 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579b14e-adbc-4eac-aca3-1b557d0f489c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:10.023327 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579b14e-adbc-4eac-aca3-1b557d0f489c None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:10.040894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-5579b14e-adbc-4eac-aca3-1b557d0f489c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:10.040894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:10.040894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:10.040894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:10.040894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:10.040894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:10.040894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:10.040894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:10.040894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:10.040894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:10.040894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:10.040894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:10.040894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:10.040894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:10.040894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:10.040894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:10.041908 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:10.041908 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:10.041908 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:10.041908 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:10.041908 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:10.041908 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:10.041908 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:10.041908 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:10.041908 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:10.041908 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:10.041908 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:10.041908 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:10.041908 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:10.041908 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:10.041908 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:10.041908 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:10.041908 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:10.042812 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:10.042812 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:10.042812 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:10.042812 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 378/754] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:10.043536 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579b14e-adbc-4eac-aca3-1b557d0f489c None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:10.060675 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:10.138896 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-48da8e97-14a0-4314-9bac-3d06f42b97b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:10.138896 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:10.138896 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:10.138896 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:10.138896 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:10.138896 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:10.138896 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:10.138896 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:10.138896 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:10.138896 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:10.138896 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:10.138896 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:10.138896 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:51:10.138896 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:51:10.138896 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:51:10.140038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:51:10.140038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:10.140038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:10.140038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:10.140038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:10.140038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:10.140038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:10.140038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:10.140038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:10.140038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:10.140038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:10.140038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:10.140038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:10.140038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:10.140038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:10.140038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:10.140038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:10.140947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:51:10.140947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:51:10.140947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:51:10.140947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:51:10.140947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:51:10.140947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:51:10.140947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:10.140947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:10.140947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 377/755] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:51:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:10.141546 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da8e97-14a0-4314-9bac-3d06f42b97b6 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:10.201148 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579b14e-adbc-4eac-aca3-1b557d0f489c None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:10.223721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:10.251577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb44a8-f6ef-4aa4-81d4-c5b5433c160d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:10.252217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb44a8-f6ef-4aa4-81d4-c5b5433c160d None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:10.252493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb44a8-f6ef-4aa4-81d4-c5b5433c160d None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:10.252760 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb44a8-f6ef-4aa4-81d4-c5b5433c160d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:10.264638 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb44a8-f6ef-4aa4-81d4-c5b5433c160d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:10.266163 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cb44a8-f6ef-4aa4-81d4-c5b5433c160d None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:10.269200 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da8e97-14a0-4314-9bac-3d06f42b97b6 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:10.281498 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-82cb44a8-f6ef-4aa4-81d4-c5b5433c160d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:10.281498 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:10.281498 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:10.281498 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:10.281498 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:10.281498 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:10.281498 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:10.281498 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:10.281498 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:10.281498 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:10.281498 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:10.281498 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:10.281498 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:10.281498 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:10.281498 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:10.281498 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:10.282532 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:10.282532 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:10.282532 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:10.282532 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:10.282532 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:10.282532 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:10.282532 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:10.282532 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:10.282532 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:10.282532 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:10.282532 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:10.282532 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:10.282532 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:10.282532 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:10.282532 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:10.282532 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:10.282532 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:10.283500 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:10.283500 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:10.283500 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:10.287424 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 379/756] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:10.288971 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb44a8-f6ef-4aa4-81d4-c5b5433c160d None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:10.314693 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb47b5d-053a-4979-b606-d0f9a50c90f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:10.315353 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb47b5d-053a-4979-b606-d0f9a50c90f2 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:10.315629 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb47b5d-053a-4979-b606-d0f9a50c90f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:10.315895 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb47b5d-053a-4979-b606-d0f9a50c90f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:10.316529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb47b5d-053a-4979-b606-d0f9a50c90f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:10.316825 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb47b5d-053a-4979-b606-d0f9a50c90f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:10.318189 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb47b5d-053a-4979-b606-d0f9a50c90f2 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:10.331878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 378/757] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:10.332736 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb47b5d-053a-4979-b606-d0f9a50c90f2 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:10.370426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:10.412480 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cb44a8-f6ef-4aa4-81d4-c5b5433c160d None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:10.449859 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb47b5d-053a-4979-b606-d0f9a50c90f2 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:10.452066 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6466b-c193-4522-91d1-484e4d550470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:10.452617 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6466b-c193-4522-91d1-484e4d550470 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:10.452900 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6466b-c193-4522-91d1-484e4d550470 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:10.453180 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e6466b-c193-4522-91d1-484e4d550470 None admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:10.453885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6466b-c193-4522-91d1-484e4d550470 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:10.454189 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6466b-c193-4522-91d1-484e4d550470 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:10.456108 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e6466b-c193-4522-91d1-484e4d550470 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:10.480383 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 380/758] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:51:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:10.480881 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:10.481306 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6466b-c193-4522-91d1-484e4d550470 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:10.491014 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a488614-4e1b-4603-b845-a390cb21615b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:10.492474 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a488614-4e1b-4603-b845-a390cb21615b None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:10.492945 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a488614-4e1b-4603-b845-a390cb21615b None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:10.494612 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a488614-4e1b-4603-b845-a390cb21615b None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:10.494612 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a488614-4e1b-4603-b845-a390cb21615b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:10.494612 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a488614-4e1b-4603-b845-a390cb21615b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:10.496160 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a488614-4e1b-4603-b845-a390cb21615b None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:10.510213 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 379/759] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:10.512297 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a488614-4e1b-4603-b845-a390cb21615b None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:10.589104 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e6466b-c193-4522-91d1-484e4d550470 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:10.615671 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:10.626080 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a488614-4e1b-4603-b845-a390cb21615b None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:10.626946 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ce405-6ecb-4e98-9b16-661480e679fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:10.631927 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ce405-6ecb-4e98-9b16-661480e679fe None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:10.631927 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ce405-6ecb-4e98-9b16-661480e679fe None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:10.631927 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ce405-6ecb-4e98-9b16-661480e679fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:10.636420 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ce405-6ecb-4e98-9b16-661480e679fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:10.637995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ce405-6ecb-4e98-9b16-661480e679fe None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:10.650711 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-3d4ce405-6ecb-4e98-9b16-661480e679fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:10.650711 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:10.650711 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:10.650711 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:10.650711 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:10.650711 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:10.650711 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:10.650711 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:10.650711 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:10.650711 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:10.650711 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:10.650711 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:10.650711 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:51:10.650711 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:51:10.650711 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:51:10.651778 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:51:10.651778 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:10.651778 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:10.651778 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:10.651778 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:10.651778 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:10.651778 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:10.651778 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:10.651778 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:10.651778 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:10.651778 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:10.651778 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:10.651778 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:10.651778 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:10.651778 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:10.651778 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:10.651778 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:10.652686 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:51:10.652686 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:51:10.652686 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:51:10.652686 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:51:10.652686 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:51:10.652686 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:51:10.652686 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:10.652686 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:10.655463 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 381/760] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:51:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:10.656441 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ce405-6ecb-4e98-9b16-661480e679fe None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:10.669515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c7456-e2ec-4e29-b478-9705c0c8aa0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:10.670471 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c7456-e2ec-4e29-b478-9705c0c8aa0f None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:10.670928 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c7456-e2ec-4e29-b478-9705c0c8aa0f None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:10.671435 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5c7456-e2ec-4e29-b478-9705c0c8aa0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:10.672343 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c7456-e2ec-4e29-b478-9705c0c8aa0f None admin] RBAC: Adding query filter params (role.id=99f0ace9fc4d4d028ca52fa9730cab4b, scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642, user.id=c067bc2d84b741d08ac47e40adae4b4f) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:10.672908 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c7456-e2ec-4e29-b478-9705c0c8aa0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:10.674603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5c7456-e2ec-4e29-b478-9705c0c8aa0f None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:10.681256 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 380/761] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:51:10 2022] GET /identity/v3/role_assignments?user.id=c067bc2d84b741d08ac47e40adae4b4f&scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642&role.id=99f0ace9fc4d4d028ca52fa9730cab4b => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:10.682301 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c7456-e2ec-4e29-b478-9705c0c8aa0f None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:10.740254 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:10.802781 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5c7456-e2ec-4e29-b478-9705c0c8aa0f None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:10.806484 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ce405-6ecb-4e98-9b16-661480e679fe None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:10.845461 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9907257-2b92-45bc-aa99-ca308c2c1401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:10.845878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec51b4-2b60-4046-8a73-2312eda9eac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:10.846120 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9907257-2b92-45bc-aa99-ca308c2c1401 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:10.846401 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9907257-2b92-45bc-aa99-ca308c2c1401 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:10.846677 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9907257-2b92-45bc-aa99-ca308c2c1401 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:10.847383 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec51b4-2b60-4046-8a73-2312eda9eac1 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:10.847922 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec51b4-2b60-4046-8a73-2312eda9eac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:10.848378 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec51b4-2b60-4046-8a73-2312eda9eac1 None admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:10.849396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec51b4-2b60-4046-8a73-2312eda9eac1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:10.849997 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec51b4-2b60-4046-8a73-2312eda9eac1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:10.852540 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec51b4-2b60-4046-8a73-2312eda9eac1 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:10.856266 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9907257-2b92-45bc-aa99-ca308c2c1401 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:10.859761 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9907257-2b92-45bc-aa99-ca308c2c1401 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:10.869424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 381/762] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:51:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:10.871002 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a9032-ed80-4fe1-bccc-c611f24d0d05 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:10.871492 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a9032-ed80-4fe1-bccc-c611f24d0d05 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:10.871969 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91a9032-ed80-4fe1-bccc-c611f24d0d05 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:10.873665 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 382/763] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:10.876606 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a9032-ed80-4fe1-bccc-c611f24d0d05 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:10.878620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-e9907257-2b92-45bc-aa99-ca308c2c1401 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:10.878620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:10.878620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:10.878620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:10.878620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:10.878620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:10.878620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:10.878620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:10.878620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:10.878620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:10.878620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:10.878620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:10.878620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:51:10.878620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:51:10.878620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:51:10.879555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:51:10.879555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:10.879555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:10.879555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:10.879555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:10.879555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:10.879555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:10.879555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:10.879555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:10.879555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:10.879555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:10.879555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:10.879555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:10.879555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:10.879555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:10.879555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:10.879555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:10.880450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:51:10.880450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:51:10.880450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:51:10.880450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:51:10.880450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:51:10.880450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:51:10.880450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:10.880450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:10.884588 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 382/764] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:51:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:10.885880 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdfd6c-ce30-4665-a9e4-d376be5cc3ae None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:10.886165 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdfd6c-ce30-4665-a9e4-d376be5cc3ae None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:10.886440 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdfd6c-ce30-4665-a9e4-d376be5cc3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:10.909717 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-54fdfd6c-ce30-4665-a9e4-d376be5cc3ae None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:10.910924 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-54fdfd6c-ce30-4665-a9e4-d376be5cc3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:10.954849 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:10.991509 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 383/765] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:51:10.993106 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fdfd6c-ce30-4665-a9e4-d376be5cc3ae None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:10.995406 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91a9032-ed80-4fe1-bccc-c611f24d0d05 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:11.007228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:11.033475 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1326ffde-3264-4576-874d-fd248c53aa1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:11.034480 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326ffde-3264-4576-874d-fd248c53aa1c None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:11.034988 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326ffde-3264-4576-874d-fd248c53aa1c None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:11.035452 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1326ffde-3264-4576-874d-fd248c53aa1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:11.036368 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1326ffde-3264-4576-874d-fd248c53aa1c None admin] RBAC: Adding query filter params (role.id=494c75ed8f864e3b955fdb043e96c675, scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642, user.id=ae9fc5f06a0441da80e656fa1e88db5d) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:11.036964 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1326ffde-3264-4576-874d-fd248c53aa1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:11.039512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1326ffde-3264-4576-874d-fd248c53aa1c None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:11.046806 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 383/766] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:51:10 2022] GET /identity/v3/role_assignments?user.id=ae9fc5f06a0441da80e656fa1e88db5d&scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642&role.id=494c75ed8f864e3b955fdb043e96c675 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:11.156840 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fdfd6c-ce30-4665-a9e4-d376be5cc3ae None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:11.185265 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4b1d8-e155-4967-8571-ea6e039dfe38 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:11.185707 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4b1d8-e155-4967-8571-ea6e039dfe38 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:11.185987 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4b1d8-e155-4967-8571-ea6e039dfe38 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:11.188707 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 384/767] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:51:11.194036 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b2d48-aca3-4e4a-bfb0-0e9274ae2493 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:11.194396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b2d48-aca3-4e4a-bfb0-0e9274ae2493 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:11.194619 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558b2d48-aca3-4e4a-bfb0-0e9274ae2493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:11.203020 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07551520-0600-43db-af71-d17fa13d3a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:11.203020 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07551520-0600-43db-af71-d17fa13d3a70 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:11.203020 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07551520-0600-43db-af71-d17fa13d3a70 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:11.203427 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07551520-0600-43db-af71-d17fa13d3a70 None admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:11.204037 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07551520-0600-43db-af71-d17fa13d3a70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:11.204348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07551520-0600-43db-af71-d17fa13d3a70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:11.205837 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07551520-0600-43db-af71-d17fa13d3a70 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:11.215145 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-558b2d48-aca3-4e4a-bfb0-0e9274ae2493 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:11.216721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-558b2d48-aca3-4e4a-bfb0-0e9274ae2493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:11.222455 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 384/768] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:51:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:11.229022 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07551520-0600-43db-af71-d17fa13d3a70 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:11.274083 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:11.343023 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07551520-0600-43db-af71-d17fa13d3a70 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:11.349955 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 385/769] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:51:11.352138 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b2d48-aca3-4e4a-bfb0-0e9274ae2493 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:11.416306 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ece67-733c-4fab-88e8-119a20f2872d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:11.417749 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ece67-733c-4fab-88e8-119a20f2872d None admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:11.418276 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ece67-733c-4fab-88e8-119a20f2872d None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:11.418744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ece67-733c-4fab-88e8-119a20f2872d None admin] PATH_INFO: `/v3/projects/ebae6aa9c60343e6ba0ff1cd62619642/users/28a1c617fc264b118e61f2a97ecb3f39/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:11.421088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ece67-733c-4fab-88e8-119a20f2872d None admin] RBAC: Authorizing `identity:create_grant(project_id=ebae6aa9c60343e6ba0ff1cd62619642, user_id=28a1c617fc264b118e61f2a97ecb3f39, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:11.422862 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ece67-733c-4fab-88e8-119a20f2872d None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:11.489296 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558b2d48-aca3-4e4a-bfb0-0e9274ae2493 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:11.492082 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:11.524590 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 385/770] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Aug 24 16:51:11 2022] PUT /identity/v3/projects/ebae6aa9c60343e6ba0ff1cd62619642/users/28a1c617fc264b118e61f2a97ecb3f39/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:51:11.543621 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a2b18-764a-4f09-97af-1aab887453e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:11.544711 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a2b18-764a-4f09-97af-1aab887453e8 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:11.545268 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a2b18-764a-4f09-97af-1aab887453e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:11.545745 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a2b18-764a-4f09-97af-1aab887453e8 None admin] PATH_INFO: `/v3/services/network` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:11.546609 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a2b18-764a-4f09-97af-1aab887453e8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:11.548475 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a2b18-764a-4f09-97af-1aab887453e8 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:11.566678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-ac8a2b18-764a-4f09-97af-1aab887453e8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 16:51:11.566678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:11.566678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:51:11.566678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:51:11.566678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:51:11.566678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:51:11.566678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:51:11.566678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:11.566678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 16:51:11.566678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:11.566678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:51:11.566678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:11.566678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:11.566678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:11.566678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:11.566678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:11.566678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:11.567788 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:11.567788 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:11.567788 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:11.567788 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:11.567788 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:11.567788 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:11.567788 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:51:11.567788 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:51:11.567788 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:51:11.567788 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:51:11.567788 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:11.567788 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:11.567788 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:11.567788 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:11.567788 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:11.567788 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:11.568660 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:11.568660 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:11.568660 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:11.568660 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:11.568660 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:11.568660 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:11.568660 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:11.568660 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:11.568660 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:11.568660 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:11.568660 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:51:11.568660 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:11.568660 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 16:51:11.568660 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:11.572448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 386/771] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:51:11 2022] GET /identity/v3/services/network => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:11.578946 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ece67-733c-4fab-88e8-119a20f2872d None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:11.627951 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a2b18-764a-4f09-97af-1aab887453e8 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:11.716122 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:11.724210 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ece67-733c-4fab-88e8-119a20f2872d None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:11.768824 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b21d8-438b-4e6e-9a04-68eda21c4090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:11.769453 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b21d8-438b-4e6e-9a04-68eda21c4090 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:11.769738 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b21d8-438b-4e6e-9a04-68eda21c4090 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:11.770016 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b21d8-438b-4e6e-9a04-68eda21c4090 None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:11.770667 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b21d8-438b-4e6e-9a04-68eda21c4090 None admin] RBAC: Adding query filter params (name=network) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:11.770973 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b21d8-438b-4e6e-9a04-68eda21c4090 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:11.772405 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40b21d8-438b-4e6e-9a04-68eda21c4090 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:11.778325 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 386/772] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Aug 24 16:51:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:11.785379 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b21d8-438b-4e6e-9a04-68eda21c4090 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:11.796676 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a2b18-764a-4f09-97af-1aab887453e8 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:11.834493 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f79ae-cdd5-47f3-8c42-5545a6758179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:11.835452 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f79ae-cdd5-47f3-8c42-5545a6758179 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:11.835872 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f79ae-cdd5-47f3-8c42-5545a6758179 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:11.836362 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f79ae-cdd5-47f3-8c42-5545a6758179 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:11.837085 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f79ae-cdd5-47f3-8c42-5545a6758179 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:11.838709 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f79ae-cdd5-47f3-8c42-5545a6758179 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:11.850629 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-4f3f79ae-cdd5-47f3-8c42-5545a6758179 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 16:51:11.850629 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:11.850629 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:51:11.850629 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:51:11.850629 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:51:11.850629 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:51:11.850629 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:51:11.850629 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:11.850629 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 16:51:11.850629 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:11.850629 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:51:11.850629 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:11.850629 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:11.850629 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:11.850629 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:11.850629 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:11.850629 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:11.852741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:11.852741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:11.852741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:11.852741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:11.852741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:11.852741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:11.852741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:51:11.852741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:51:11.852741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:51:11.852741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:51:11.852741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:11.852741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:11.852741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:11.852741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:11.852741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:11.852741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:11.853782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:11.853782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:11.853782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:11.853782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:11.853782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:11.853782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:11.853782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:11.853782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:11.853782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:11.853782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:11.853782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:51:11.853782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:11.853782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 16:51:11.853782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:11.856047 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 387/773] 10.222.0.55 () {56 vars in 1129 bytes} [Wed Aug 24 16:51:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:51:11.862178 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f79ae-cdd5-47f3-8c42-5545a6758179 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:11.915507 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:11.961894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b21d8-438b-4e6e-9a04-68eda21c4090 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:12.009014 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c6eea-8598-4501-b5ad-222c12f021c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:12.009639 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c6eea-8598-4501-b5ad-222c12f021c4 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:12.009916 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c6eea-8598-4501-b5ad-222c12f021c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:12.010187 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c6eea-8598-4501-b5ad-222c12f021c4 None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:12.010828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c6eea-8598-4501-b5ad-222c12f021c4 None admin] RBAC: Adding query filter params (type=network) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:12.011148 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c6eea-8598-4501-b5ad-222c12f021c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:12.012535 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c6eea-8598-4501-b5ad-222c12f021c4 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:12.023978 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 387/774] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Aug 24 16:51:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:12.030911 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c6eea-8598-4501-b5ad-222c12f021c4 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:12.049539 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f79ae-cdd5-47f3-8c42-5545a6758179 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:12.090545 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:12.140487 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca30b4-22d9-44c1-be82-b400fcbcbcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:12.141113 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca30b4-22d9-44c1-be82-b400fcbcbcbe None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:12.141474 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca30b4-22d9-44c1-be82-b400fcbcbcbe None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:12.141748 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca30b4-22d9-44c1-be82-b400fcbcbcbe None admin] PATH_INFO: `/v3/services` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:12.142388 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca30b4-22d9-44c1-be82-b400fcbcbcbe None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:12.142688 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca30b4-22d9-44c1-be82-b400fcbcbcbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:12.144132 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca30b4-22d9-44c1-be82-b400fcbcbcbe None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:12.161340 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 388/775] 10.222.0.55 () {56 vars in 1124 bytes} [Wed Aug 24 16:51:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:12.166728 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca30b4-22d9-44c1-be82-b400fcbcbcbe None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:12.192099 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c6eea-8598-4501-b5ad-222c12f021c4 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:12.258397 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838cf6d4-1856-4572-89b4-99aa33510b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:12.259040 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838cf6d4-1856-4572-89b4-99aa33510b60 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:12.259348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838cf6d4-1856-4572-89b4-99aa33510b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:12.259636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838cf6d4-1856-4572-89b4-99aa33510b60 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:12.260324 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838cf6d4-1856-4572-89b4-99aa33510b60 None admin] RBAC: Adding query filter params (interface=public, service_id=877ec418f63549a9a945de05dd94fa35, region_id=RegionOne) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:12.260627 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838cf6d4-1856-4572-89b4-99aa33510b60 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:12.262006 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838cf6d4-1856-4572-89b4-99aa33510b60 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:12.277062 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 388/776] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Aug 24 16:51:12 2022] GET /identity/v3/endpoints?service_id=877ec418f63549a9a945de05dd94fa35&interface=public®ion_id=RegionOne => generated 194 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:12.282731 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838cf6d4-1856-4572-89b4-99aa33510b60 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:12.333913 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:12.342101 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca30b4-22d9-44c1-be82-b400fcbcbcbe None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:12.401954 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5ed7e-5753-4e59-a0f4-8f73cc20112e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:12.402592 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5ed7e-5753-4e59-a0f4-8f73cc20112e None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:12.402830 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5ed7e-5753-4e59-a0f4-8f73cc20112e None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:12.403121 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5ed7e-5753-4e59-a0f4-8f73cc20112e None admin] PATH_INFO: `/v3/services` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:12.403785 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5ed7e-5753-4e59-a0f4-8f73cc20112e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:12.404082 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5ed7e-5753-4e59-a0f4-8f73cc20112e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:12.405436 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa5ed7e-5753-4e59-a0f4-8f73cc20112e None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:12.411162 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 389/777] 10.222.0.55 () {56 vars in 1124 bytes} [Wed Aug 24 16:51:12 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:12.416395 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5ed7e-5753-4e59-a0f4-8f73cc20112e None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:12.441021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:12.469726 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838cf6d4-1856-4572-89b4-99aa33510b60 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:12.513008 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53629559-6a23-4478-9795-a09ff6b21be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:12.514140 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53629559-6a23-4478-9795-a09ff6b21be4 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:12.514601 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53629559-6a23-4478-9795-a09ff6b21be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:12.515019 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53629559-6a23-4478-9795-a09ff6b21be4 None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:12.515806 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53629559-6a23-4478-9795-a09ff6b21be4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:12.517334 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53629559-6a23-4478-9795-a09ff6b21be4 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:12.525136 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 389/778] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Aug 24 16:51:12 2022] GET /identity/v3/services => generated 772 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:12.591476 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5ed7e-5753-4e59-a0f4-8f73cc20112e None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:12.629686 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c020b-7f09-427a-8f48-f3f97def0bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:12.630306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c020b-7f09-427a-8f48-f3f97def0bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:12.630586 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c020b-7f09-427a-8f48-f3f97def0bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:12.630860 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c020b-7f09-427a-8f48-f3f97def0bd4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:12.631590 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c020b-7f09-427a-8f48-f3f97def0bd4 None admin] RBAC: Adding query filter params (interface=public, service_id=4445c4747c014ca8ab9835837ea2dac5, region_id=RegionOne) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:12.632414 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c020b-7f09-427a-8f48-f3f97def0bd4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:12.633782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c020b-7f09-427a-8f48-f3f97def0bd4 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:12.642577 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 390/779] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Aug 24 16:51:12 2022] GET /identity/v3/endpoints?service_id=4445c4747c014ca8ab9835837ea2dac5&interface=public®ion_id=RegionOne => generated 194 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:12.648345 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53629559-6a23-4478-9795-a09ff6b21be4 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:12.809159 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53629559-6a23-4478-9795-a09ff6b21be4 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:12.844999 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2aadd1d-fb8a-4c52-b086-6226f413ddf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:12.845532 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aadd1d-fb8a-4c52-b086-6226f413ddf3 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:12.845809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aadd1d-fb8a-4c52-b086-6226f413ddf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:12.846080 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aadd1d-fb8a-4c52-b086-6226f413ddf3 None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:12.846684 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aadd1d-fb8a-4c52-b086-6226f413ddf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:12.848089 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2aadd1d-fb8a-4c52-b086-6226f413ddf3 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:12.855233 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 390/780] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Aug 24 16:51:12 2022] GET /identity/v3/services => generated 772 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:13.052770 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def42710-0917-4130-b088-9f2ea07d4b90 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:13.053153 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def42710-0917-4130-b088-9f2ea07d4b90 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:13.053588 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def42710-0917-4130-b088-9f2ea07d4b90 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:13.055403 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 391/781] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:13.061580 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bb5f3-1848-4bf8-a499-b5bea7b3f3a0 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:13.061864 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bb5f3-1848-4bf8-a499-b5bea7b3f3a0 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:13.062132 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bb5f3-1848-4bf8-a499-b5bea7b3f3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:13.083560 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-550bb5f3-1848-4bf8-a499-b5bea7b3f3a0 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:13.085056 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-550bb5f3-1848-4bf8-a499-b5bea7b3f3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:13.099554 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:13.173706 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 391/782] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:51:13.512188 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def42710-0917-4130-b088-9f2ea07d4b90 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:13.526195 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4dd6c-b5df-49de-9433-a0f24e452ca6 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:13.526684 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4dd6c-b5df-49de-9433-a0f24e452ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:13.526759 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4dd6c-b5df-49de-9433-a0f24e452ca6 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:13.529636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 392/783] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:13.533155 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c1aa5-dbc5-40db-a88a-d2301abb7a4a None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:13.533430 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c1aa5-dbc5-40db-a88a-d2301abb7a4a None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:13.533700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c1aa5-dbc5-40db-a88a-d2301abb7a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:13.556582 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:13.563423 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-c89c1aa5-dbc5-40db-a88a-d2301abb7a4a None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:13.564622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-c89c1aa5-dbc5-40db-a88a-d2301abb7a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:13.665923 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def42710-0917-4130-b088-9f2ea07d4b90 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:13.678713 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 393/784] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:51:13.749177 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6aa9b-a7dd-4faa-af4f-1d87fc3b3fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:13.749813 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6aa9b-a7dd-4faa-af4f-1d87fc3b3fc1 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:13.750090 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6aa9b-a7dd-4faa-af4f-1d87fc3b3fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:13.750361 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6aa9b-a7dd-4faa-af4f-1d87fc3b3fc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:13.772024 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6aa9b-a7dd-4faa-af4f-1d87fc3b3fc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:51:13.777417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-0dd6aa9b-a7dd-4faa-af4f-1d87fc3b3fc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:51:13.777417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:13.777417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:13.777417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:13.777417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:13.777417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:13.777417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:13.777417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:13.777417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:13.777417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:13.777417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:13.777417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:13.777417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:51:13.777417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:51:13.777417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:51:13.777417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:51:13.778347 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:51:13.778347 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:51:13.778347 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:51:13.778347 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:51:13.778347 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:13.778347 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:13.778347 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:13.778347 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:13.778347 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:13.778347 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:13.778347 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:13.778347 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:13.778347 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:13.778347 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:13.778347 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:13.778347 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:13.779268 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:13.779268 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:13.779268 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:13.779268 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:13.779268 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:51:13.779268 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:51:13.779268 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:51:13.779268 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:51:13.779268 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:51:13.779268 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:51:13.779268 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:51:13.779268 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:13.781377 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 392/785] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:51:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:13.786351 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c1aa5-dbc5-40db-a88a-d2301abb7a4a None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:13.875475 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:13.908428 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c1aa5-dbc5-40db-a88a-d2301abb7a4a None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:13.950863 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1397b-4d82-4b2e-a87a-a76ae6ebb903 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:13.951213 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1397b-4d82-4b2e-a87a-a76ae6ebb903 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:13.951435 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd1397b-4d82-4b2e-a87a-a76ae6ebb903 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:13.952273 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391acb8-aca1-4f52-8eed-eabdec5a36ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:13.952893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 393/786] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:51:13.953000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391acb8-aca1-4f52-8eed-eabdec5a36ee None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:13.953157 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391acb8-aca1-4f52-8eed-eabdec5a36ee None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:13.953428 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391acb8-aca1-4f52-8eed-eabdec5a36ee None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:13.954101 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391acb8-aca1-4f52-8eed-eabdec5a36ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:13.954404 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391acb8-aca1-4f52-8eed-eabdec5a36ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:13.955810 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391acb8-aca1-4f52-8eed-eabdec5a36ee None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:13.968038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42bd1f-2832-4891-ad9d-8fb743f8ed7a None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:13.968317 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42bd1f-2832-4891-ad9d-8fb743f8ed7a None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:13.968581 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a42bd1f-2832-4891-ad9d-8fb743f8ed7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:13.968966 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 394/787] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:51:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:13.974390 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391acb8-aca1-4f52-8eed-eabdec5a36ee None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:14.012524 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-1a42bd1f-2832-4891-ad9d-8fb743f8ed7a None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:14.015354 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-1a42bd1f-2832-4891-ad9d-8fb743f8ed7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:14.095683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 394/788] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:51:14.096625 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a42bd1f-2832-4891-ad9d-8fb743f8ed7a None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:14.123946 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:14.131698 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391acb8-aca1-4f52-8eed-eabdec5a36ee None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:14.195566 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650158b-c430-486c-a24b-4aaf8809a55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:14.196215 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650158b-c430-486c-a24b-4aaf8809a55d None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:14.196490 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650158b-c430-486c-a24b-4aaf8809a55d None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:14.196759 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3650158b-c430-486c-a24b-4aaf8809a55d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:14.206577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:14.214613 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3650158b-c430-486c-a24b-4aaf8809a55d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:14.216722 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3650158b-c430-486c-a24b-4aaf8809a55d None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:14.243337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-3650158b-c430-486c-a24b-4aaf8809a55d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:14.243337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:14.243337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:14.243337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:14.243337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:14.243337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:14.243337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:14.243337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:14.243337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:14.243337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:14.243337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:14.243337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:14.243337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:14.243337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:14.243337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:14.243337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:14.244328 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:14.244328 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:14.244328 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:14.244328 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:14.244328 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:14.244328 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:14.244328 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:14.244328 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:14.244328 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:14.244328 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:14.244328 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:14.244328 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:14.244328 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:14.244328 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:14.244328 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:14.244328 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:14.244328 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:14.245217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:14.245217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:14.245217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:14.247300 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 395/789] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:51:14.253239 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650158b-c430-486c-a24b-4aaf8809a55d None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:14.299887 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a42bd1f-2832-4891-ad9d-8fb743f8ed7a None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:14.367019 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f90706-44a7-47fa-91d8-98f52c9ba707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:14.368027 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f90706-44a7-47fa-91d8-98f52c9ba707 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:14.368500 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f90706-44a7-47fa-91d8-98f52c9ba707 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:14.368984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f90706-44a7-47fa-91d8-98f52c9ba707 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:14.380732 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f90706-44a7-47fa-91d8-98f52c9ba707 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:51:14.387087 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-98f90706-44a7-47fa-91d8-98f52c9ba707 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:51:14.387087 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:14.387087 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:14.387087 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:14.387087 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:14.387087 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:14.387087 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:14.387087 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:14.387087 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:14.387087 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:14.387087 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:14.387087 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:14.387087 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:51:14.387087 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:51:14.387087 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:51:14.387087 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:51:14.388056 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:51:14.388056 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:51:14.388056 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:51:14.388056 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:51:14.388056 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:14.388056 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:14.388056 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:14.388056 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:14.388056 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:14.388056 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:14.388056 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:14.388056 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:14.388056 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:14.388056 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:14.388056 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:14.388056 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:14.388921 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:14.388921 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:14.388921 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:14.388921 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:14.388921 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:51:14.388921 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:51:14.388921 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:51:14.388921 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:51:14.388921 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:51:14.388921 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:51:14.388921 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:51:14.388921 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:14.392738 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 395/790] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Aug 24 16:51:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:14.400748 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f90706-44a7-47fa-91d8-98f52c9ba707 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:14.449011 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3650158b-c430-486c-a24b-4aaf8809a55d None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:14.493094 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26ad2a-541b-4af9-af0b-d5791bde2fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:14.493701 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26ad2a-541b-4af9-af0b-d5791bde2fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:14.494221 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26ad2a-541b-4af9-af0b-d5791bde2fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:14.494491 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26ad2a-541b-4af9-af0b-d5791bde2fc9 None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:14.496121 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c26ad2a-541b-4af9-af0b-d5791bde2fc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:14.496427 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c26ad2a-541b-4af9-af0b-d5791bde2fc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:14.497803 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c26ad2a-541b-4af9-af0b-d5791bde2fc9 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:14.500768 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:14.517407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 396/791] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:14.518382 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26ad2a-541b-4af9-af0b-d5791bde2fc9 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:14.529764 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f90706-44a7-47fa-91d8-98f52c9ba707 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:14.566463 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b180d-34c4-49d2-8f9d-54a48a3485fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:14.567397 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b180d-34c4-49d2-8f9d-54a48a3485fe None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:14.567849 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b180d-34c4-49d2-8f9d-54a48a3485fe None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:14.568328 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b180d-34c4-49d2-8f9d-54a48a3485fe None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:14.569372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b180d-34c4-49d2-8f9d-54a48a3485fe None admin] RBAC: Adding query filter params (name=service) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:14.570336 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b180d-34c4-49d2-8f9d-54a48a3485fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:14.571894 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b180d-34c4-49d2-8f9d-54a48a3485fe None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:14.579489 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:14.587321 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 396/792] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Aug 24 16:51:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:14.588579 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b180d-34c4-49d2-8f9d-54a48a3485fe None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:14.630778 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26ad2a-541b-4af9-af0b-d5791bde2fc9 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:14.667539 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db71f5-d749-4d43-a47c-352293919869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:14.668176 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db71f5-d749-4d43-a47c-352293919869 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:14.668500 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db71f5-d749-4d43-a47c-352293919869 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:14.668778 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db71f5-d749-4d43-a47c-352293919869 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:14.681276 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db71f5-d749-4d43-a47c-352293919869 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:51:14.686595 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-91db71f5-d749-4d43-a47c-352293919869 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:51:14.686595 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:14.686595 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:14.686595 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:14.686595 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:14.686595 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:14.686595 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:14.686595 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:14.686595 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:14.686595 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:14.686595 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:14.686595 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:14.686595 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:51:14.686595 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:51:14.686595 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:51:14.686595 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:51:14.687583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:51:14.687583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:51:14.687583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:51:14.687583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:51:14.687583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:14.687583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:14.687583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:14.687583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:14.687583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:14.687583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:14.687583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:14.687583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:14.687583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:14.687583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:14.687583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:14.687583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:14.688434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:14.688434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:14.688434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:14.688434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:14.688434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:51:14.688434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:51:14.688434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:51:14.688434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:51:14.688434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:51:14.688434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:51:14.688434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:51:14.688434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:14.691448 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 397/793] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:51:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:14.692781 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db71f5-d749-4d43-a47c-352293919869 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:14.702549 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b180d-34c4-49d2-8f9d-54a48a3485fe None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:14.739664 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d57f48-a4d7-49a4-87d2-5bc09f01fc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:14.740659 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d57f48-a4d7-49a4-87d2-5bc09f01fc76 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:14.741545 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d57f48-a4d7-49a4-87d2-5bc09f01fc76 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:14.742022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d57f48-a4d7-49a4-87d2-5bc09f01fc76 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:14.745247 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:14.750989 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d57f48-a4d7-49a4-87d2-5bc09f01fc76 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:14.755849 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d57f48-a4d7-49a4-87d2-5bc09f01fc76 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:14.764664 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-d9d57f48-a4d7-49a4-87d2-5bc09f01fc76 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:51:14.764664 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:14.764664 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:14.764664 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:14.764664 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:14.764664 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:14.764664 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:14.764664 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:14.764664 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:14.764664 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:14.764664 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:14.764664 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:14.764664 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:51:14.764664 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:51:14.764664 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:51:14.764664 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:51:14.765652 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:14.765652 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:14.765652 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:51:14.765652 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:14.765652 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:51:14.765652 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:14.765652 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:14.765652 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:14.765652 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:14.765652 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:14.765652 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:14.765652 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:14.765652 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:14.765652 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:14.765652 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:14.765652 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:14.765652 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:14.765652 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:14.766600 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:14.766600 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:14.766600 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:51:14.766600 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:51:14.766600 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:51:14.766600 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:51:14.766600 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:51:14.766600 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:51:14.766600 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:51:14.766600 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:14.766600 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 397/794] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:51:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:14.767228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d57f48-a4d7-49a4-87d2-5bc09f01fc76 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:14.815741 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db71f5-d749-4d43-a47c-352293919869 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:14.826671 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:14.862693 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072154fa-4feb-4caa-a1d0-ee5504324f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:14.864211 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072154fa-4feb-4caa-a1d0-ee5504324f7f None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:14.864871 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072154fa-4feb-4caa-a1d0-ee5504324f7f None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:14.865443 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072154fa-4feb-4caa-a1d0-ee5504324f7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:14.886867 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072154fa-4feb-4caa-a1d0-ee5504324f7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:14.888759 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072154fa-4feb-4caa-a1d0-ee5504324f7f None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:14.890993 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d57f48-a4d7-49a4-87d2-5bc09f01fc76 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:14.905020 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-072154fa-4feb-4caa-a1d0-ee5504324f7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:14.905020 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:14.905020 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:14.905020 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:14.905020 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:14.905020 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:14.905020 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:14.905020 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:14.905020 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:14.905020 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:14.905020 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:14.905020 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:14.905020 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:14.905020 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:14.905020 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:14.905020 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:14.906018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:14.906018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:14.906018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:14.906018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:14.906018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:14.906018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:14.906018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:14.906018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:14.906018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:14.906018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:14.906018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:14.906018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:14.906018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:14.906018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:14.906018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:14.906018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:14.906018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:14.906901 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:14.906901 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:14.906901 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:14.913606 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 398/795] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:14.914773 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072154fa-4feb-4caa-a1d0-ee5504324f7f None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:14.927959 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4a13a-3c10-4509-9c32-b6ca0038f165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:14.928678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4a13a-3c10-4509-9c32-b6ca0038f165 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:14.929485 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4a13a-3c10-4509-9c32-b6ca0038f165 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:14.929756 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4a13a-3c10-4509-9c32-b6ca0038f165 None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:14.930713 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e4a13a-3c10-4509-9c32-b6ca0038f165 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:14.930927 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e4a13a-3c10-4509-9c32-b6ca0038f165 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:14.932381 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e4a13a-3c10-4509-9c32-b6ca0038f165 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:14.941821 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 398/796] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:51:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:14.942658 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4a13a-3c10-4509-9c32-b6ca0038f165 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:15.010894 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:15.027045 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072154fa-4feb-4caa-a1d0-ee5504324f7f None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:15.060248 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4a13a-3c10-4509-9c32-b6ca0038f165 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:15.066900 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610feab2-0c6b-4289-b830-0df8a3aac2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:15.067559 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610feab2-0c6b-4289-b830-0df8a3aac2be None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:15.067844 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610feab2-0c6b-4289-b830-0df8a3aac2be None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:15.068107 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610feab2-0c6b-4289-b830-0df8a3aac2be None admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:15.068862 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610feab2-0c6b-4289-b830-0df8a3aac2be None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:15.069170 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610feab2-0c6b-4289-b830-0df8a3aac2be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:15.070754 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610feab2-0c6b-4289-b830-0df8a3aac2be None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:15.095837 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 399/797] 10.222.0.55 () {56 vars in 1135 bytes} [Wed Aug 24 16:51:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:15.095837 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610feab2-0c6b-4289-b830-0df8a3aac2be None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:15.102417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bf2ba3-f5e2-41ef-926c-360902b7432c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:15.103038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf2ba3-f5e2-41ef-926c-360902b7432c None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:15.103366 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf2ba3-f5e2-41ef-926c-360902b7432c None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:15.103638 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bf2ba3-f5e2-41ef-926c-360902b7432c None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:15.104281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf2ba3-f5e2-41ef-926c-360902b7432c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:15.104581 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf2ba3-f5e2-41ef-926c-360902b7432c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:15.105932 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bf2ba3-f5e2-41ef-926c-360902b7432c None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:15.114415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:15.119480 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 399/798] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:15.125308 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2205a-0e79-4469-9291-35266fc38ffc None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:15.125601 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2205a-0e79-4469-9291-35266fc38ffc None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:15.125877 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2205a-0e79-4469-9291-35266fc38ffc None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:15.127160 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 400/799] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:15.127816 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2205a-0e79-4469-9291-35266fc38ffc None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:15.208669 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610feab2-0c6b-4289-b830-0df8a3aac2be None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:15.236164 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2205a-0e79-4469-9291-35266fc38ffc None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:15.242836 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc031ebb-e6eb-4165-9cc5-285cc318a43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:15.243495 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc031ebb-e6eb-4165-9cc5-285cc318a43b None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:15.243771 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc031ebb-e6eb-4165-9cc5-285cc318a43b None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:15.244038 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc031ebb-e6eb-4165-9cc5-285cc318a43b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:15.253697 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc031ebb-e6eb-4165-9cc5-285cc318a43b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:15.254291 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:15.255197 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc031ebb-e6eb-4165-9cc5-285cc318a43b None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:15.270301 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-cc031ebb-e6eb-4165-9cc5-285cc318a43b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:15.270301 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:15.270301 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:15.270301 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:15.270301 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:15.270301 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:15.270301 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:15.270301 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:15.270301 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:15.270301 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:15.270301 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:15.270301 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:15.270301 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:15.270301 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:15.270301 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:15.270301 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:15.271275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:15.271275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:15.271275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:15.271275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:15.271275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:15.271275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:15.271275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:15.271275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:15.271275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:15.271275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:15.271275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:15.271275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:15.271275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:15.271275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:15.271275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:15.271275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:15.271275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:15.272245 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:15.272245 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:15.272245 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:15.272245 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 400/800] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:15.272693 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0cee4-b461-4d1d-9390-b99c4d84b79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:15.272693 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0cee4-b461-4d1d-9390-b99c4d84b79e None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:15.272841 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc031ebb-e6eb-4165-9cc5-285cc318a43b None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:15.272919 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0cee4-b461-4d1d-9390-b99c4d84b79e None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:15.272919 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0cee4-b461-4d1d-9390-b99c4d84b79e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:15.286278 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0cee4-b461-4d1d-9390-b99c4d84b79e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:15.287756 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0cee4-b461-4d1d-9390-b99c4d84b79e None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:15.304138 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-c4f0cee4-b461-4d1d-9390-b99c4d84b79e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:15.304138 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:15.304138 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:15.304138 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:15.304138 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:15.304138 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:15.304138 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:15.304138 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:15.304138 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:15.304138 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:15.304138 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:15.304138 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:15.304138 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:15.304138 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:15.304138 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:15.304138 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:15.305159 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:15.305159 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:15.305159 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:15.305159 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:15.305159 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:15.305159 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:15.305159 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:15.305159 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:15.305159 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:15.305159 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:15.305159 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:15.305159 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:15.305159 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:15.305159 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:15.305159 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:15.305159 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:15.305159 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:15.306052 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:15.306052 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:15.306052 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:15.306052 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 401/801] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:15.306407 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118c0c7-9a36-4c97-a935-e679f27cd383 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:15.306706 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118c0c7-9a36-4c97-a935-e679f27cd383 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:15.306943 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0118c0c7-9a36-4c97-a935-e679f27cd383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:15.325255 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-0118c0c7-9a36-4c97-a935-e679f27cd383 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:15.326457 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-0118c0c7-9a36-4c97-a935-e679f27cd383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:15.352463 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:15.383743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc031ebb-e6eb-4165-9cc5-285cc318a43b None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:15.394308 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 402/802] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:51:15.395679 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48260780-d877-4462-815b-de445f53afe3 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:15.395969 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48260780-d877-4462-815b-de445f53afe3 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:15.396247 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48260780-d877-4462-815b-de445f53afe3 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:15.397713 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 403/803] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:15.398367 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48260780-d877-4462-815b-de445f53afe3 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:15.420134 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced2c6a-8a8a-474c-8258-46f971fad198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:15.421007 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced2c6a-8a8a-474c-8258-46f971fad198 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:15.421464 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced2c6a-8a8a-474c-8258-46f971fad198 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:15.421886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ced2c6a-8a8a-474c-8258-46f971fad198 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:15.430415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced2c6a-8a8a-474c-8258-46f971fad198 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:15.432052 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ced2c6a-8a8a-474c-8258-46f971fad198 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:15.443484 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-4ced2c6a-8a8a-474c-8258-46f971fad198 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:51:15.443484 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:15.443484 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:15.443484 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:15.443484 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:15.443484 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:15.443484 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:15.443484 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:15.443484 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:15.443484 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:15.443484 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:15.443484 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:15.443484 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:51:15.443484 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:51:15.443484 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:51:15.443484 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:51:15.444606 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:15.444606 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:15.444606 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:51:15.444606 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:15.444606 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:51:15.444606 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:15.444606 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:15.444606 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:15.444606 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:15.444606 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:15.444606 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:15.444606 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:15.444606 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:15.444606 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:15.444606 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:15.444606 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:15.444606 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:15.444606 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:15.445576 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:15.445576 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:15.445576 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:51:15.445576 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:51:15.445576 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:51:15.445576 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:51:15.445576 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:51:15.445576 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:51:15.445576 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:51:15.445576 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:15.445576 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 401/804] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Aug 24 16:51:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:15.445576 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced2c6a-8a8a-474c-8258-46f971fad198 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:15.515565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:15.519988 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48260780-d877-4462-815b-de445f53afe3 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:15.553028 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ced2c6a-8a8a-474c-8258-46f971fad198 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:15.559039 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92194a-30cd-4046-89dc-c650da4ed2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:15.559693 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92194a-30cd-4046-89dc-c650da4ed2a8 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:15.559973 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92194a-30cd-4046-89dc-c650da4ed2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:15.560243 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92194a-30cd-4046-89dc-c650da4ed2a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:15.560886 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92194a-30cd-4046-89dc-c650da4ed2a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:15.561439 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92194a-30cd-4046-89dc-c650da4ed2a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:15.562800 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92194a-30cd-4046-89dc-c650da4ed2a8 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:15.579824 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 404/805] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:15.579824 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032621f-c54f-4d3c-873a-99a5e49e6214 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:15.579824 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032621f-c54f-4d3c-873a-99a5e49e6214 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:15.579824 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032621f-c54f-4d3c-873a-99a5e49e6214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:15.584736 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:15.591646 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844253d-0d0d-4594-a27d-15adb4164925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:15.592261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844253d-0d0d-4594-a27d-15adb4164925 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:15.592545 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844253d-0d0d-4594-a27d-15adb4164925 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:15.595346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844253d-0d0d-4594-a27d-15adb4164925 None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:15.595346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844253d-0d0d-4594-a27d-15adb4164925 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:15.595346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844253d-0d0d-4594-a27d-15adb4164925 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:15.595667 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844253d-0d0d-4594-a27d-15adb4164925 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:15.598309 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-d032621f-c54f-4d3c-873a-99a5e49e6214 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:15.599503 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-d032621f-c54f-4d3c-873a-99a5e49e6214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:15.608547 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 402/806] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:15.610307 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844253d-0d0d-4594-a27d-15adb4164925 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:15.674686 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 405/807] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:51:15.675558 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032621f-c54f-4d3c-873a-99a5e49e6214 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:15.723413 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844253d-0d0d-4594-a27d-15adb4164925 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:15.762588 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38202e4-7380-46df-b386-7a24e9007934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:15.763229 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38202e4-7380-46df-b386-7a24e9007934 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:15.763512 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38202e4-7380-46df-b386-7a24e9007934 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:15.763783 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38202e4-7380-46df-b386-7a24e9007934 None admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:15.765068 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38202e4-7380-46df-b386-7a24e9007934 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:15.765366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38202e4-7380-46df-b386-7a24e9007934 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:15.767214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:15.768039 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38202e4-7380-46df-b386-7a24e9007934 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:15.777501 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032621f-c54f-4d3c-873a-99a5e49e6214 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:15.793933 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 403/808] 10.222.0.55 () {56 vars in 1149 bytes} [Wed Aug 24 16:51:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:15.794158 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38202e4-7380-46df-b386-7a24e9007934 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:15.815393 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a935f7-dca3-45fd-af33-4246ca49231a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:15.816386 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a935f7-dca3-45fd-af33-4246ca49231a None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:15.816663 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a935f7-dca3-45fd-af33-4246ca49231a None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:15.816933 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a935f7-dca3-45fd-af33-4246ca49231a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:15.824445 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a935f7-dca3-45fd-af33-4246ca49231a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:15.825944 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a935f7-dca3-45fd-af33-4246ca49231a None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:15.838441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-b1a935f7-dca3-45fd-af33-4246ca49231a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:51:15.838441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:15.838441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:15.838441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:15.838441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:15.838441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:15.838441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:15.838441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:15.838441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:15.838441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:15.838441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:15.838441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:15.838441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:51:15.838441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:51:15.838441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:51:15.838441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:51:15.839763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:15.839763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:15.839763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:51:15.839763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:15.839763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:51:15.839763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:15.839763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:15.839763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:15.839763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:15.839763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:15.839763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:15.839763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:15.839763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:15.839763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:15.839763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:15.839763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:15.839763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:15.839763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:15.840772 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:15.840772 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:15.840772 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:51:15.840772 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:51:15.840772 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:51:15.840772 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:51:15.840772 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:51:15.840772 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:51:15.840772 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:51:15.840772 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:15.840772 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 406/809] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Aug 24 16:51:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:15.840772 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a935f7-dca3-45fd-af33-4246ca49231a None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:15.852389 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:15.910197 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38202e4-7380-46df-b386-7a24e9007934 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:15.948272 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192468db-ddb9-4de9-80da-d683822e37cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:15.949330 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192468db-ddb9-4de9-80da-d683822e37cc None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:15.949815 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192468db-ddb9-4de9-80da-d683822e37cc None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:15.950290 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192468db-ddb9-4de9-80da-d683822e37cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:15.952911 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a935f7-dca3-45fd-af33-4246ca49231a None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:15.957814 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192468db-ddb9-4de9-80da-d683822e37cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:15.959619 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192468db-ddb9-4de9-80da-d683822e37cc None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:15.972119 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-192468db-ddb9-4de9-80da-d683822e37cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:15.972119 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:15.972119 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:15.972119 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:15.972119 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:15.972119 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:15.972119 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:15.972119 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:15.972119 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:15.972119 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:15.972119 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:15.972119 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:15.972119 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:51:15.972119 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:51:15.972119 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:51:15.973208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:51:15.973208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:15.973208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:15.973208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:15.973208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:15.973208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:15.973208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:15.973208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:15.973208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:15.973208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:15.973208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:15.973208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:15.973208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:15.973208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:15.973208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:15.973208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:15.973208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:15.974191 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:51:15.974191 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:51:15.974191 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:51:15.974191 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:51:15.974191 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:51:15.974191 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:51:15.974191 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:15.974191 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:15.978746 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 404/810] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:51:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:15.979513 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192468db-ddb9-4de9-80da-d683822e37cc None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:15.990434 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b1a76-e692-4913-86d5-d2addefb66af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:15.991092 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b1a76-e692-4913-86d5-d2addefb66af None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:15.992025 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b1a76-e692-4913-86d5-d2addefb66af None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:15.992308 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b1a76-e692-4913-86d5-d2addefb66af None admin] PATH_INFO: `/v3/services/network` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:15.992893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b1a76-e692-4913-86d5-d2addefb66af None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:15.994251 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b1a76-e692-4913-86d5-d2addefb66af None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:16.002860 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-e25b1a76-e692-4913-86d5-d2addefb66af None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 16:51:16.002860 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:16.002860 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:51:16.002860 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:51:16.002860 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:51:16.002860 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:51:16.002860 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:51:16.002860 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:16.002860 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 16:51:16.002860 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:16.002860 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:51:16.002860 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:16.002860 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:16.002860 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:16.002860 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:16.002860 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:16.002860 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:16.003967 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:16.003967 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:16.003967 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:16.003967 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:16.003967 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:16.003967 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:16.003967 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:51:16.003967 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:51:16.003967 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:51:16.003967 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:51:16.003967 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:16.003967 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:16.003967 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:16.003967 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:16.003967 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:16.003967 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:16.004826 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:16.004826 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:16.004826 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:16.004826 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:16.004826 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:16.004826 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:16.004826 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:16.004826 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:16.004826 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:16.004826 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:16.004826 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:51:16.004826 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:16.004826 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 16:51:16.004826 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:16.004826 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 407/811] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:51:15 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:16.005625 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b1a76-e692-4913-86d5-d2addefb66af None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:16.024712 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:16.092793 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192468db-ddb9-4de9-80da-d683822e37cc None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:16.103281 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:16.111344 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b1a76-e692-4913-86d5-d2addefb66af None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:16.128040 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa3ad8-d42d-4738-8180-98c7b19408ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:16.128904 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa3ad8-d42d-4738-8180-98c7b19408ce None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:16.129184 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa3ad8-d42d-4738-8180-98c7b19408ce None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:16.129458 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fa3ad8-d42d-4738-8180-98c7b19408ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:16.140783 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa3ad8-d42d-4738-8180-98c7b19408ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:16.142235 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fa3ad8-d42d-4738-8180-98c7b19408ce None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:16.146256 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15afdf9-5ae9-4ff7-8573-bef3b9eb200b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:16.150620 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15afdf9-5ae9-4ff7-8573-bef3b9eb200b None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:16.150620 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15afdf9-5ae9-4ff7-8573-bef3b9eb200b None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:16.150620 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15afdf9-5ae9-4ff7-8573-bef3b9eb200b None admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:16.150620 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15afdf9-5ae9-4ff7-8573-bef3b9eb200b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:16.150620 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15afdf9-5ae9-4ff7-8573-bef3b9eb200b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:16.150620 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15afdf9-5ae9-4ff7-8573-bef3b9eb200b None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:16.157288 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-f4fa3ad8-d42d-4738-8180-98c7b19408ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:16.157288 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:16.157288 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:16.157288 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:16.157288 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:16.157288 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:16.157288 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:16.157288 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:16.157288 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:16.157288 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:16.157288 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:16.157288 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:16.157288 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:16.157288 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:16.157288 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:16.157288 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:16.158239 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:16.158239 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:16.158239 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:16.158239 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:16.158239 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:16.158239 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:16.158239 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:16.158239 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:16.158239 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:16.158239 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:16.158239 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:16.158239 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:16.158239 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:16.158239 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:16.158239 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:16.158239 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:16.158239 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:16.159156 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:16.159156 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:16.159156 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:16.159156 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 405/812] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:16.159156 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa3ad8-d42d-4738-8180-98c7b19408ce None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:16.173143 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 408/813] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Aug 24 16:51:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:16.173982 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15afdf9-5ae9-4ff7-8573-bef3b9eb200b None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:16.247164 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:16.264477 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fa3ad8-d42d-4738-8180-98c7b19408ce None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:16.278066 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15afdf9-5ae9-4ff7-8573-bef3b9eb200b None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:16.298217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826fd1d-ce2f-45a8-803b-851509f9b5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:16.298850 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826fd1d-ce2f-45a8-803b-851509f9b5fa None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:16.299153 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826fd1d-ce2f-45a8-803b-851509f9b5fa None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:16.299434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a826fd1d-ce2f-45a8-803b-851509f9b5fa None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:16.300019 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826fd1d-ce2f-45a8-803b-851509f9b5fa None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:16.301379 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a826fd1d-ce2f-45a8-803b-851509f9b5fa None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:16.310087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-a826fd1d-ce2f-45a8-803b-851509f9b5fa None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 16:51:16.310087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:16.310087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:51:16.310087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:51:16.310087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:51:16.310087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:51:16.310087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:51:16.310087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:16.310087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 16:51:16.310087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:16.310087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:51:16.310087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:16.310087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:16.310087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:16.310087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:16.310087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:16.310087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:16.311380 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:16.311380 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:16.311380 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:16.311380 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:16.311380 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:16.311380 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:16.311380 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:51:16.311380 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:51:16.311380 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:51:16.311380 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:51:16.311380 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:16.311380 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:16.311380 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:16.311380 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:16.311380 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:16.311380 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:16.312211 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:16.312211 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:16.312211 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:16.312211 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:16.312211 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:16.312211 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:16.312211 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:16.312211 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:16.312211 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:16.312211 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:16.312211 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:51:16.312211 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:16.312211 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 16:51:16.312211 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:16.312211 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 406/814] 10.222.0.55 () {56 vars in 1129 bytes} [Wed Aug 24 16:51:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:16.312999 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826fd1d-ce2f-45a8-803b-851509f9b5fa None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:16.313889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8504fa1-4604-47e9-9574-c8e3b778ec60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:16.314501 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8504fa1-4604-47e9-9574-c8e3b778ec60 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:16.314783 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8504fa1-4604-47e9-9574-c8e3b778ec60 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:16.315057 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8504fa1-4604-47e9-9574-c8e3b778ec60 None admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:16.315776 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8504fa1-4604-47e9-9574-c8e3b778ec60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:16.316424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8504fa1-4604-47e9-9574-c8e3b778ec60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:16.317855 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8504fa1-4604-47e9-9574-c8e3b778ec60 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:16.330205 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 409/815] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:51:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:16.331027 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8504fa1-4604-47e9-9574-c8e3b778ec60 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:16.339774 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:16.414217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a826fd1d-ce2f-45a8-803b-851509f9b5fa None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:16.430599 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8504fa1-4604-47e9-9574-c8e3b778ec60 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:16.450053 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87910f2d-95f5-41cb-9792-55986946a010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:16.450654 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87910f2d-95f5-41cb-9792-55986946a010 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:16.450935 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87910f2d-95f5-41cb-9792-55986946a010 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:16.451227 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87910f2d-95f5-41cb-9792-55986946a010 None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:16.451847 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87910f2d-95f5-41cb-9792-55986946a010 None admin] RBAC: Adding query filter params (name=network) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:16.452148 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87910f2d-95f5-41cb-9792-55986946a010 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:16.453502 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87910f2d-95f5-41cb-9792-55986946a010 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:16.458033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 407/816] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Aug 24 16:51:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:16.458829 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87910f2d-95f5-41cb-9792-55986946a010 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:16.468965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:16.474454 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81870d-c22a-4ac3-a7c0-f032ab49a81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:16.475067 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81870d-c22a-4ac3-a7c0-f032ab49a81b None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:16.475468 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81870d-c22a-4ac3-a7c0-f032ab49a81b None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:16.475837 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81870d-c22a-4ac3-a7c0-f032ab49a81b None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:16.476487 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81870d-c22a-4ac3-a7c0-f032ab49a81b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:16.480290 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81870d-c22a-4ac3-a7c0-f032ab49a81b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:16.480290 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81870d-c22a-4ac3-a7c0-f032ab49a81b None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:16.490513 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 410/817] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:16.491883 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81870d-c22a-4ac3-a7c0-f032ab49a81b None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:16.548271 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:16.561268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87910f2d-95f5-41cb-9792-55986946a010 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:16.591823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81870d-c22a-4ac3-a7c0-f032ab49a81b None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:16.596920 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab211f3-cf40-481a-b3dd-8f23d8318c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:16.597528 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab211f3-cf40-481a-b3dd-8f23d8318c3f None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:16.597804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab211f3-cf40-481a-b3dd-8f23d8318c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:16.598071 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab211f3-cf40-481a-b3dd-8f23d8318c3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:16.627859 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c6b80-e2e9-4f41-8c51-0293855bcbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:16.628565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c6b80-e2e9-4f41-8c51-0293855bcbd5 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:16.628840 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c6b80-e2e9-4f41-8c51-0293855bcbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:16.629117 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c6b80-e2e9-4f41-8c51-0293855bcbd5 None admin] PATH_INFO: `/v3/services` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:16.629743 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c6b80-e2e9-4f41-8c51-0293855bcbd5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:16.630043 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c6b80-e2e9-4f41-8c51-0293855bcbd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:16.631429 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c6b80-e2e9-4f41-8c51-0293855bcbd5 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:16.636775 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 411/818] 10.222.0.55 () {56 vars in 1124 bytes} [Wed Aug 24 16:51:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:16.637584 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c6b80-e2e9-4f41-8c51-0293855bcbd5 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:16.667253 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab211f3-cf40-481a-b3dd-8f23d8318c3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:16.668707 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab211f3-cf40-481a-b3dd-8f23d8318c3f None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:16.696956 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:16.742572 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c6b80-e2e9-4f41-8c51-0293855bcbd5 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:16.755336 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:16.768046 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 408/819] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:51:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:51:16.768868 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab211f3-cf40-481a-b3dd-8f23d8318c3f None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:16.777341 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8504d1e-01d4-4ebf-a1bc-9b7263b12ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:16.778053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8504d1e-01d4-4ebf-a1bc-9b7263b12ec8 None admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:16.778333 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8504d1e-01d4-4ebf-a1bc-9b7263b12ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:16.788125 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8504d1e-01d4-4ebf-a1bc-9b7263b12ec8 None admin] PATH_INFO: `/v3/projects/ebae6aa9c60343e6ba0ff1cd62619642/users/c067bc2d84b741d08ac47e40adae4b4f/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:16.788125 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8504d1e-01d4-4ebf-a1bc-9b7263b12ec8 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebae6aa9c60343e6ba0ff1cd62619642, user_id=c067bc2d84b741d08ac47e40adae4b4f, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:16.788125 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8504d1e-01d4-4ebf-a1bc-9b7263b12ec8 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:16.866702 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab211f3-cf40-481a-b3dd-8f23d8318c3f None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:16.872852 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 412/820] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Aug 24 16:51:16 2022] PUT /identity/v3/projects/ebae6aa9c60343e6ba0ff1cd62619642/users/c067bc2d84b741d08ac47e40adae4b4f/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:51:16.873747 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8504d1e-01d4-4ebf-a1bc-9b7263b12ec8 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:16.914928 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ea727-0827-4c40-af2b-7cc1b1aac710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:16.915632 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ea727-0827-4c40-af2b-7cc1b1aac710 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:16.915912 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ea727-0827-4c40-af2b-7cc1b1aac710 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:16.916187 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ea727-0827-4c40-af2b-7cc1b1aac710 None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:16.916853 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ea727-0827-4c40-af2b-7cc1b1aac710 None admin] RBAC: Adding query filter params (type=network) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:16.917158 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ea727-0827-4c40-af2b-7cc1b1aac710 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:16.918602 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ea727-0827-4c40-af2b-7cc1b1aac710 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:16.929931 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 409/821] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Aug 24 16:51:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:16.929931 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ea727-0827-4c40-af2b-7cc1b1aac710 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:16.987682 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:17.011631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8504d1e-01d4-4ebf-a1bc-9b7263b12ec8 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:17.034542 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:17.043842 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ea727-0827-4c40-af2b-7cc1b1aac710 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:17.053440 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178e20f-8f3e-4912-b0b6-fd4bbe5a6cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:17.055383 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178e20f-8f3e-4912-b0b6-fd4bbe5a6cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:17.055668 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178e20f-8f3e-4912-b0b6-fd4bbe5a6cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:17.055935 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178e20f-8f3e-4912-b0b6-fd4bbe5a6cf5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:17.063086 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178e20f-8f3e-4912-b0b6-fd4bbe5a6cf5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:17.064551 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b178e20f-8f3e-4912-b0b6-fd4bbe5a6cf5 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:17.077824 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-b178e20f-8f3e-4912-b0b6-fd4bbe5a6cf5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:17.077824 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:17.077824 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:17.077824 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:17.077824 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:17.077824 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:17.077824 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:17.077824 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:17.077824 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:17.077824 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:17.077824 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:17.077824 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:17.077824 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:51:17.077824 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:51:17.077824 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:51:17.081712 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:51:17.081712 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:17.081712 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:17.081712 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:17.081712 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:17.081712 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:17.081712 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:17.081712 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:17.081712 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:17.081712 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:17.081712 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:17.081712 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:17.081712 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:17.081712 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:17.081712 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:17.081712 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:17.081712 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:17.082825 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:51:17.082825 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:51:17.082825 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:51:17.082825 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:51:17.082825 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:51:17.082825 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:51:17.082825 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:17.082825 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:17.082825 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 413/822] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:51:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:17.082825 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178e20f-8f3e-4912-b0b6-fd4bbe5a6cf5 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:17.086298 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14244e-fca0-4313-8e6a-5f7edc7b554c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:17.087084 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14244e-fca0-4313-8e6a-5f7edc7b554c None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:17.087516 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14244e-fca0-4313-8e6a-5f7edc7b554c None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:17.087890 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14244e-fca0-4313-8e6a-5f7edc7b554c None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:17.088613 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14244e-fca0-4313-8e6a-5f7edc7b554c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:17.088991 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14244e-fca0-4313-8e6a-5f7edc7b554c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:17.090475 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14244e-fca0-4313-8e6a-5f7edc7b554c None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:17.096469 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 410/823] 10.222.0.55 () {56 vars in 1124 bytes} [Wed Aug 24 16:51:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:17.101284 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14244e-fca0-4313-8e6a-5f7edc7b554c None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:17.204855 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178e20f-8f3e-4912-b0b6-fd4bbe5a6cf5 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:17.216907 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14244e-fca0-4313-8e6a-5f7edc7b554c None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:17.234736 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:17.242036 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a051fb-cd78-41c6-b635-eb86463df4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:17.242744 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a051fb-cd78-41c6-b635-eb86463df4ba None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:17.250208 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a051fb-cd78-41c6-b635-eb86463df4ba None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:17.250208 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a051fb-cd78-41c6-b635-eb86463df4ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:17.254234 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a051fb-cd78-41c6-b635-eb86463df4ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:17.254562 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9123404-f8d4-43b5-aa3c-67e27121ee8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:17.255207 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9123404-f8d4-43b5-aa3c-67e27121ee8a None admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:17.255488 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9123404-f8d4-43b5-aa3c-67e27121ee8a None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:17.255713 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a051fb-cd78-41c6-b635-eb86463df4ba None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:17.255809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9123404-f8d4-43b5-aa3c-67e27121ee8a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:17.256398 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9123404-f8d4-43b5-aa3c-67e27121ee8a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:17.258310 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9123404-f8d4-43b5-aa3c-67e27121ee8a None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:17.271091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-b1a051fb-cd78-41c6-b635-eb86463df4ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:17.271091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:17.271091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:17.271091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:17.271091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:17.271091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:17.271091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:17.271091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:17.271091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:17.271091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:17.271091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:17.271091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:17.271091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:17.271091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:17.271091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:17.271091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:17.272370 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:17.272370 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:17.272370 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:17.272370 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:17.272370 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:17.272370 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:17.272370 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:17.272370 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:17.272370 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:17.272370 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:17.272370 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:17.272370 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:17.272370 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:17.272370 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:17.272370 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:17.272370 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:17.272370 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:17.273356 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:17.273356 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:17.273356 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:17.273356 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 414/824] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:17.273356 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a051fb-cd78-41c6-b635-eb86463df4ba None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:17.302620 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:17.375067 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a051fb-cd78-41c6-b635-eb86463df4ba None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:17.392176 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 411/825] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 16:51:17 2022] POST /identity/v3/endpoints => generated 337 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:51:17.404409 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9123404-f8d4-43b5-aa3c-67e27121ee8a None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:17.423556 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8fe17-ddbf-4493-bdc9-a6d753cfa37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:17.424312 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8fe17-ddbf-4493-bdc9-a6d753cfa37d None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:17.424669 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8fe17-ddbf-4493-bdc9-a6d753cfa37d None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:17.425096 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e8fe17-ddbf-4493-bdc9-a6d753cfa37d None admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:17.426046 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e8fe17-ddbf-4493-bdc9-a6d753cfa37d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:17.426429 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e8fe17-ddbf-4493-bdc9-a6d753cfa37d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:17.428166 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e8fe17-ddbf-4493-bdc9-a6d753cfa37d None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:17.442893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 415/826] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:51:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:17.444167 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8fe17-ddbf-4493-bdc9-a6d753cfa37d None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:17.553944 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9123404-f8d4-43b5-aa3c-67e27121ee8a None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:17.565832 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:17.589683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e8fe17-ddbf-4493-bdc9-a6d753cfa37d None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:17.601874 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80e1bb-786b-4a59-a486-47dabb85118a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:17.602484 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80e1bb-786b-4a59-a486-47dabb85118a None admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:17.602787 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80e1bb-786b-4a59-a486-47dabb85118a None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:17.603056 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80e1bb-786b-4a59-a486-47dabb85118a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:17.603780 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe80e1bb-786b-4a59-a486-47dabb85118a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:17.606047 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe80e1bb-786b-4a59-a486-47dabb85118a None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:17.634831 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8526b0-947e-4329-82cd-7cf0068b01c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:17.635608 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8526b0-947e-4329-82cd-7cf0068b01c7 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:17.636045 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8526b0-947e-4329-82cd-7cf0068b01c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:17.636318 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8526b0-947e-4329-82cd-7cf0068b01c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:17.637039 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8526b0-947e-4329-82cd-7cf0068b01c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:17.637411 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8526b0-947e-4329-82cd-7cf0068b01c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:17.638842 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8526b0-947e-4329-82cd-7cf0068b01c7 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:17.651334 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 416/827] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:17.652194 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8526b0-947e-4329-82cd-7cf0068b01c7 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:17.710471 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 412/828] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 16:51:17 2022] POST /identity/v3/endpoints => generated 346 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:51:17.710471 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80e1bb-786b-4a59-a486-47dabb85118a None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:17.741782 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:17.781898 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8526b0-947e-4329-82cd-7cf0068b01c7 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:17.838280 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80e1bb-786b-4a59-a486-47dabb85118a None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:17.843094 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ed5b7-297d-4e78-b90e-78b1cfb38e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:17.843802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ed5b7-297d-4e78-b90e-78b1cfb38e34 None admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:17.844080 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ed5b7-297d-4e78-b90e-78b1cfb38e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:17.844351 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ed5b7-297d-4e78-b90e-78b1cfb38e34 None admin] PATH_INFO: `/v3/projects/ebae6aa9c60343e6ba0ff1cd62619642/users/ae9fc5f06a0441da80e656fa1e88db5d/roles/494c75ed8f864e3b955fdb043e96c675` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:17.861364 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:17.865268 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ed5b7-297d-4e78-b90e-78b1cfb38e34 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebae6aa9c60343e6ba0ff1cd62619642, user_id=ae9fc5f06a0441da80e656fa1e88db5d, role_id=494c75ed8f864e3b955fdb043e96c675)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:17.870266 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ed5b7-297d-4e78-b90e-78b1cfb38e34 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:17.892361 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7a0a7-3339-4f3f-907b-62743a01cb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:17.893018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7a0a7-3339-4f3f-907b-62743a01cb4f None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:17.893304 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7a0a7-3339-4f3f-907b-62743a01cb4f None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:17.894022 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e7a0a7-3339-4f3f-907b-62743a01cb4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:17.901964 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7a0a7-3339-4f3f-907b-62743a01cb4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:17.903442 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e7a0a7-3339-4f3f-907b-62743a01cb4f None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:17.915664 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-93e7a0a7-3339-4f3f-907b-62743a01cb4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:17.915664 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:17.915664 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:17.915664 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:17.915664 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:17.915664 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:17.915664 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:17.915664 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:17.915664 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:17.915664 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:17.915664 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:17.915664 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:17.915664 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:51:17.915664 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:51:17.915664 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:51:17.920491 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:51:17.920491 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:17.920491 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:17.920491 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:17.920491 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:17.920491 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:17.920491 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:17.920491 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:17.920491 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:17.920491 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:17.920491 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:17.920491 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:17.920491 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:17.920491 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:17.920491 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:17.920491 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:17.920491 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:17.921393 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:51:17.921393 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:51:17.921393 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:51:17.921393 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:51:17.921393 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:51:17.921393 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:51:17.921393 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:17.921393 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:17.921393 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 413/829] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:51:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:17.923282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7a0a7-3339-4f3f-907b-62743a01cb4f None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:17.942291 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 417/830] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Aug 24 16:51:17 2022] PUT /identity/v3/projects/ebae6aa9c60343e6ba0ff1cd62619642/users/ae9fc5f06a0441da80e656fa1e88db5d/roles/494c75ed8f864e3b955fdb043e96c675 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:51:18.030721 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:18.049569 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e7a0a7-3339-4f3f-907b-62743a01cb4f None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:18.090218 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4609ba9-4d10-400f-a458-faba5a898c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:18.090764 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4609ba9-4d10-400f-a458-faba5a898c91 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:18.091050 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4609ba9-4d10-400f-a458-faba5a898c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:18.091409 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4609ba9-4d10-400f-a458-faba5a898c91 None admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:18.092124 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4609ba9-4d10-400f-a458-faba5a898c91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:18.092431 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4609ba9-4d10-400f-a458-faba5a898c91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:18.093904 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4609ba9-4d10-400f-a458-faba5a898c91 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:18.108160 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 414/831] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:51:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:18.114231 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ed5b7-297d-4e78-b90e-78b1cfb38e34 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:18.224012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ed5b7-297d-4e78-b90e-78b1cfb38e34 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:18.261986 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb30e6d-d1b0-4d41-872e-aa1a4f2e1162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:18.262604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb30e6d-d1b0-4d41-872e-aa1a4f2e1162 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:18.262884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb30e6d-d1b0-4d41-872e-aa1a4f2e1162 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:18.263184 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb30e6d-d1b0-4d41-872e-aa1a4f2e1162 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:18.263923 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb30e6d-d1b0-4d41-872e-aa1a4f2e1162 None admin] RBAC: Adding query filter params (role.id=99f0ace9fc4d4d028ca52fa9730cab4b, scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642, user.id=28a1c617fc264b118e61f2a97ecb3f39) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:18.264231 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb30e6d-d1b0-4d41-872e-aa1a4f2e1162 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:18.265673 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb30e6d-d1b0-4d41-872e-aa1a4f2e1162 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:18.272684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 418/832] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:51:18 2022] GET /identity/v3/role_assignments?user.id=28a1c617fc264b118e61f2a97ecb3f39&scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642&role.id=99f0ace9fc4d4d028ca52fa9730cab4b => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:18.854152 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa3b74-ad8f-469b-8c0f-65e538db5f46 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:18.854682 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa3b74-ad8f-469b-8c0f-65e538db5f46 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:18.854682 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa3b74-ad8f-469b-8c0f-65e538db5f46 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:18.862865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 415/833] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:18.868174 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07a258-ff1f-4621-9925-f954ec103f90 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:18.869030 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07a258-ff1f-4621-9925-f954ec103f90 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:18.869517 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db07a258-ff1f-4621-9925-f954ec103f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:18.891268 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-db07a258-ff1f-4621-9925-f954ec103f90 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:18.892451 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-db07a258-ff1f-4621-9925-f954ec103f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:18.967767 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:19.003318 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 419/834] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:51:19.490604 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa3b74-ad8f-469b-8c0f-65e538db5f46 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:19.668369 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa3b74-ad8f-469b-8c0f-65e538db5f46 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:19.767353 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a4519-4a6a-42fa-968d-367e0b9db702 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:19.767598 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a4519-4a6a-42fa-968d-367e0b9db702 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:19.767931 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a4519-4a6a-42fa-968d-367e0b9db702 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:19.769472 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 420/835] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:19.775353 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17eeec-9b62-4867-8dd0-0f65c579ca5d None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:19.775715 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17eeec-9b62-4867-8dd0-0f65c579ca5d None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:19.775956 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17eeec-9b62-4867-8dd0-0f65c579ca5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:19.794901 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-7f17eeec-9b62-4867-8dd0-0f65c579ca5d None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:19.796203 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-7f17eeec-9b62-4867-8dd0-0f65c579ca5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:19.890872 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 421/836] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:51:19.899089 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda5766f-e71a-4e8c-aa24-9f310e6db846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:19.900420 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5766f-e71a-4e8c-aa24-9f310e6db846 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:19.901781 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5766f-e71a-4e8c-aa24-9f310e6db846 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:19.902268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda5766f-e71a-4e8c-aa24-9f310e6db846 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:19.915370 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda5766f-e71a-4e8c-aa24-9f310e6db846 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:51:19.920821 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-eda5766f-e71a-4e8c-aa24-9f310e6db846 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:51:19.920821 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:19.920821 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:19.920821 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:19.920821 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:19.920821 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:19.920821 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:19.920821 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:19.920821 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:19.920821 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:19.920821 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:19.920821 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:19.920821 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:51:19.920821 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:51:19.920821 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:51:19.920821 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:51:19.921752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:51:19.921752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:51:19.921752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:51:19.921752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:51:19.921752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:19.921752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:19.921752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:19.921752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:19.921752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:19.921752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:19.921752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:19.921752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:19.921752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:19.921752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:19.921752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:19.921752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:19.922602 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:19.922602 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:19.922602 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:19.922602 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:19.922602 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:51:19.922602 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:51:19.922602 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:51:19.922602 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:51:19.922602 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:51:19.922602 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:51:19.922602 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:51:19.922602 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:19.929162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 416/837] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:51:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 436 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:19.932029 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17eeec-9b62-4867-8dd0-0f65c579ca5d None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:20.020478 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae7dd1-3323-474e-98ed-4f3a00bdb64a None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:20.020672 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae7dd1-3323-474e-98ed-4f3a00bdb64a None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:20.020935 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ae7dd1-3323-474e-98ed-4f3a00bdb64a None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:20.022614 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 417/838] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:51:20.027675 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9449c-2dcd-4258-9306-9acab2b31072 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:20.027957 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9449c-2dcd-4258-9306-9acab2b31072 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:20.028233 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9449c-2dcd-4258-9306-9acab2b31072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:20.036437 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:20.041447 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17eeec-9b62-4867-8dd0-0f65c579ca5d None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:20.047523 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-3dd9449c-2dcd-4258-9306-9acab2b31072 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:20.056119 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-3dd9449c-2dcd-4258-9306-9acab2b31072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:20.080907 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:20.085056 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819d040-b948-42f5-b837-77e6cf748d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:20.085996 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819d040-b948-42f5-b837-77e6cf748d37 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:20.086275 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819d040-b948-42f5-b837-77e6cf748d37 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:20.086548 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819d040-b948-42f5-b837-77e6cf748d37 None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:20.087283 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819d040-b948-42f5-b837-77e6cf748d37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:20.087718 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819d040-b948-42f5-b837-77e6cf748d37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:20.089782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5819d040-b948-42f5-b837-77e6cf748d37 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:20.104591 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 422/839] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:51:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:20.106835 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819d040-b948-42f5-b837-77e6cf748d37 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:20.143201 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 418/840] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:51:20.162353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9449c-2dcd-4258-9306-9acab2b31072 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:20.223528 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819d040-b948-42f5-b837-77e6cf748d37 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:20.264617 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb26299-21e9-4f93-9ce1-ddf37656f12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:20.265697 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb26299-21e9-4f93-9ce1-ddf37656f12b None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:20.266171 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb26299-21e9-4f93-9ce1-ddf37656f12b None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:20.266660 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb26299-21e9-4f93-9ce1-ddf37656f12b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:20.275146 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9449c-2dcd-4258-9306-9acab2b31072 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:20.279545 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb26299-21e9-4f93-9ce1-ddf37656f12b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:20.281213 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb26299-21e9-4f93-9ce1-ddf37656f12b None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:20.297607 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-0bb26299-21e9-4f93-9ce1-ddf37656f12b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:20.297607 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:20.297607 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:20.297607 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:20.297607 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:20.297607 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:20.297607 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:20.297607 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:20.297607 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:20.297607 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:20.297607 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:20.297607 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:20.297607 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:20.297607 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:20.297607 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:20.297607 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:20.298612 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:20.298612 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:20.298612 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:20.298612 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:20.298612 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:20.298612 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:20.298612 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:20.298612 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:20.298612 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:20.298612 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:20.298612 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:20.298612 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:20.298612 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:20.298612 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:20.298612 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:20.298612 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:20.298612 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:20.299555 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:20.299555 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:20.299555 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:20.306556 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 423/841] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:20.308202 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb26299-21e9-4f93-9ce1-ddf37656f12b None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:20.313362 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b21142-8a10-4376-a23d-53de28735750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:20.313650 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b21142-8a10-4376-a23d-53de28735750 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:20.313892 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b21142-8a10-4376-a23d-53de28735750 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:20.314163 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b21142-8a10-4376-a23d-53de28735750 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:20.314756 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b21142-8a10-4376-a23d-53de28735750 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:20.316162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b21142-8a10-4376-a23d-53de28735750 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:20.318088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:20.326049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-07b21142-8a10-4376-a23d-53de28735750 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 16:51:20.326049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:20.326049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:51:20.326049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:51:20.326049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:51:20.326049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:51:20.326049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:51:20.326049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:20.326049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 16:51:20.326049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:20.326049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:51:20.326049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:20.326049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:20.326049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:20.326049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:20.326049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:20.326049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:20.337369 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:20.337369 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:20.337369 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:20.337369 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:20.337369 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:20.337369 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:20.337369 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:51:20.337369 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:51:20.337369 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:51:20.337369 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:51:20.337369 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:20.337369 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:20.337369 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:20.337369 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:20.337369 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:20.337369 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:20.338295 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:20.338295 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:20.338295 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:20.338295 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:20.338295 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:20.338295 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:20.338295 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:20.338295 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:20.338295 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:20.338295 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:20.338295 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:51:20.338295 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:20.338295 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 16:51:20.338295 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:20.338295 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 419/842] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Aug 24 16:51:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:20.339203 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b21142-8a10-4376-a23d-53de28735750 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:20.347751 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:20.434959 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb26299-21e9-4f93-9ce1-ddf37656f12b None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:20.443506 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b21142-8a10-4376-a23d-53de28735750 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:20.474356 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de768420-3145-49e4-b8e8-6d8ae5bc43db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:20.474996 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de768420-3145-49e4-b8e8-6d8ae5bc43db None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:20.476039 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de768420-3145-49e4-b8e8-6d8ae5bc43db None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:20.476314 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de768420-3145-49e4-b8e8-6d8ae5bc43db None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:20.476958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de768420-3145-49e4-b8e8-6d8ae5bc43db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:20.477259 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de768420-3145-49e4-b8e8-6d8ae5bc43db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:20.478619 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de768420-3145-49e4-b8e8-6d8ae5bc43db None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:20.480575 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d70fb-6e02-4e44-8d29-7a9335352c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:20.481440 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d70fb-6e02-4e44-8d29-7a9335352c20 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:20.481865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d70fb-6e02-4e44-8d29-7a9335352c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:20.482283 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4d70fb-6e02-4e44-8d29-7a9335352c20 None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:20.483071 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d70fb-6e02-4e44-8d29-7a9335352c20 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:20.483546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d70fb-6e02-4e44-8d29-7a9335352c20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:20.485163 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4d70fb-6e02-4e44-8d29-7a9335352c20 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:20.491169 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 424/843] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:20.494880 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 420/844] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Aug 24 16:51:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:20.495892 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d70fb-6e02-4e44-8d29-7a9335352c20 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:20.495999 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de768420-3145-49e4-b8e8-6d8ae5bc43db None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:20.567858 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:20.593776 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:20.606116 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de768420-3145-49e4-b8e8-6d8ae5bc43db None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:20.612207 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4d70fb-6e02-4e44-8d29-7a9335352c20 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:20.644515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6589b2-b491-4293-8546-208d6db48883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:20.645154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6589b2-b491-4293-8546-208d6db48883 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:20.645428 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6589b2-b491-4293-8546-208d6db48883 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:20.645694 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6589b2-b491-4293-8546-208d6db48883 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:20.649505 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad85a1d-32ec-4179-bfd1-6e8a51fc850a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:20.650126 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad85a1d-32ec-4179-bfd1-6e8a51fc850a None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:20.650401 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad85a1d-32ec-4179-bfd1-6e8a51fc850a None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:20.650670 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad85a1d-32ec-4179-bfd1-6e8a51fc850a None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:20.651339 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad85a1d-32ec-4179-bfd1-6e8a51fc850a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:20.651644 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad85a1d-32ec-4179-bfd1-6e8a51fc850a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:20.653069 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad85a1d-32ec-4179-bfd1-6e8a51fc850a None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:20.657377 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6589b2-b491-4293-8546-208d6db48883 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:51:20.667478 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 421/845] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Aug 24 16:51:20 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:20.667478 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad85a1d-32ec-4179-bfd1-6e8a51fc850a None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:20.667740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-8a6589b2-b491-4293-8546-208d6db48883 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:51:20.667740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:20.667740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:20.667740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:20.667740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:20.667740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:20.667740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:20.667740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:20.667740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:20.667740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:20.667740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:20.667740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:20.667740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:51:20.667740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:51:20.667740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:51:20.667740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:51:20.668671 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:51:20.668671 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:51:20.668671 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:51:20.668671 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:51:20.668671 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:20.668671 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:20.668671 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:20.668671 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:20.668671 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:20.668671 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:20.668671 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:20.668671 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:20.668671 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:20.668671 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:20.668671 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:20.668671 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:20.669526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:20.669526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:20.669526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:20.669526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:20.669526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:51:20.669526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:51:20.669526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:51:20.669526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:51:20.669526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:51:20.669526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:51:20.669526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:51:20.669526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:20.669526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 425/846] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Aug 24 16:51:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:20.670230 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6589b2-b491-4293-8546-208d6db48883 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:20.784404 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6589b2-b491-4293-8546-208d6db48883 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:20.793135 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad85a1d-32ec-4179-bfd1-6e8a51fc850a None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:20.822562 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d36449-3ce4-4837-8481-2328e25f84e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:20.823090 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d36449-3ce4-4837-8481-2328e25f84e9 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:20.823393 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d36449-3ce4-4837-8481-2328e25f84e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:20.823591 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:20.823688 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d36449-3ce4-4837-8481-2328e25f84e9 None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:20.824323 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d36449-3ce4-4837-8481-2328e25f84e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:20.824620 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d36449-3ce4-4837-8481-2328e25f84e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:20.826922 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d36449-3ce4-4837-8481-2328e25f84e9 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:20.835352 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc593a2-2ef1-4dcf-9941-5ec2baa105f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:20.836417 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc593a2-2ef1-4dcf-9941-5ec2baa105f6 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:20.836417 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc593a2-2ef1-4dcf-9941-5ec2baa105f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:20.836417 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc593a2-2ef1-4dcf-9941-5ec2baa105f6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:20.836682 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 426/847] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Aug 24 16:51:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:20.838797 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59162032-2aa2-443b-bb82-b620e0fc326c None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:20.838797 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59162032-2aa2-443b-bb82-b620e0fc326c None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:20.839070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59162032-2aa2-443b-bb82-b620e0fc326c None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:20.841251 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 427/848] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:20.845897 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba8823-c050-4153-8ce5-c80a9e5ebcdb None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:20.846176 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba8823-c050-4153-8ce5-c80a9e5ebcdb None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:20.846451 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dba8823-c050-4153-8ce5-c80a9e5ebcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:20.849920 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc593a2-2ef1-4dcf-9941-5ec2baa105f6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:20.851670 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc593a2-2ef1-4dcf-9941-5ec2baa105f6 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:20.863888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-9dc593a2-2ef1-4dcf-9941-5ec2baa105f6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:51:20.863888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:20.863888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:20.863888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:20.863888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:20.863888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:20.863888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:20.863888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:20.863888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:20.863888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:20.863888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:20.863888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:20.863888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:51:20.863888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:51:20.863888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:51:20.863888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:51:20.865536 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:20.865536 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:20.865536 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:51:20.865536 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:20.865536 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:51:20.865536 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:20.865536 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:20.865536 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:20.865536 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:20.865536 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:20.865536 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:20.865536 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:20.865536 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:20.865536 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:20.865536 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:20.865536 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:20.865536 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:20.865536 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:20.866728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:20.866728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:20.866728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:51:20.866728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:51:20.866728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:51:20.866728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:51:20.866728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:51:20.866728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:51:20.866728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 16:51:20.866728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:20.870821 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 422/849] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:51:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:20.872190 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc593a2-2ef1-4dcf-9941-5ec2baa105f6 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:20.873506 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-5dba8823-c050-4153-8ce5-c80a9e5ebcdb None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:20.876514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-5dba8823-c050-4153-8ce5-c80a9e5ebcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:20.880058 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:20.950403 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 428/850] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:51:20.951474 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba8823-c050-4153-8ce5-c80a9e5ebcdb None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:20.999924 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc593a2-2ef1-4dcf-9941-5ec2baa105f6 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:21.045441 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f2afc-305c-45b5-8574-6de44deb0e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:21.046324 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f2afc-305c-45b5-8574-6de44deb0e30 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:21.046804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f2afc-305c-45b5-8574-6de44deb0e30 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:21.047273 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f2afc-305c-45b5-8574-6de44deb0e30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:21.062971 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dba8823-c050-4153-8ce5-c80a9e5ebcdb None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:21.064909 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f2afc-305c-45b5-8574-6de44deb0e30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:21.066367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f2afc-305c-45b5-8574-6de44deb0e30 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:21.091379 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-7b1f2afc-305c-45b5-8574-6de44deb0e30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:21.091379 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:21.091379 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:21.091379 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:21.091379 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:21.091379 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:21.091379 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:21.091379 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:21.091379 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:21.091379 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:21.091379 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:21.091379 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:21.091379 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:21.091379 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:21.091379 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:21.091379 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:21.092364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:21.092364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:21.092364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:21.092364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:21.092364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:21.092364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:21.092364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:21.092364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:21.092364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:21.092364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:21.092364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:21.092364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:21.092364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:21.092364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:21.092364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:21.092364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:21.092364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:21.093270 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:21.093270 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:21.093270 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:21.096365 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 423/851] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:21.102032 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f2afc-305c-45b5-8574-6de44deb0e30 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:21.108159 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1074c94-c97b-4d2e-ac15-657e537f6fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:21.109091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1074c94-c97b-4d2e-ac15-657e537f6fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:21.109579 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1074c94-c97b-4d2e-ac15-657e537f6fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:21.110043 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1074c94-c97b-4d2e-ac15-657e537f6fa0 None admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:21.110969 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1074c94-c97b-4d2e-ac15-657e537f6fa0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:21.112068 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1074c94-c97b-4d2e-ac15-657e537f6fa0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:21.114236 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1074c94-c97b-4d2e-ac15-657e537f6fa0 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:21.128085 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:21.147611 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 429/852] 10.222.0.55 () {56 vars in 1135 bytes} [Wed Aug 24 16:51:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:21.149486 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1074c94-c97b-4d2e-ac15-657e537f6fa0 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:21.150380 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:21.222894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f2afc-305c-45b5-8574-6de44deb0e30 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:21.267376 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef6c13-bca7-497f-9951-271a3d2bde89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:21.267826 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1074c94-c97b-4d2e-ac15-657e537f6fa0 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:21.267987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef6c13-bca7-497f-9951-271a3d2bde89 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:21.268266 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef6c13-bca7-497f-9951-271a3d2bde89 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:21.268534 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef6c13-bca7-497f-9951-271a3d2bde89 None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:21.269173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef6c13-bca7-497f-9951-271a3d2bde89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:21.269473 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef6c13-bca7-497f-9951-271a3d2bde89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:21.270840 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef6c13-bca7-497f-9951-271a3d2bde89 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:21.283768 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 424/853] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:21.284388 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef6c13-bca7-497f-9951-271a3d2bde89 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:21.312363 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d5cba-8c59-4326-abe9-29ef9132dab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:21.312973 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d5cba-8c59-4326-abe9-29ef9132dab0 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:21.313253 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d5cba-8c59-4326-abe9-29ef9132dab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:21.313524 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d5cba-8c59-4326-abe9-29ef9132dab0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:21.387835 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:21.388680 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:21.392117 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d5cba-8c59-4326-abe9-29ef9132dab0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:21.392242 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef6c13-bca7-497f-9951-271a3d2bde89 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:21.393742 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d5cba-8c59-4326-abe9-29ef9132dab0 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:21.426884 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853e765-6c71-4411-9f8e-85a294d7b632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:21.427539 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853e765-6c71-4411-9f8e-85a294d7b632 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:21.427814 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853e765-6c71-4411-9f8e-85a294d7b632 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:21.430509 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b853e765-6c71-4411-9f8e-85a294d7b632 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:21.431091 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853e765-6c71-4411-9f8e-85a294d7b632 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:21.432497 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b853e765-6c71-4411-9f8e-85a294d7b632 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:21.441725 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-b853e765-6c71-4411-9f8e-85a294d7b632 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 16:51:21.441725 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:21.441725 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:51:21.441725 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:51:21.441725 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:51:21.441725 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:51:21.441725 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:51:21.441725 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:21.441725 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 16:51:21.441725 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:21.441725 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:51:21.441725 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:21.441725 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:21.441725 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:21.441725 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:21.441725 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:21.442735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:21.442735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:21.442735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:21.442735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:21.442735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:21.442735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:21.442735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:21.442735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:51:21.442735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:51:21.442735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:51:21.442735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:51:21.442735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:21.442735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:21.442735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:21.442735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:21.442735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:21.442735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:21.444109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:21.444109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:21.444109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:21.444109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:21.444109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:21.444109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:21.444109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:21.444109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:21.444109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:21.444109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:21.444109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:51:21.444109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:21.444109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 16:51:21.444109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:21.444109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 425/854] 10.222.0.55 () {56 vars in 1132 bytes} [Wed Aug 24 16:51:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:21.444963 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853e765-6c71-4411-9f8e-85a294d7b632 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:21.508230 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 430/855] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:51:21 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:51:21.509472 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d5cba-8c59-4326-abe9-29ef9132dab0 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:21.555669 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b853e765-6c71-4411-9f8e-85a294d7b632 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:21.592152 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a512ad8-ebb5-4fd9-b748-73a635ab27ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:21.592792 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a512ad8-ebb5-4fd9-b748-73a635ab27ed None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:21.593059 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a512ad8-ebb5-4fd9-b748-73a635ab27ed None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:21.593676 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a512ad8-ebb5-4fd9-b748-73a635ab27ed None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:21.601669 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a512ad8-ebb5-4fd9-b748-73a635ab27ed None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:21.603104 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a512ad8-ebb5-4fd9-b748-73a635ab27ed None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:21.614377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-2a512ad8-ebb5-4fd9-b748-73a635ab27ed None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:51:21.614377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:21.614377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:21.614377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:21.614377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:21.614377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:21.614377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:21.614377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:21.614377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:21.614377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:21.614377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:21.614377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:21.614377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:51:21.614377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:51:21.614377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:51:21.614377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:51:21.615434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:21.615434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:21.615434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:51:21.615434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:21.615434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:51:21.615434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:21.615434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:21.615434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:21.615434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:21.615434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:21.615434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:21.615434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:21.615434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:21.615434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:21.615434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:21.615434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:21.615434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:21.615434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:21.616743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:21.616743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:21.616743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:51:21.616743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:51:21.616743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:51:21.616743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:51:21.616743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:51:21.616743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:51:21.616743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:51:21.616743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:21.617413 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:21.620314 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 426/856] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Aug 24 16:51:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:21.633430 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a512ad8-ebb5-4fd9-b748-73a635ab27ed None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:21.633581 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d5cba-8c59-4326-abe9-29ef9132dab0 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:21.648335 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:21.660292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3385613-133c-4e8c-87a5-7969de001ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:21.660907 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3385613-133c-4e8c-87a5-7969de001ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:21.661186 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3385613-133c-4e8c-87a5-7969de001ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:21.661457 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3385613-133c-4e8c-87a5-7969de001ca9 None admin] PATH_INFO: `/v3/services` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:21.662163 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3385613-133c-4e8c-87a5-7969de001ca9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:21.662519 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3385613-133c-4e8c-87a5-7969de001ca9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:21.663893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3385613-133c-4e8c-87a5-7969de001ca9 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:21.673546 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 431/857] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Aug 24 16:51:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:21.673546 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3385613-133c-4e8c-87a5-7969de001ca9 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:21.738806 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a512ad8-ebb5-4fd9-b748-73a635ab27ed None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:21.774876 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18fec10-008f-4917-a403-53bcb18b925b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:21.775536 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fec10-008f-4917-a403-53bcb18b925b None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:21.775809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fec10-008f-4917-a403-53bcb18b925b None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:21.776073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18fec10-008f-4917-a403-53bcb18b925b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:21.781775 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3385613-133c-4e8c-87a5-7969de001ca9 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:21.787079 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18fec10-008f-4917-a403-53bcb18b925b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:21.788685 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18fec10-008f-4917-a403-53bcb18b925b None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:21.805386 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-b18fec10-008f-4917-a403-53bcb18b925b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:21.805386 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:21.805386 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:21.805386 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:21.805386 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:21.805386 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:21.805386 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:21.805386 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:21.805386 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:21.805386 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:21.805386 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:21.805386 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:21.805386 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:21.805386 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:21.805386 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:21.805386 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:21.806628 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:21.806628 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:21.806628 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:21.806628 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:21.806628 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:21.806628 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:21.806628 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:21.806628 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:21.806628 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:21.806628 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:21.806628 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:21.806628 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:21.806628 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:21.806628 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:21.806628 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:21.806628 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:21.806628 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:21.807573 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:21.807573 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:21.807573 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:21.807573 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 427/858] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:21.807815 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18fec10-008f-4917-a403-53bcb18b925b None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:21.826907 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df7149-6746-4250-8303-b8d10f8ae445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:21.827781 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df7149-6746-4250-8303-b8d10f8ae445 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:21.828067 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df7149-6746-4250-8303-b8d10f8ae445 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:21.828345 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df7149-6746-4250-8303-b8d10f8ae445 None admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:21.829074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df7149-6746-4250-8303-b8d10f8ae445 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:21.829381 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df7149-6746-4250-8303-b8d10f8ae445 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:21.830834 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df7149-6746-4250-8303-b8d10f8ae445 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:21.848721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 432/859] 10.222.0.55 () {56 vars in 1149 bytes} [Wed Aug 24 16:51:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:21.849565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df7149-6746-4250-8303-b8d10f8ae445 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:21.877774 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:21.903668 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:21.933603 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18fec10-008f-4917-a403-53bcb18b925b None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:21.962661 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df7149-6746-4250-8303-b8d10f8ae445 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:21.976780 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b8346-0388-4ce6-94b5-9190154854ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:21.978026 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b8346-0388-4ce6-94b5-9190154854ef None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:21.978689 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b8346-0388-4ce6-94b5-9190154854ef None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:21.979104 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b8346-0388-4ce6-94b5-9190154854ef None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:21.980066 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b8346-0388-4ce6-94b5-9190154854ef None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:21.980541 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b8346-0388-4ce6-94b5-9190154854ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:21.982323 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b8346-0388-4ce6-94b5-9190154854ef None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:21.989424 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 428/860] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Aug 24 16:51:21 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:21.991897 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b8346-0388-4ce6-94b5-9190154854ef None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:22.002721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863b20c-106b-48ec-8af8-052da0074c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:22.003547 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863b20c-106b-48ec-8af8-052da0074c4c None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:22.003918 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863b20c-106b-48ec-8af8-052da0074c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:22.004308 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1863b20c-106b-48ec-8af8-052da0074c4c None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:22.005066 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863b20c-106b-48ec-8af8-052da0074c4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:22.005467 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863b20c-106b-48ec-8af8-052da0074c4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:22.007187 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1863b20c-106b-48ec-8af8-052da0074c4c None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:22.025583 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 433/861] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:22.026714 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863b20c-106b-48ec-8af8-052da0074c4c None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:22.126765 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:22.152092 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1863b20c-106b-48ec-8af8-052da0074c4c None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:22.155744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b8346-0388-4ce6-94b5-9190154854ef None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:22.197170 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f58f2e-c6ad-4db8-b474-819bbd052d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:22.197396 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcb294-cba6-41fb-bfe1-b54df60c4ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:22.197873 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcb294-cba6-41fb-bfe1-b54df60c4ee4 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:22.198153 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcb294-cba6-41fb-bfe1-b54df60c4ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:22.198468 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcb294-cba6-41fb-bfe1-b54df60c4ee4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:22.198617 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f58f2e-c6ad-4db8-b474-819bbd052d20 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:22.199019 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f58f2e-c6ad-4db8-b474-819bbd052d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:22.199457 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f58f2e-c6ad-4db8-b474-819bbd052d20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:22.208162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:22.214055 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f58f2e-c6ad-4db8-b474-819bbd052d20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:22.216339 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f58f2e-c6ad-4db8-b474-819bbd052d20 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:22.232055 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-01f58f2e-c6ad-4db8-b474-819bbd052d20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:22.232055 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:22.232055 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:22.232055 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:22.232055 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:22.232055 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:22.232055 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:22.232055 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:22.232055 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:22.232055 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:22.232055 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:22.232055 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:22.232055 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:51:22.232055 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:51:22.232055 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:51:22.233173 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:51:22.233173 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:22.233173 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:22.233173 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:22.233173 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:22.233173 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:22.233173 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:22.233173 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:22.233173 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:22.233173 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:22.233173 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:22.233173 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:22.233173 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:22.233173 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:22.233173 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:22.233173 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:22.233173 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:22.234252 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:51:22.234252 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:51:22.234252 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:51:22.234252 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:51:22.234252 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:51:22.234252 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:51:22.234252 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:22.234252 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:22.236939 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 434/862] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:51:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:22.243078 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f58f2e-c6ad-4db8-b474-819bbd052d20 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:22.286830 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfcb294-cba6-41fb-bfe1-b54df60c4ee4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:22.288843 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfcb294-cba6-41fb-bfe1-b54df60c4ee4 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:22.376458 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f58f2e-c6ad-4db8-b474-819bbd052d20 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:22.409397 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 429/863] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:51:21 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:51:22.410631 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcb294-cba6-41fb-bfe1-b54df60c4ee4 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:22.421132 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b3920b-43ef-48b6-a49e-44e6d76c7ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:22.421746 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3920b-43ef-48b6-a49e-44e6d76c7ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:22.422022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3920b-43ef-48b6-a49e-44e6d76c7ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:22.422299 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3920b-43ef-48b6-a49e-44e6d76c7ca3 None admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:22.423021 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b3920b-43ef-48b6-a49e-44e6d76c7ca3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:22.423814 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b3920b-43ef-48b6-a49e-44e6d76c7ca3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:22.425681 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b3920b-43ef-48b6-a49e-44e6d76c7ca3 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:22.438876 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:22.449072 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 435/864] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:51:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:22.451369 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b3920b-43ef-48b6-a49e-44e6d76c7ca3 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:22.462122 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:22.531782 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcb294-cba6-41fb-bfe1-b54df60c4ee4 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:22.568999 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac7058-7b8e-470a-9be3-7da34392ed0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:22.569642 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac7058-7b8e-470a-9be3-7da34392ed0e None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:22.570176 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac7058-7b8e-470a-9be3-7da34392ed0e None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:22.570441 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac7058-7b8e-470a-9be3-7da34392ed0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:22.578045 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b3920b-43ef-48b6-a49e-44e6d76c7ca3 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:22.581685 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac7058-7b8e-470a-9be3-7da34392ed0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:22.583165 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac7058-7b8e-470a-9be3-7da34392ed0e None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:22.600881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-26ac7058-7b8e-470a-9be3-7da34392ed0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:22.600881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:22.600881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:22.600881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:22.600881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:22.600881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:22.600881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:22.600881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:22.600881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:22.600881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:22.600881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:22.600881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:22.600881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:22.600881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:22.600881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:22.600881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:22.602027 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:22.602027 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:22.602027 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:22.602027 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:22.602027 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:22.602027 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:22.602027 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:22.602027 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:22.602027 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:22.602027 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:22.602027 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:22.602027 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:22.602027 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:22.602027 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:22.602027 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:22.602027 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:22.602027 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:22.602932 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:22.602932 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:22.602932 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:22.606563 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 430/865] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:22.607902 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac7058-7b8e-470a-9be3-7da34392ed0e None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:22.621542 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6badcae5-a297-4846-99e7-d7a9f88a096b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:22.622604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badcae5-a297-4846-99e7-d7a9f88a096b None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:22.623086 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badcae5-a297-4846-99e7-d7a9f88a096b None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:22.623610 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6badcae5-a297-4846-99e7-d7a9f88a096b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:22.624728 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badcae5-a297-4846-99e7-d7a9f88a096b None admin] RBAC: Adding query filter params (role.id=99f0ace9fc4d4d028ca52fa9730cab4b, scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642, user.id=c067bc2d84b741d08ac47e40adae4b4f) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:22.625349 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badcae5-a297-4846-99e7-d7a9f88a096b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:22.626992 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6badcae5-a297-4846-99e7-d7a9f88a096b None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:22.643428 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 436/866] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:51:22 2022] GET /identity/v3/role_assignments?user.id=c067bc2d84b741d08ac47e40adae4b4f&scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642&role.id=99f0ace9fc4d4d028ca52fa9730cab4b => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:22.669896 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ddb0a-c251-428d-befb-793e918f2e4f None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:22.670113 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ddb0a-c251-428d-befb-793e918f2e4f None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:22.670367 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ddb0a-c251-428d-befb-793e918f2e4f None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:22.672111 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 437/867] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:51:22.677821 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220a23a-fef3-4c56-a402-5fc271a9bcb5 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:22.678735 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220a23a-fef3-4c56-a402-5fc271a9bcb5 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:22.679020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220a23a-fef3-4c56-a402-5fc271a9bcb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:22.699146 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-5220a23a-fef3-4c56-a402-5fc271a9bcb5 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:22.700446 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-5220a23a-fef3-4c56-a402-5fc271a9bcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:22.715064 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:22.726455 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac7058-7b8e-470a-9be3-7da34392ed0e None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:22.776493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b977d9-2276-4e8f-b872-1b570ce3154a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:22.777390 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b977d9-2276-4e8f-b872-1b570ce3154a None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:22.777823 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b977d9-2276-4e8f-b872-1b570ce3154a None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:22.778252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b977d9-2276-4e8f-b872-1b570ce3154a None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:22.779775 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b977d9-2276-4e8f-b872-1b570ce3154a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:22.780082 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b977d9-2276-4e8f-b872-1b570ce3154a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:22.781485 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b977d9-2276-4e8f-b872-1b570ce3154a None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:22.792683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:22.797477 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 431/868] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:22.803720 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 438/869] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:22 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:51:22.803899 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b977d9-2276-4e8f-b872-1b570ce3154a None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:22.917185 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b977d9-2276-4e8f-b872-1b570ce3154a None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:22.954902 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfbda9-4b55-4a89-82d0-ae4ba493a9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:22.955590 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfbda9-4b55-4a89-82d0-ae4ba493a9af None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:22.955974 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfbda9-4b55-4a89-82d0-ae4ba493a9af None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:22.956313 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dfbda9-4b55-4a89-82d0-ae4ba493a9af None admin] PATH_INFO: `/v3/projects/service` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:22.964305 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfbda9-4b55-4a89-82d0-ae4ba493a9af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:22.965860 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dfbda9-4b55-4a89-82d0-ae4ba493a9af None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:22.978173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-a1dfbda9-4b55-4a89-82d0-ae4ba493a9af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:22.978173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:22.978173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:22.978173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:22.978173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:22.978173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:22.978173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:22.978173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:22.978173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:22.978173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:22.978173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:22.978173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:22.978173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:51:22.978173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:51:22.978173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:51:22.979319 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:51:22.979319 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:22.979319 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:22.979319 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:22.979319 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:22.979319 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:22.979319 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:22.979319 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:22.979319 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:22.979319 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:22.979319 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:22.979319 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:22.979319 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:22.979319 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:22.979319 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:22.979319 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:22.979319 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:22.980426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:51:22.980426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:51:22.980426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:51:22.980426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:51:22.980426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:51:22.980426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:51:22.980426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:22.980426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:22.981704 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 432/870] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:51:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:22.987351 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220a23a-fef3-4c56-a402-5fc271a9bcb5 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:23.082876 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfbda9-4b55-4a89-82d0-ae4ba493a9af None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:23.103290 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220a23a-fef3-4c56-a402-5fc271a9bcb5 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:23.107483 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:23.153237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e17342-0bdf-4319-b7b2-0796edae282e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:23.154129 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e17342-0bdf-4319-b7b2-0796edae282e None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:23.154481 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e17342-0bdf-4319-b7b2-0796edae282e None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:23.155394 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e17342-0bdf-4319-b7b2-0796edae282e None admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:23.156154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e17342-0bdf-4319-b7b2-0796edae282e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:23.156460 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e17342-0bdf-4319-b7b2-0796edae282e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:23.157898 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e17342-0bdf-4319-b7b2-0796edae282e None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:23.171145 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 439/871] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:51:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:23.176999 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e17342-0bdf-4319-b7b2-0796edae282e None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:23.205351 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dfbda9-4b55-4a89-82d0-ae4ba493a9af None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:23.251296 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a1461-a045-453e-8064-120d85151b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:23.252164 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a1461-a045-453e-8064-120d85151b0b None admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:23.252621 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a1461-a045-453e-8064-120d85151b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:23.253041 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a1461-a045-453e-8064-120d85151b0b None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:23.254342 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a1461-a045-453e-8064-120d85151b0b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:23.256827 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a1461-a045-453e-8064-120d85151b0b None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:23.257115 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:23.305080 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e17342-0bdf-4319-b7b2-0796edae282e None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:23.341646 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea44deaf-43ea-4645-b66e-df1ddfec2324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:23.342312 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44deaf-43ea-4645-b66e-df1ddfec2324 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:23.342688 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44deaf-43ea-4645-b66e-df1ddfec2324 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:23.343068 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea44deaf-43ea-4645-b66e-df1ddfec2324 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:23.343986 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44deaf-43ea-4645-b66e-df1ddfec2324 None admin] RBAC: Adding query filter params (role.id=494c75ed8f864e3b955fdb043e96c675, scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642, user.id=ae9fc5f06a0441da80e656fa1e88db5d) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:23.344377 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44deaf-43ea-4645-b66e-df1ddfec2324 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:23.345928 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea44deaf-43ea-4645-b66e-df1ddfec2324 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:23.348760 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 433/872] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Aug 24 16:51:23 2022] POST /identity/v3/services => generated 251 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:51:23.359151 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 440/873] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:51:23 2022] GET /identity/v3/role_assignments?user.id=ae9fc5f06a0441da80e656fa1e88db5d&scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642&role.id=494c75ed8f864e3b955fdb043e96c675 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:24.005050 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb96a29-b20f-4c4e-bb13-4fb1c7be0b8a None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:24.005421 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb96a29-b20f-4c4e-bb13-4fb1c7be0b8a None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:24.005616 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb96a29-b20f-4c4e-bb13-4fb1c7be0b8a None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:24.007319 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 434/874] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:24.012665 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5b7c7-fb72-44c3-85fd-0a137aa81f57 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:24.013150 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5b7c7-fb72-44c3-85fd-0a137aa81f57 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:24.013231 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe5b7c7-fb72-44c3-85fd-0a137aa81f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:24.032237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-cfe5b7c7-fb72-44c3-85fd-0a137aa81f57 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:24.033427 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-cfe5b7c7-fb72-44c3-85fd-0a137aa81f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:24.111322 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 441/875] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:24 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:51:24.380169 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb96a29-b20f-4c4e-bb13-4fb1c7be0b8a None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:24.459460 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:24.497064 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb96a29-b20f-4c4e-bb13-4fb1c7be0b8a None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:24.533353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db35109-00ed-471e-84ac-28d31bba0896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:24.533977 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db35109-00ed-471e-84ac-28d31bba0896 None admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:24.534256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db35109-00ed-471e-84ac-28d31bba0896 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:24.534528 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db35109-00ed-471e-84ac-28d31bba0896 None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:24.535227 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db35109-00ed-471e-84ac-28d31bba0896 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:24.536606 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db35109-00ed-471e-84ac-28d31bba0896 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:24.622612 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 435/876] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Aug 24 16:51:24 2022] POST /identity/v3/services => generated 269 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:51:24.659635 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b2492-90fd-4695-8ba6-e9b10576a2e2 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:24.659831 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b2492-90fd-4695-8ba6-e9b10576a2e2 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:24.660099 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b2492-90fd-4695-8ba6-e9b10576a2e2 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:24.663690 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 442/877] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:24.669546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de3e97-1f0a-48bb-bf83-7bc4bf69dc90 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:24.669876 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de3e97-1f0a-48bb-bf83-7bc4bf69dc90 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:24.670105 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de3e97-1f0a-48bb-bf83-7bc4bf69dc90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:24.691397 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-15de3e97-1f0a-48bb-bf83-7bc4bf69dc90 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:24.692649 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-15de3e97-1f0a-48bb-bf83-7bc4bf69dc90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:24.781447 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 436/878] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:24 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:51:25.057979 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b2492-90fd-4695-8ba6-e9b10576a2e2 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:25.110878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:25.175041 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b2492-90fd-4695-8ba6-e9b10576a2e2 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:25.213926 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fca7ad-007f-4d59-8809-c6930772e880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:25.214837 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fca7ad-007f-4d59-8809-c6930772e880 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:25.215304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fca7ad-007f-4d59-8809-c6930772e880 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:25.215721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fca7ad-007f-4d59-8809-c6930772e880 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:25.216489 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fca7ad-007f-4d59-8809-c6930772e880 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:25.218005 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fca7ad-007f-4d59-8809-c6930772e880 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:25.228122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-27fca7ad-007f-4d59-8809-c6930772e880 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:51:25.228122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:25.228122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:51:25.228122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:51:25.228122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:51:25.228122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:51:25.228122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:51:25.228122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:25.228122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:51:25.228122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:25.228122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:51:25.228122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:25.228122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:25.228122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:25.228122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:25.228122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:25.228122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:25.229357 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:25.229357 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:25.229357 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:25.229357 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:25.229357 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:25.229357 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:25.229357 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:51:25.229357 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:51:25.229357 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:51:25.229357 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:51:25.229357 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:25.229357 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:25.229357 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:25.229357 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:25.229357 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:25.229357 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:25.230410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:25.230410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:25.230410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:25.230410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:25.230410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:25.230410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:25.230410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:25.230410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:25.230410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:25.230410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:25.230410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:51:25.230410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:25.230410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:51:25.230410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:25.232808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 443/879] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Aug 24 16:51:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:25.241534 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de3e97-1f0a-48bb-bf83-7bc4bf69dc90 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:25.304652 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:25.343305 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286d6de-f5d9-42d9-9ee4-870cd96fcf2a None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:25.343479 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286d6de-f5d9-42d9-9ee4-870cd96fcf2a None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:25.343774 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286d6de-f5d9-42d9-9ee4-870cd96fcf2a None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:25.345356 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 444/880] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:25.352351 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29d951-733b-4e5b-9224-c94be23a07f5 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:25.352941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29d951-733b-4e5b-9224-c94be23a07f5 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:25.353419 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29d951-733b-4e5b-9224-c94be23a07f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:25.354931 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de3e97-1f0a-48bb-bf83-7bc4bf69dc90 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:25.373554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-cd29d951-733b-4e5b-9224-c94be23a07f5 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:25.375171 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-cd29d951-733b-4e5b-9224-c94be23a07f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:25.392638 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f318eb42-1344-4ebe-a316-f9b6fb1e8da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:25.393310 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f318eb42-1344-4ebe-a316-f9b6fb1e8da5 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:25.393508 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f318eb42-1344-4ebe-a316-f9b6fb1e8da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:25.393773 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f318eb42-1344-4ebe-a316-f9b6fb1e8da5 None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:25.394424 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f318eb42-1344-4ebe-a316-f9b6fb1e8da5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:25.394736 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f318eb42-1344-4ebe-a316-f9b6fb1e8da5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:25.396136 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f318eb42-1344-4ebe-a316-f9b6fb1e8da5 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:25.406331 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 437/881] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Aug 24 16:51:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:25.407588 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f318eb42-1344-4ebe-a316-f9b6fb1e8da5 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:25.463518 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 445/882] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:51:25.511509 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f318eb42-1344-4ebe-a316-f9b6fb1e8da5 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:25.512076 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588f551-e262-42f8-ae68-d7a5a4f2a2b0 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:25.512567 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588f551-e262-42f8-ae68-d7a5a4f2a2b0 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:25.513186 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588f551-e262-42f8-ae68-d7a5a4f2a2b0 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:25.515280 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 446/883] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:51:25.520508 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfd905-c4c0-4582-ad21-bea68849ae7f None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:25.521105 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfd905-c4c0-4582-ad21-bea68849ae7f None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:25.522126 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfd905-c4c0-4582-ad21-bea68849ae7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:25.533885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:25.544584 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-a3dfd905-c4c0-4582-ad21-bea68849ae7f None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:25.546373 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-a3dfd905-c4c0-4582-ad21-bea68849ae7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:25.548615 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc12f2-5b50-4587-845c-3b2e717099e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:25.549215 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc12f2-5b50-4587-845c-3b2e717099e9 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:25.549492 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc12f2-5b50-4587-845c-3b2e717099e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:25.549756 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffc12f2-5b50-4587-845c-3b2e717099e9 None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:25.550434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc12f2-5b50-4587-845c-3b2e717099e9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:25.550734 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc12f2-5b50-4587-845c-3b2e717099e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:25.552188 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffc12f2-5b50-4587-845c-3b2e717099e9 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:25.562578 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 438/884] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Aug 24 16:51:25 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:25.587515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:25.632696 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 447/885] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:51:25.753691 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc12f2-5b50-4587-845c-3b2e717099e9 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:25.876926 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffc12f2-5b50-4587-845c-3b2e717099e9 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:25.906135 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfd905-c4c0-4582-ad21-bea68849ae7f None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:25.920248 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0eb64-bf08-45d1-abcb-d43fcd1e137c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:25.921943 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0eb64-bf08-45d1-abcb-d43fcd1e137c None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:25.922459 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0eb64-bf08-45d1-abcb-d43fcd1e137c None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:25.922931 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0eb64-bf08-45d1-abcb-d43fcd1e137c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:25.924004 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0eb64-bf08-45d1-abcb-d43fcd1e137c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:25.926287 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0eb64-bf08-45d1-abcb-d43fcd1e137c None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:25.940073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-11c0eb64-bf08-45d1-abcb-d43fcd1e137c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 16:51:25.940073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:25.940073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:51:25.940073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:51:25.940073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:51:25.940073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:51:25.940073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:51:25.940073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:25.940073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 16:51:25.940073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:25.940073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:51:25.940073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:25.940073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:25.940073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:25.940073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:25.940073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:25.940073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:25.941126 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:25.941126 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:25.941126 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:25.941126 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:25.941126 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:25.941126 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:25.941126 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:51:25.941126 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:51:25.941126 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:51:25.941126 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:51:25.941126 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:25.941126 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:25.941126 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:25.941126 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:25.941126 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:25.941126 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:25.941987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:25.941987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:25.941987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:25.941987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:25.941987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:25.941987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:25.941987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:25.941987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:25.941987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:25.941987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:25.941987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:51:25.941987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:25.941987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 16:51:25.941987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:25.944755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 439/886] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Aug 24 16:51:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:25.951228 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0eb64-bf08-45d1-abcb-d43fcd1e137c None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:26.007492 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:26.029291 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfd905-c4c0-4582-ad21-bea68849ae7f None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:26.067292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee6f92-c96e-4aa2-a84d-0e6ddfe0def2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:26.067928 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee6f92-c96e-4aa2-a84d-0e6ddfe0def2 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:26.068262 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee6f92-c96e-4aa2-a84d-0e6ddfe0def2 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:26.068657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee6f92-c96e-4aa2-a84d-0e6ddfe0def2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:26.071063 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0eb64-bf08-45d1-abcb-d43fcd1e137c None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:26.080037 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee6f92-c96e-4aa2-a84d-0e6ddfe0def2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:51:26.084941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-30ee6f92-c96e-4aa2-a84d-0e6ddfe0def2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:51:26.084941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:26.084941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:26.084941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:26.084941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:26.084941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:26.084941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:26.084941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:26.084941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:26.084941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:26.084941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:26.084941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:26.084941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:51:26.084941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:51:26.084941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:51:26.084941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:51:26.086858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:51:26.086858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:51:26.086858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:51:26.086858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:51:26.086858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:26.086858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:26.086858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:26.086858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:26.086858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:26.086858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:26.086858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:26.086858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:26.086858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:26.086858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:26.086858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:26.086858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:26.089080 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:26.089080 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:26.089080 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:26.089080 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:26.089080 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:51:26.089080 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:51:26.089080 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:51:26.089080 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:51:26.089080 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:51:26.089080 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:51:26.089080 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:51:26.089080 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:26.089080 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 448/887] 10.222.0.55 () {56 vars in 1120 bytes} [Wed Aug 24 16:51:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:26.092321 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee6f92-c96e-4aa2-a84d-0e6ddfe0def2 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:26.118965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079cffc-9673-4430-bcb9-f5839071fd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:26.119637 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079cffc-9673-4430-bcb9-f5839071fd99 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:26.120058 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079cffc-9673-4430-bcb9-f5839071fd99 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:26.120343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079cffc-9673-4430-bcb9-f5839071fd99 None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:26.120978 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079cffc-9673-4430-bcb9-f5839071fd99 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:26.121285 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079cffc-9673-4430-bcb9-f5839071fd99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:26.123029 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079cffc-9673-4430-bcb9-f5839071fd99 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:26.134741 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 440/888] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Aug 24 16:51:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:26.136100 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079cffc-9673-4430-bcb9-f5839071fd99 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:26.138263 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:26.220324 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee6f92-c96e-4aa2-a84d-0e6ddfe0def2 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:26.259714 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d682fa3-6f4d-4480-9cef-1e00e978ad6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:26.260329 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d682fa3-6f4d-4480-9cef-1e00e978ad6c None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:26.260613 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d682fa3-6f4d-4480-9cef-1e00e978ad6c None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:26.260889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d682fa3-6f4d-4480-9cef-1e00e978ad6c None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:26.261581 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d682fa3-6f4d-4480-9cef-1e00e978ad6c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:26.261890 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d682fa3-6f4d-4480-9cef-1e00e978ad6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:26.263143 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079cffc-9673-4430-bcb9-f5839071fd99 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:26.263335 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d682fa3-6f4d-4480-9cef-1e00e978ad6c None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:26.273845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 449/889] 10.222.0.55 () {56 vars in 1115 bytes} [Wed Aug 24 16:51:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:26.279091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d682fa3-6f4d-4480-9cef-1e00e978ad6c None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:26.281305 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:26.307620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50b56d-2fc6-44b3-8c89-53172388d25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:26.308594 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50b56d-2fc6-44b3-8c89-53172388d25d None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:26.309110 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50b56d-2fc6-44b3-8c89-53172388d25d None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:26.309581 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50b56d-2fc6-44b3-8c89-53172388d25d None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:26.311921 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a50b56d-2fc6-44b3-8c89-53172388d25d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:26.312444 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a50b56d-2fc6-44b3-8c89-53172388d25d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:26.314284 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a50b56d-2fc6-44b3-8c89-53172388d25d None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:26.325664 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 441/890] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Aug 24 16:51:26 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:26.327056 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50b56d-2fc6-44b3-8c89-53172388d25d None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:26.380175 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:26.390707 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d682fa3-6f4d-4480-9cef-1e00e978ad6c None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:26.427356 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13fb4e-8433-4ccf-b318-e4af43ee1652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:26.428959 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13fb4e-8433-4ccf-b318-e4af43ee1652 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:26.428959 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13fb4e-8433-4ccf-b318-e4af43ee1652 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:26.429264 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a13fb4e-8433-4ccf-b318-e4af43ee1652 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:26.440480 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13fb4e-8433-4ccf-b318-e4af43ee1652 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:26.441939 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a13fb4e-8433-4ccf-b318-e4af43ee1652 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:26.451465 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50b56d-2fc6-44b3-8c89-53172388d25d None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:26.458358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-4a13fb4e-8433-4ccf-b318-e4af43ee1652 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:26.458358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:26.458358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:26.458358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:26.458358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:26.458358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:26.458358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:26.458358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:26.458358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:26.458358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:26.458358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:26.458358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:26.458358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:26.458358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:26.458358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:26.458358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:26.459862 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:26.459862 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:26.459862 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:26.459862 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:26.459862 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:26.459862 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:26.459862 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:26.459862 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:26.459862 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:26.459862 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:26.459862 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:26.459862 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:26.459862 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:26.459862 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:26.459862 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:26.459862 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:26.459862 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:26.460965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:26.460965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:26.460965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:26.460965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 450/891] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:51:26.465310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13fb4e-8433-4ccf-b318-e4af43ee1652 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:26.499734 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129f7ed-803d-4050-931c-6206d0f1c1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:26.500702 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129f7ed-803d-4050-931c-6206d0f1c1a2 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:26.501179 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129f7ed-803d-4050-931c-6206d0f1c1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:26.501643 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129f7ed-803d-4050-931c-6206d0f1c1a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:26.502551 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129f7ed-803d-4050-931c-6206d0f1c1a2 None admin] RBAC: Adding query filter params (interface=public, service_id=ca3d052a453e4eb092acba7ccb843f27, region_id=RegionOne) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:26.503146 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129f7ed-803d-4050-931c-6206d0f1c1a2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:26.505273 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129f7ed-803d-4050-931c-6206d0f1c1a2 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:26.517924 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 442/892] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Aug 24 16:51:26 2022] GET /identity/v3/endpoints?service_id=ca3d052a453e4eb092acba7ccb843f27&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:26.519404 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129f7ed-803d-4050-931c-6206d0f1c1a2 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:26.565516 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:26.583009 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a13fb4e-8433-4ccf-b318-e4af43ee1652 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:26.623844 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc11e98-df73-4a76-ad7e-fed3d775fd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:26.624204 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc11e98-df73-4a76-ad7e-fed3d775fd20 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:26.624508 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc11e98-df73-4a76-ad7e-fed3d775fd20 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:26.624792 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc11e98-df73-4a76-ad7e-fed3d775fd20 None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:26.625473 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc11e98-df73-4a76-ad7e-fed3d775fd20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:26.625764 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc11e98-df73-4a76-ad7e-fed3d775fd20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:26.627181 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc11e98-df73-4a76-ad7e-fed3d775fd20 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:26.636150 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129f7ed-803d-4050-931c-6206d0f1c1a2 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:26.641762 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 451/893] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:26.647505 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc11e98-df73-4a76-ad7e-fed3d775fd20 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:26.664718 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:26.676492 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9de2fc-69bc-4f9f-842f-029227a163e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:26.677101 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9de2fc-69bc-4f9f-842f-029227a163e7 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:26.677381 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9de2fc-69bc-4f9f-842f-029227a163e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:26.678539 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9de2fc-69bc-4f9f-842f-029227a163e7 None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:26.678916 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9de2fc-69bc-4f9f-842f-029227a163e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:26.680357 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9de2fc-69bc-4f9f-842f-029227a163e7 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:26.687401 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 443/894] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Aug 24 16:51:26 2022] GET /identity/v3/services => generated 1268 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:51:26.688796 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe22f36-924b-4b66-a93c-e7132dcfb206 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:26.689085 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe22f36-924b-4b66-a93c-e7132dcfb206 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:26.689362 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe22f36-924b-4b66-a93c-e7132dcfb206 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:26.695879 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 444/895] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:26.698003 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c44aca-b1f6-49ec-8398-d59e7e88fa3d None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:26.698287 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c44aca-b1f6-49ec-8398-d59e7e88fa3d None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:26.698559 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c44aca-b1f6-49ec-8398-d59e7e88fa3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:26.719890 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-b4c44aca-b1f6-49ec-8398-d59e7e88fa3d None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:26.721247 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-b4c44aca-b1f6-49ec-8398-d59e7e88fa3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:26.795245 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc11e98-df73-4a76-ad7e-fed3d775fd20 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:26.818712 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 445/896] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:26 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:51:26.842423 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63442825-bb36-480d-930f-4cbb0d926ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:26.843081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63442825-bb36-480d-930f-4cbb0d926ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:26.843451 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63442825-bb36-480d-930f-4cbb0d926ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:26.843663 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63442825-bb36-480d-930f-4cbb0d926ed4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:26.853173 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63442825-bb36-480d-930f-4cbb0d926ed4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:26.854644 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63442825-bb36-480d-930f-4cbb0d926ed4 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:26.868148 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-63442825-bb36-480d-930f-4cbb0d926ed4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:51:26.868148 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:26.868148 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:26.868148 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:26.868148 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:26.868148 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:26.868148 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:26.868148 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:26.868148 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:26.868148 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:26.868148 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:26.868148 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:26.868148 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:51:26.868148 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:51:26.868148 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:51:26.868148 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:51:26.869240 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:26.869240 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:26.869240 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:51:26.869240 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:26.869240 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:51:26.869240 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:26.869240 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:26.869240 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:26.869240 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:26.869240 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:26.869240 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:26.869240 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:26.869240 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:26.869240 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:26.869240 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:26.869240 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:26.869240 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:26.869240 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:26.870251 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:26.870251 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:26.870251 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:51:26.870251 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:51:26.870251 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:51:26.870251 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:51:26.870251 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:51:26.870251 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:51:26.870251 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:51:26.870251 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:26.870251 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 452/897] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Aug 24 16:51:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:26.876367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c44aca-b1f6-49ec-8398-d59e7e88fa3d None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:26.915397 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:26.989758 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c44aca-b1f6-49ec-8398-d59e7e88fa3d None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:27.030594 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0a089-5cc6-45fb-b4c1-3880e92038e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:27.031598 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0a089-5cc6-45fb-b4c1-3880e92038e9 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:27.032076 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0a089-5cc6-45fb-b4c1-3880e92038e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:27.032535 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0a089-5cc6-45fb-b4c1-3880e92038e9 None admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:27.033460 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0a089-5cc6-45fb-b4c1-3880e92038e9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:27.033955 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0a089-5cc6-45fb-b4c1-3880e92038e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:27.035622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0a089-5cc6-45fb-b4c1-3880e92038e9 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:27.056472 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 446/898] 10.222.0.55 () {56 vars in 1149 bytes} [Wed Aug 24 16:51:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:27.062719 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63442825-bb36-480d-930f-4cbb0d926ed4 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:27.119610 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0a089-5cc6-45fb-b4c1-3880e92038e9 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:27.140118 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:27.187717 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63442825-bb36-480d-930f-4cbb0d926ed4 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:27.227921 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6988682-e002-4c6d-a4a0-26ffa610c7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:27.228551 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6988682-e002-4c6d-a4a0-26ffa610c7f5 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:27.228826 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6988682-e002-4c6d-a4a0-26ffa610c7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:27.229098 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6988682-e002-4c6d-a4a0-26ffa610c7f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:27.255583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:27.266624 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0a089-5cc6-45fb-b4c1-3880e92038e9 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:27.321156 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67e3f8-b9b5-4407-b66a-93f1dd5d24f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:27.322515 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67e3f8-b9b5-4407-b66a-93f1dd5d24f1 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:27.323058 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67e3f8-b9b5-4407-b66a-93f1dd5d24f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:27.324278 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67e3f8-b9b5-4407-b66a-93f1dd5d24f1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:27.325376 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67e3f8-b9b5-4407-b66a-93f1dd5d24f1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:27.325997 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6988682-e002-4c6d-a4a0-26ffa610c7f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:27.327267 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67e3f8-b9b5-4407-b66a-93f1dd5d24f1 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:27.327637 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6988682-e002-4c6d-a4a0-26ffa610c7f5 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:27.342609 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-4d67e3f8-b9b5-4407-b66a-93f1dd5d24f1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 16:51:27.342609 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:27.342609 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:51:27.342609 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:51:27.342609 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:51:27.342609 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:51:27.342609 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:51:27.342609 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:27.342609 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 16:51:27.342609 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:27.342609 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:51:27.342609 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:27.342609 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:27.342609 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:27.342609 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:27.342609 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:27.343755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:27.343755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:27.343755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:27.343755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:27.343755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:27.343755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:27.343755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:27.343755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:51:27.343755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:51:27.343755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:51:27.343755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:51:27.343755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:27.343755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:27.343755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:27.343755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:27.343755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:27.343755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:27.344696 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:27.344696 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:27.344696 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:27.344696 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:27.344696 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:27.344696 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:27.344696 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:27.344696 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:27.344696 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:27.344696 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:27.344696 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:51:27.344696 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:27.344696 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 16:51:27.344696 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:27.346291 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 447/899] 10.222.0.55 () {56 vars in 1132 bytes} [Wed Aug 24 16:51:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:51:27.351430 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67e3f8-b9b5-4407-b66a-93f1dd5d24f1 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:27.406163 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:27.455520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 453/900] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:51:27 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:51:27.457085 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6988682-e002-4c6d-a4a0-26ffa610c7f5 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:27.491676 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67e3f8-b9b5-4407-b66a-93f1dd5d24f1 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:27.535830 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8394cb-130e-4c56-8f09-2a403e2436b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:27.536642 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8394cb-130e-4c56-8f09-2a403e2436b8 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:27.537053 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8394cb-130e-4c56-8f09-2a403e2436b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:27.537705 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8394cb-130e-4c56-8f09-2a403e2436b8 None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:27.538965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8394cb-130e-4c56-8f09-2a403e2436b8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:27.538965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8394cb-130e-4c56-8f09-2a403e2436b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:27.540639 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8394cb-130e-4c56-8f09-2a403e2436b8 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:27.550886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 448/901] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Aug 24 16:51:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:27.552266 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8394cb-130e-4c56-8f09-2a403e2436b8 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:27.575977 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6988682-e002-4c6d-a4a0-26ffa610c7f5 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:27.580151 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:27.613277 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb0f12-8502-4bae-a096-b1c7c75967d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:27.613915 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb0f12-8502-4bae-a096-b1c7c75967d0 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:27.614204 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb0f12-8502-4bae-a096-b1c7c75967d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:27.614512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb0f12-8502-4bae-a096-b1c7c75967d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:27.625304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb0f12-8502-4bae-a096-b1c7c75967d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:27.626795 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb0f12-8502-4bae-a096-b1c7c75967d0 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:27.643801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-47fb0f12-8502-4bae-a096-b1c7c75967d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:27.643801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:27.643801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:27.643801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:27.643801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:27.643801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:27.643801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:27.643801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:27.643801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:27.643801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:27.643801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:27.643801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:27.643801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:27.643801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:27.643801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:27.643801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:27.644821 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:27.644821 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:27.644821 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:27.644821 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:27.644821 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:27.644821 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:27.644821 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:27.644821 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:27.644821 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:27.644821 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:27.644821 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:27.644821 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:27.644821 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:27.644821 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:27.644821 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:27.644821 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:27.644821 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:27.645728 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:27.645728 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:27.645728 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:27.645728 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 454/902] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:27.647403 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cb2d6-7bc2-4bf7-8f67-f418fef4a853 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:27.647403 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cb2d6-7bc2-4bf7-8f67-f418fef4a853 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:27.647403 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283cb2d6-7bc2-4bf7-8f67-f418fef4a853 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:27.651381 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 455/903] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:27.653093 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283cb2d6-7bc2-4bf7-8f67-f418fef4a853 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:27.670494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:27.676489 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8394cb-130e-4c56-8f09-2a403e2436b8 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:27.717277 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286f65f-f9f9-48ad-b6fe-e5eede2d1ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:27.718015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286f65f-f9f9-48ad-b6fe-e5eede2d1ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:27.718294 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286f65f-f9f9-48ad-b6fe-e5eede2d1ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:27.718577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286f65f-f9f9-48ad-b6fe-e5eede2d1ab6 None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:27.719250 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286f65f-f9f9-48ad-b6fe-e5eede2d1ab6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:27.719556 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286f65f-f9f9-48ad-b6fe-e5eede2d1ab6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:27.721082 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286f65f-f9f9-48ad-b6fe-e5eede2d1ab6 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:27.731733 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 449/904] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Aug 24 16:51:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:27.731733 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98af5c-7a05-42e6-9528-43959064e952 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:27.731733 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98af5c-7a05-42e6-9528-43959064e952 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:27.731733 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98af5c-7a05-42e6-9528-43959064e952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:27.749077 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-1f98af5c-7a05-42e6-9528-43959064e952 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:27.750424 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-1f98af5c-7a05-42e6-9528-43959064e952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:27.780390 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283cb2d6-7bc2-4bf7-8f67-f418fef4a853 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:27.819931 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9aeed8-8df9-4f26-8770-e921c686d28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:27.820658 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9aeed8-8df9-4f26-8770-e921c686d28d None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:27.820901 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9aeed8-8df9-4f26-8770-e921c686d28d None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:27.821200 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9aeed8-8df9-4f26-8770-e921c686d28d None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:27.821973 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9aeed8-8df9-4f26-8770-e921c686d28d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:27.822301 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9aeed8-8df9-4f26-8770-e921c686d28d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:27.823752 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9aeed8-8df9-4f26-8770-e921c686d28d None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:27.832757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 450/905] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:27 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:51:27.832757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98af5c-7a05-42e6-9528-43959064e952 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:27.840937 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 456/906] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:27.846330 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9aeed8-8df9-4f26-8770-e921c686d28d None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:27.854012 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:27.942636 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:27.975403 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98af5c-7a05-42e6-9528-43959064e952 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:27.978668 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9aeed8-8df9-4f26-8770-e921c686d28d None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:28.012100 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942371a0-ef36-4834-ab28-87055cbac41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:28.012705 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942371a0-ef36-4834-ab28-87055cbac41e None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:28.012971 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942371a0-ef36-4834-ab28-87055cbac41e None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:28.013264 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942371a0-ef36-4834-ab28-87055cbac41e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:28.013985 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942371a0-ef36-4834-ab28-87055cbac41e None admin] RBAC: Adding query filter params (interface=public, service_id=9eeec57edb6e44648978ae17744338b2, region_id=RegionOne) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:28.014287 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942371a0-ef36-4834-ab28-87055cbac41e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:28.015757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942371a0-ef36-4834-ab28-87055cbac41e None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:28.021254 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 451/907] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Aug 24 16:51:27 2022] GET /identity/v3/endpoints?service_id=9eeec57edb6e44648978ae17744338b2&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:28.027066 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942371a0-ef36-4834-ab28-87055cbac41e None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:28.032640 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ba0c7-f7ce-4986-a6b0-4fbf241b68df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:28.033594 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ba0c7-f7ce-4986-a6b0-4fbf241b68df None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:28.034076 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ba0c7-f7ce-4986-a6b0-4fbf241b68df None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:28.034542 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ba0c7-f7ce-4986-a6b0-4fbf241b68df None admin] PATH_INFO: `/v3/projects/service` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:28.043415 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ba0c7-f7ce-4986-a6b0-4fbf241b68df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:28.045214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4ba0c7-f7ce-4986-a6b0-4fbf241b68df None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:28.057650 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-0f4ba0c7-f7ce-4986-a6b0-4fbf241b68df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:28.057650 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:28.057650 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:28.057650 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:28.057650 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:28.057650 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:28.057650 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:28.057650 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:28.057650 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:28.057650 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:28.057650 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:28.057650 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:28.057650 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:51:28.057650 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:51:28.057650 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:51:28.058606 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:51:28.058606 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:28.058606 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:28.058606 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:28.058606 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:28.058606 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:28.058606 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:28.058606 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:28.058606 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:28.058606 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:28.058606 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:28.058606 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:28.058606 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:28.058606 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:28.058606 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:28.058606 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:28.058606 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:28.059564 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:51:28.059564 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:51:28.059564 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:51:28.059564 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:51:28.059564 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:51:28.059564 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:51:28.059564 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:28.059564 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:28.062253 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 457/908] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:51:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:51:28.070924 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ba0c7-f7ce-4986-a6b0-4fbf241b68df None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:28.122389 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:28.141257 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942371a0-ef36-4834-ab28-87055cbac41e None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:28.178563 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634c613-5337-4276-bb73-f17d49f30028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:28.179332 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634c613-5337-4276-bb73-f17d49f30028 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:28.179673 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634c613-5337-4276-bb73-f17d49f30028 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:28.179952 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634c613-5337-4276-bb73-f17d49f30028 None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:28.180564 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634c613-5337-4276-bb73-f17d49f30028 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:28.182005 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a634c613-5337-4276-bb73-f17d49f30028 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:28.187424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ba0c7-f7ce-4986-a6b0-4fbf241b68df None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:28.199206 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 452/909] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Aug 24 16:51:28 2022] GET /identity/v3/services => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:51:28.199206 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634c613-5337-4276-bb73-f17d49f30028 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:28.259640 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6478edd-939d-4e10-8fa4-588d6afb462b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:28.260816 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6478edd-939d-4e10-8fa4-588d6afb462b None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:28.261396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6478edd-939d-4e10-8fa4-588d6afb462b None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:28.262092 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6478edd-939d-4e10-8fa4-588d6afb462b None admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:28.263744 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6478edd-939d-4e10-8fa4-588d6afb462b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:28.264431 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6478edd-939d-4e10-8fa4-588d6afb462b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:28.267459 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6478edd-939d-4e10-8fa4-588d6afb462b None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:28.273748 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:28.300232 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 458/910] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:51:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:28.305817 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6478edd-939d-4e10-8fa4-588d6afb462b None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:28.341863 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634c613-5337-4276-bb73-f17d49f30028 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:28.396760 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6592155-f668-467e-8906-e4babc2f1cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:28.397301 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6592155-f668-467e-8906-e4babc2f1cf7 None admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:28.397582 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6592155-f668-467e-8906-e4babc2f1cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:28.397854 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6592155-f668-467e-8906-e4babc2f1cf7 None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:28.398509 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6592155-f668-467e-8906-e4babc2f1cf7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:28.400055 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6592155-f668-467e-8906-e4babc2f1cf7 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:28.437277 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6478edd-939d-4e10-8fa4-588d6afb462b None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:28.473035 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3409d17-3ebb-4eb4-9c4c-4ceb80f4a911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:28.473652 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3409d17-3ebb-4eb4-9c4c-4ceb80f4a911 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:28.473923 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3409d17-3ebb-4eb4-9c4c-4ceb80f4a911 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:28.474191 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3409d17-3ebb-4eb4-9c4c-4ceb80f4a911 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:28.475553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3409d17-3ebb-4eb4-9c4c-4ceb80f4a911 None admin] RBAC: Adding query filter params (role.id=c25ffa9ed2f3481697f2ff740bc34e8e, scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642, user.id=ae9fc5f06a0441da80e656fa1e88db5d) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:28.475846 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3409d17-3ebb-4eb4-9c4c-4ceb80f4a911 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:28.477273 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3409d17-3ebb-4eb4-9c4c-4ceb80f4a911 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:28.483448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 459/911] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:51:28 2022] GET /identity/v3/role_assignments?user.id=ae9fc5f06a0441da80e656fa1e88db5d&scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642&role.id=c25ffa9ed2f3481697f2ff740bc34e8e => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:28.523384 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 453/912] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Aug 24 16:51:28 2022] POST /identity/v3/services => generated 241 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:51:28.777870 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc38d9e-557e-4926-9ee5-e98f449d6faa None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:28.778152 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc38d9e-557e-4926-9ee5-e98f449d6faa None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:28.778424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc38d9e-557e-4926-9ee5-e98f449d6faa None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:28.780063 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 460/913] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:28.785395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297aa57-637c-42c2-8263-5d316a6fd218 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:28.785678 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297aa57-637c-42c2-8263-5d316a6fd218 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:28.785958 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297aa57-637c-42c2-8263-5d316a6fd218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:28.792740 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:28.805209 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-7297aa57-637c-42c2-8263-5d316a6fd218 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:28.813993 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-7297aa57-637c-42c2-8263-5d316a6fd218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:28.889244 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 454/914] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:51:29.167879 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc38d9e-557e-4926-9ee5-e98f449d6faa None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:29.232235 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:29.277348 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc38d9e-557e-4926-9ee5-e98f449d6faa None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:29.314030 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06bdf2-f26a-49c9-a706-f07b0af5e22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:29.315179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06bdf2-f26a-49c9-a706-f07b0af5e22a None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:29.315719 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06bdf2-f26a-49c9-a706-f07b0af5e22a None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:29.316184 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06bdf2-f26a-49c9-a706-f07b0af5e22a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:29.316950 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06bdf2-f26a-49c9-a706-f07b0af5e22a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:29.318602 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06bdf2-f26a-49c9-a706-f07b0af5e22a None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:29.327974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-ee06bdf2-f26a-49c9-a706-f07b0af5e22a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 16:51:29.327974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:29.327974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:51:29.327974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:51:29.327974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:51:29.327974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:51:29.327974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:51:29.327974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:29.327974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 16:51:29.327974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:29.327974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:51:29.327974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:29.327974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:29.327974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:29.327974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:29.327974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:29.327974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:29.328974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:29.328974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:29.328974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:29.328974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:29.328974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:29.328974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:29.328974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:51:29.328974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:51:29.328974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:51:29.328974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:51:29.328974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:29.328974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:29.328974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:29.328974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:29.328974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:29.328974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:29.329804 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:29.329804 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:29.329804 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:29.329804 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:29.329804 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:29.329804 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:29.329804 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:29.329804 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:29.329804 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:29.329804 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:29.329804 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:51:29.329804 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:29.329804 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 16:51:29.329804 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:29.332676 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 461/915] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Aug 24 16:51:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:29.339018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297aa57-637c-42c2-8263-5d316a6fd218 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:29.446436 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297aa57-637c-42c2-8263-5d316a6fd218 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:29.474071 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:29.482139 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9993b7-efd8-453a-abaf-5587abf26e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:29.482721 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9993b7-efd8-453a-abaf-5587abf26e33 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:29.483053 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9993b7-efd8-453a-abaf-5587abf26e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:29.483353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9993b7-efd8-453a-abaf-5587abf26e33 None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:29.483988 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9993b7-efd8-453a-abaf-5587abf26e33 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:29.484279 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9993b7-efd8-453a-abaf-5587abf26e33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:29.485780 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9993b7-efd8-453a-abaf-5587abf26e33 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:29.492622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 455/916] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Aug 24 16:51:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:29.500191 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06bdf2-f26a-49c9-a706-f07b0af5e22a None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:29.609475 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06bdf2-f26a-49c9-a706-f07b0af5e22a None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:29.635090 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:29.648326 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e8c7a-0aee-4b3e-b338-91a8174c81fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:29.650354 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e8c7a-0aee-4b3e-b338-91a8174c81fe None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:29.650354 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e8c7a-0aee-4b3e-b338-91a8174c81fe None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:29.650354 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e8c7a-0aee-4b3e-b338-91a8174c81fe None admin] PATH_INFO: `/v3/services` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:29.650354 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e8c7a-0aee-4b3e-b338-91a8174c81fe None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:29.650354 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e8c7a-0aee-4b3e-b338-91a8174c81fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:29.652029 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e8c7a-0aee-4b3e-b338-91a8174c81fe None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:29.657876 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 462/917] 10.222.0.55 () {56 vars in 1114 bytes} [Wed Aug 24 16:51:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:29.664329 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9993b7-efd8-453a-abaf-5587abf26e33 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:29.774709 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9993b7-efd8-453a-abaf-5587abf26e33 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:29.811024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb6fc5-5e9f-4759-9fa0-d4528763a448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:29.811654 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb6fc5-5e9f-4759-9fa0-d4528763a448 None admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:29.811927 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb6fc5-5e9f-4759-9fa0-d4528763a448 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:29.812191 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb6fc5-5e9f-4759-9fa0-d4528763a448 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:29.812853 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb6fc5-5e9f-4759-9fa0-d4528763a448 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:29.814204 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb6fc5-5e9f-4759-9fa0-d4528763a448 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:29.881083 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 456/918] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 16:51:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:51:30.327818 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982402d-7140-4df7-a7a3-cc3acbdd5bff None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:30.328369 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982402d-7140-4df7-a7a3-cc3acbdd5bff None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:30.328369 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982402d-7140-4df7-a7a3-cc3acbdd5bff None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:30.330122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 463/919] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:30.336258 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ce6f3-7939-4fc1-97cb-569a7961b8c4 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:30.336536 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ce6f3-7939-4fc1-97cb-569a7961b8c4 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:30.336810 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ce6f3-7939-4fc1-97cb-569a7961b8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:30.356487 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-958ce6f3-7939-4fc1-97cb-569a7961b8c4 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:30.357667 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-958ce6f3-7939-4fc1-97cb-569a7961b8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:30.409546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:30.440483 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 457/920] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:51:30.481821 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c154bb-5ec8-4ab4-aada-efc00578539b None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:30.482109 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c154bb-5ec8-4ab4-aada-efc00578539b None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:30.482674 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c154bb-5ec8-4ab4-aada-efc00578539b None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:30.484338 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 464/921] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:30.500577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb13b3a-a55c-469e-b469-4503527c493a None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:30.500577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb13b3a-a55c-469e-b469-4503527c493a None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:30.500577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb13b3a-a55c-469e-b469-4503527c493a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:30.500842 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843596c-c7fa-4921-bf91-b26754566fc3 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:30.500842 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843596c-c7fa-4921-bf91-b26754566fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:30.500842 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6843596c-c7fa-4921-bf91-b26754566fc3 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:30.500842 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 465/922] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:51:30.503260 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4534eb8-7935-499f-ad48-1471b50f0960 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:30.503546 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4534eb8-7935-499f-ad48-1471b50f0960 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:30.503817 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4534eb8-7935-499f-ad48-1471b50f0960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:30.510481 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-adb13b3a-a55c-469e-b469-4503527c493a None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:30.511710 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-adb13b3a-a55c-469e-b469-4503527c493a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:30.522935 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-a4534eb8-7935-499f-ad48-1471b50f0960 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:30.524418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-a4534eb8-7935-499f-ad48-1471b50f0960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:30.596769 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 466/923] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:51:30.600809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 458/924] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:51:30.742006 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4534eb8-7935-499f-ad48-1471b50f0960 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:30.850324 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4534eb8-7935-499f-ad48-1471b50f0960 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:30.863048 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb13b3a-a55c-469e-b469-4503527c493a None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:30.894559 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1d846-9d3d-442f-9fe0-035d3e12868c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:30.895165 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1d846-9d3d-442f-9fe0-035d3e12868c None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:30.895765 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1d846-9d3d-442f-9fe0-035d3e12868c None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:30.896047 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1d846-9d3d-442f-9fe0-035d3e12868c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:30.897779 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:30.898422 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1d846-9d3d-442f-9fe0-035d3e12868c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:30.900239 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1d846-9d3d-442f-9fe0-035d3e12868c None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:30.910338 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-e6d1d846-9d3d-442f-9fe0-035d3e12868c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 16:51:30.910338 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:30.910338 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:51:30.910338 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:51:30.910338 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:51:30.910338 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:51:30.910338 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:51:30.910338 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:30.910338 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 16:51:30.910338 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:30.910338 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:51:30.910338 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:30.910338 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:30.910338 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:30.910338 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:30.910338 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:30.913147 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:30.913147 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:30.913147 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:30.913147 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:30.913147 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:30.913147 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:30.913147 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:30.913147 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:51:30.913147 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:51:30.913147 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:51:30.913147 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:51:30.913147 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:30.913147 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:30.913147 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:30.913147 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:30.913147 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:30.913147 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:30.914065 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:30.914065 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:30.914065 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:30.914065 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:30.914065 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:30.914065 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:30.914065 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:30.914065 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:30.914065 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:30.914065 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:30.914065 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:51:30.914065 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:30.914065 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 16:51:30.914065 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:30.915651 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 467/925] 10.222.0.55 () {56 vars in 1132 bytes} [Wed Aug 24 16:51:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:30.916512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1d846-9d3d-442f-9fe0-035d3e12868c None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:30.980485 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb13b3a-a55c-469e-b469-4503527c493a None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:30.983472 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:31.018243 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808d52b-3a6c-4881-bdc5-a0e755df5d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:31.018897 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808d52b-3a6c-4881-bdc5-a0e755df5d71 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:31.019204 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808d52b-3a6c-4881-bdc5-a0e755df5d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:31.019480 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808d52b-3a6c-4881-bdc5-a0e755df5d71 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:31.019870 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1d846-9d3d-442f-9fe0-035d3e12868c None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:31.020062 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808d52b-3a6c-4881-bdc5-a0e755df5d71 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:31.022093 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808d52b-3a6c-4881-bdc5-a0e755df5d71 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:31.031473 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-8808d52b-3a6c-4881-bdc5-a0e755df5d71 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:51:31.031473 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:31.031473 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:51:31.031473 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:51:31.031473 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:51:31.031473 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:51:31.031473 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:51:31.031473 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:31.031473 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:51:31.031473 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:31.031473 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:51:31.031473 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:31.031473 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:31.031473 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:31.031473 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:31.031473 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:31.031473 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:31.032512 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:31.032512 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:31.032512 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:31.032512 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:31.032512 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:31.032512 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:31.032512 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:51:31.032512 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:51:31.032512 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:51:31.032512 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:51:31.032512 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:31.032512 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:31.032512 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:31.032512 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:31.032512 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:31.032512 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:31.033348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:31.033348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:31.033348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:31.033348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:31.033348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:31.033348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:31.033348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:31.033348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:31.033348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:31.033348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:31.033348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:51:31.033348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:31.033348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:51:31.033348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:31.033348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 459/926] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Aug 24 16:51:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:31.034769 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808d52b-3a6c-4881-bdc5-a0e755df5d71 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:31.066702 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d850340e-87b5-497a-a883-d8829cc1b3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:31.067829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850340e-87b5-497a-a883-d8829cc1b3f9 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:31.068988 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850340e-87b5-497a-a883-d8829cc1b3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:31.069455 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850340e-87b5-497a-a883-d8829cc1b3f9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:31.081280 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d850340e-87b5-497a-a883-d8829cc1b3f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:51:31.087022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-d850340e-87b5-497a-a883-d8829cc1b3f9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:51:31.087022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:31.087022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:31.087022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:31.087022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:31.087022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:31.087022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:31.087022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:31.087022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:31.087022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:31.087022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:31.087022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:31.087022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:51:31.087022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:51:31.087022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:51:31.087022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:51:31.088834 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:51:31.088834 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:51:31.088834 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:51:31.088834 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:51:31.088834 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:31.088834 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:31.088834 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:31.088834 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:31.088834 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:31.088834 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:31.088834 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:31.088834 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:31.088834 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:31.088834 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:31.088834 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:31.088834 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:31.090266 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:31.090266 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:31.090266 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:31.090266 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:31.090266 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:51:31.090266 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:51:31.090266 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:51:31.090266 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:51:31.090266 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:51:31.090266 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:51:31.090266 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:51:31.090266 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:31.090266 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 468/927] 10.222.0.55 () {56 vars in 1120 bytes} [Wed Aug 24 16:51:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:31.090266 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d850340e-87b5-497a-a883-d8829cc1b3f9 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:31.140082 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:31.149447 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808d52b-3a6c-4881-bdc5-a0e755df5d71 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:31.187653 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf6c3a-72b8-4f6a-950d-c1622325f1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:31.188263 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf6c3a-72b8-4f6a-950d-c1622325f1d1 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:31.188536 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf6c3a-72b8-4f6a-950d-c1622325f1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:31.188813 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf6c3a-72b8-4f6a-950d-c1622325f1d1 None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:31.189446 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf6c3a-72b8-4f6a-950d-c1622325f1d1 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:31.189815 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf6c3a-72b8-4f6a-950d-c1622325f1d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:31.191210 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf6c3a-72b8-4f6a-950d-c1622325f1d1 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:31.196676 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 460/928] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Aug 24 16:51:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:31.197295 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf6c3a-72b8-4f6a-950d-c1622325f1d1 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:31.210582 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d850340e-87b5-497a-a883-d8829cc1b3f9 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:31.230913 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:31.247847 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3168112-58b0-4069-a2d5-8cb9eb485df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:31.248532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3168112-58b0-4069-a2d5-8cb9eb485df0 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:31.248869 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3168112-58b0-4069-a2d5-8cb9eb485df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:31.249309 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3168112-58b0-4069-a2d5-8cb9eb485df0 None admin] PATH_INFO: `/v3/services` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:31.250001 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3168112-58b0-4069-a2d5-8cb9eb485df0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:31.250374 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3168112-58b0-4069-a2d5-8cb9eb485df0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:31.251810 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3168112-58b0-4069-a2d5-8cb9eb485df0 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:31.263470 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 469/929] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Aug 24 16:51:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:31.263470 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3168112-58b0-4069-a2d5-8cb9eb485df0 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:31.309878 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf6c3a-72b8-4f6a-950d-c1622325f1d1 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:31.346751 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9abe0-d19c-4909-90e3-f1100b957687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:31.347395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9abe0-d19c-4909-90e3-f1100b957687 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:31.347675 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9abe0-d19c-4909-90e3-f1100b957687 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:31.347948 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d9abe0-d19c-4909-90e3-f1100b957687 None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:31.348622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9abe0-d19c-4909-90e3-f1100b957687 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:31.348925 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9abe0-d19c-4909-90e3-f1100b957687 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:31.351144 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d9abe0-d19c-4909-90e3-f1100b957687 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:31.364652 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 461/930] 10.222.0.55 () {56 vars in 1115 bytes} [Wed Aug 24 16:51:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:31.364652 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9abe0-d19c-4909-90e3-f1100b957687 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:31.372418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3168112-58b0-4069-a2d5-8cb9eb485df0 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:31.374768 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:31.407901 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb3c12-620d-49f1-8bc7-6c2d2fe52140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:31.408875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb3c12-620d-49f1-8bc7-6c2d2fe52140 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:31.409335 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb3c12-620d-49f1-8bc7-6c2d2fe52140 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:31.409811 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb3c12-620d-49f1-8bc7-6c2d2fe52140 None admin] PATH_INFO: `/v3/services` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:31.410650 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb3c12-620d-49f1-8bc7-6c2d2fe52140 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:31.411029 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb3c12-620d-49f1-8bc7-6c2d2fe52140 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:31.413276 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eb3c12-620d-49f1-8bc7-6c2d2fe52140 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:31.418527 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 470/931] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Aug 24 16:51:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:31.419480 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb3c12-620d-49f1-8bc7-6c2d2fe52140 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:31.471241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:31.480148 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d9abe0-d19c-4909-90e3-f1100b957687 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:31.522672 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f7186-8926-4098-a37b-d361441d588f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:31.523570 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f7186-8926-4098-a37b-d361441d588f None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:31.523904 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f7186-8926-4098-a37b-d361441d588f None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:31.524180 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319f7186-8926-4098-a37b-d361441d588f None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:31.524814 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f7186-8926-4098-a37b-d361441d588f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:31.524910 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb3c12-620d-49f1-8bc7-6c2d2fe52140 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:31.525117 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f7186-8926-4098-a37b-d361441d588f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:31.526778 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319f7186-8926-4098-a37b-d361441d588f None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:31.537396 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 462/932] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Aug 24 16:51:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:31.537396 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f7186-8926-4098-a37b-d361441d588f None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:31.566170 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ff77d-0e1c-46a0-ab72-ca6fe0e51dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:31.566802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ff77d-0e1c-46a0-ab72-ca6fe0e51dfc None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:31.567077 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ff77d-0e1c-46a0-ab72-ca6fe0e51dfc None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:31.567376 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ff77d-0e1c-46a0-ab72-ca6fe0e51dfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:31.577859 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ff77d-0e1c-46a0-ab72-ca6fe0e51dfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:31.579366 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ff77d-0e1c-46a0-ab72-ca6fe0e51dfc None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:31.595237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-ed4ff77d-0e1c-46a0-ab72-ca6fe0e51dfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:31.595237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:31.595237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:31.595237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:31.595237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:31.595237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:31.595237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:31.595237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:31.595237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:31.595237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:31.595237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:31.595237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:31.595237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:31.595237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:31.595237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:31.595237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:31.596305 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:31.596305 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:31.596305 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:31.596305 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:31.596305 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:31.596305 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:31.596305 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:31.596305 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:31.596305 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:31.596305 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:31.596305 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:31.596305 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:31.596305 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:31.596305 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:31.596305 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:31.596305 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:31.596305 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:31.597198 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:31.597198 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:31.597198 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:31.597198 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 471/933] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:31.597198 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ff77d-0e1c-46a0-ab72-ca6fe0e51dfc None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:31.630481 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:31.647259 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319f7186-8926-4098-a37b-d361441d588f None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:31.682803 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05757f-5987-4dbe-b10a-d09103afdf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:31.683366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05757f-5987-4dbe-b10a-d09103afdf71 None admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:31.683641 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05757f-5987-4dbe-b10a-d09103afdf71 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:31.683911 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05757f-5987-4dbe-b10a-d09103afdf71 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:31.684577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05757f-5987-4dbe-b10a-d09103afdf71 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:31.686191 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05757f-5987-4dbe-b10a-d09103afdf71 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:31.717156 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ff77d-0e1c-46a0-ab72-ca6fe0e51dfc None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:31.754153 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6e3c3-acd7-4247-bda2-bf08374c0bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:31.754769 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6e3c3-acd7-4247-bda2-bf08374c0bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:31.755057 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6e3c3-acd7-4247-bda2-bf08374c0bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:31.755388 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6e3c3-acd7-4247-bda2-bf08374c0bb9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:31.756111 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6e3c3-acd7-4247-bda2-bf08374c0bb9 None admin] RBAC: Adding query filter params (interface=public, service_id=082889913f5d4069a104c4b0c9cbc42a, region_id=RegionOne) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:31.756502 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6e3c3-acd7-4247-bda2-bf08374c0bb9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:31.757952 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6e3c3-acd7-4247-bda2-bf08374c0bb9 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:31.768269 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 472/934] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Aug 24 16:51:31 2022] GET /identity/v3/endpoints?service_id=082889913f5d4069a104c4b0c9cbc42a&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:31.768269 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6e3c3-acd7-4247-bda2-bf08374c0bb9 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:31.776683 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 463/935] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 16:51:31 2022] POST /identity/v3/endpoints => generated 347 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:51:31.777768 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05757f-5987-4dbe-b10a-d09103afdf71 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:31.816839 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:31.903166 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:31.922466 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6e3c3-acd7-4247-bda2-bf08374c0bb9 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:31.940667 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05757f-5987-4dbe-b10a-d09103afdf71 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:31.967295 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e7480-dfbd-446b-8d49-0a05849309db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:31.968257 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e7480-dfbd-446b-8d49-0a05849309db None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:31.968257 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e7480-dfbd-446b-8d49-0a05849309db None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:31.968441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e7480-dfbd-446b-8d49-0a05849309db None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:31.969424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e7480-dfbd-446b-8d49-0a05849309db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:31.969424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e7480-dfbd-446b-8d49-0a05849309db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:31.970946 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235e7480-dfbd-446b-8d49-0a05849309db None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:31.983883 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 473/936] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:31.984280 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741ad9b-bc2d-4a95-9aa7-0487e02bf668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:31.985128 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741ad9b-bc2d-4a95-9aa7-0487e02bf668 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:31.985247 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4557f-1b9e-4205-9efb-8666a1ad7558 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:31.985524 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4557f-1b9e-4205-9efb-8666a1ad7558 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:31.985802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba4557f-1b9e-4205-9efb-8666a1ad7558 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:31.986126 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741ad9b-bc2d-4a95-9aa7-0487e02bf668 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:31.986589 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741ad9b-bc2d-4a95-9aa7-0487e02bf668 None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:31.987367 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 474/937] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:31.987652 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741ad9b-bc2d-4a95-9aa7-0487e02bf668 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:31.989315 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5741ad9b-bc2d-4a95-9aa7-0487e02bf668 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:31.992912 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4557f-1b9e-4205-9efb-8666a1ad7558 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:31.998667 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 464/938] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Aug 24 16:51:31 2022] GET /identity/v3/services => generated 1497 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:51:32.000179 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd0cd1-7ef3-4a89-b555-4ecbf1c54a1d None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:32.000610 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd0cd1-7ef3-4a89-b555-4ecbf1c54a1d None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:32.001021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd0cd1-7ef3-4a89-b555-4ecbf1c54a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:32.026340 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-bffd0cd1-7ef3-4a89-b555-4ecbf1c54a1d None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:32.028286 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-bffd0cd1-7ef3-4a89-b555-4ecbf1c54a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:32.119513 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 465/939] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:51:32.127450 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba4557f-1b9e-4205-9efb-8666a1ad7558 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:32.165690 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2ab99-e109-4990-9377-6c98c426beed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:32.166335 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2ab99-e109-4990-9377-6c98c426beed None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:32.167098 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2ab99-e109-4990-9377-6c98c426beed None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:32.167098 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc2ab99-e109-4990-9377-6c98c426beed None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:32.175272 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc2ab99-e109-4990-9377-6c98c426beed None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:32.176705 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc2ab99-e109-4990-9377-6c98c426beed None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:32.189727 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-dfc2ab99-e109-4990-9377-6c98c426beed None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:51:32.189727 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:32.189727 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:32.189727 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:32.189727 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:32.189727 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:32.189727 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:32.189727 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:32.189727 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:32.189727 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:32.189727 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:32.189727 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:32.189727 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:51:32.189727 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:51:32.189727 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:51:32.189727 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:51:32.190744 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:32.190744 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:32.190744 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:51:32.190744 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:32.190744 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:51:32.190744 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:32.190744 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:32.190744 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:32.190744 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:32.190744 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:32.190744 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:32.190744 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:32.190744 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:32.190744 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:32.190744 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:32.190744 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:32.190744 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:32.190744 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:32.191802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:32.191802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:32.191802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:51:32.191802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:51:32.191802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:51:32.191802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:51:32.191802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:51:32.191802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:51:32.191802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:51:32.191802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:32.195192 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 475/940] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Aug 24 16:51:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:32.197131 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd0cd1-7ef3-4a89-b555-4ecbf1c54a1d None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:32.202064 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:32.311055 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd0cd1-7ef3-4a89-b555-4ecbf1c54a1d None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:32.347271 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d2733-9a1a-41bd-aa5a-e29df48e05b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:32.348162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d2733-9a1a-41bd-aa5a-e29df48e05b6 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:32.348592 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d2733-9a1a-41bd-aa5a-e29df48e05b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:32.349006 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d2733-9a1a-41bd-aa5a-e29df48e05b6 None admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:32.349915 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d2733-9a1a-41bd-aa5a-e29df48e05b6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:32.350373 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d2733-9a1a-41bd-aa5a-e29df48e05b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:32.351961 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d2733-9a1a-41bd-aa5a-e29df48e05b6 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:32.373248 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 466/941] 10.222.0.55 () {56 vars in 1149 bytes} [Wed Aug 24 16:51:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:32.383168 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2ab99-e109-4990-9377-6c98c426beed None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:32.394043 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:32.407243 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d2733-9a1a-41bd-aa5a-e29df48e05b6 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:32.494779 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc2ab99-e109-4990-9377-6c98c426beed None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:32.495686 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:32.534213 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20bc0b-ce87-45e6-8ab3-64b711d6bed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:32.534934 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20bc0b-ce87-45e6-8ab3-64b711d6bed8 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:32.535253 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20bc0b-ce87-45e6-8ab3-64b711d6bed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:32.535530 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20bc0b-ce87-45e6-8ab3-64b711d6bed8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:32.541556 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d2733-9a1a-41bd-aa5a-e29df48e05b6 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:32.547841 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c20bc0b-ce87-45e6-8ab3-64b711d6bed8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:32.549457 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c20bc0b-ce87-45e6-8ab3-64b711d6bed8 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:32.566368 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-7c20bc0b-ce87-45e6-8ab3-64b711d6bed8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:32.566368 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:32.566368 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:32.566368 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:32.566368 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:32.566368 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:32.566368 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:32.566368 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:32.566368 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:32.566368 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:32.566368 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:32.566368 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:32.566368 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:32.566368 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:32.566368 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:32.566368 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:32.567435 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:32.567435 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:32.567435 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:32.567435 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:32.567435 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:32.567435 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:32.567435 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:32.567435 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:32.567435 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:32.567435 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:32.567435 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:32.567435 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:32.567435 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:32.567435 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:32.567435 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:32.567435 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:32.567435 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:32.568587 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:32.568587 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:32.568587 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:32.571400 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 476/942] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:32.574068 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20bc0b-ce87-45e6-8ab3-64b711d6bed8 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:32.582991 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f767d9-0043-4670-9018-1c9142595b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:32.584013 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f767d9-0043-4670-9018-1c9142595b7b None admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:32.584488 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f767d9-0043-4670-9018-1c9142595b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:32.584964 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f767d9-0043-4670-9018-1c9142595b7b None admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:32.585807 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f767d9-0043-4670-9018-1c9142595b7b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:32.587649 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f767d9-0043-4670-9018-1c9142595b7b None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:32.590460 dv-cinder-779578-5-smb devstack@keystone.service[81760]: WARNING keystone.server.flask.common [None req-b5f767d9-0043-4670-9018-1c9142595b7b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 16:51:32.635361 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:32.642829 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.sql.core [None req-b5f767d9-0043-4670-9018-1c9142595b7b None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 16:51:32.642829 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 16:51:32.642829 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [parameters: {'id': '9cf7236381a44e979ca3f1e51c08100c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 16:51:32.642829 dv-cinder-779578-5-smb devstack@keystone.service[81760]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81760) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 16:51:32.665971 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-b5f767d9-0043-4670-9018-1c9142595b7b None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9cf7236381a44e979ca3f1e51c08100c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9cf7236381a44e979ca3f1e51c08100c. Aug 24 16:51:32.665971 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:32.665971 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 16:51:32.665971 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 16:51:32.665971 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 16:51:32.665971 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 16:51:32.665971 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 16:51:32.665971 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 16:51:32.665971 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 16:51:32.665971 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application conn.query(q) Aug 24 16:51:32.665971 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 16:51:32.665971 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 16:51:32.665971 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 16:51:32.666828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application result.read() Aug 24 16:51:32.666828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 16:51:32.666828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 16:51:32.666828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 16:51:32.666828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 16:51:32.666828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 16:51:32.666828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 16:51:32.666828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 16:51:32.666828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 16:51:32.666828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 16:51:32.666828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:32.666828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 16:51:32.666828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:32.666828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:32.666828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 16:51:32.666828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 16:51:32.666828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 16:51:32.666828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 16:51:32.668128 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 16:51:32.668128 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application next(self.gen) Aug 24 16:51:32.668128 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 16:51:32.668128 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application yield resource Aug 24 16:51:32.668128 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 16:51:32.668128 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application next(self.gen) Aug 24 16:51:32.668128 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 16:51:32.668128 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 16:51:32.668128 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 16:51:32.668128 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 16:51:32.668128 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 16:51:32.668128 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise self.value Aug 24 16:51:32.668128 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 16:51:32.668128 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 16:51:32.668128 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 16:51:32.668128 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application session.commit() Aug 24 16:51:32.668128 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 16:51:32.669024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 16:51:32.669024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 16:51:32.669024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 16:51:32.669024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 16:51:32.669024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application self.session.flush() Aug 24 16:51:32.669024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 16:51:32.669024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 16:51:32.669024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 16:51:32.669024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 16:51:32.669024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 16:51:32.669024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application compat.raise_( Aug 24 16:51:32.669024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 16:51:32.669024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception Aug 24 16:51:32.669024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 16:51:32.669024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 16:51:32.669024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 16:51:32.669024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 16:51:32.671101 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 16:51:32.671101 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 16:51:32.671101 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 16:51:32.671101 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 16:51:32.671101 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 16:51:32.671101 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 16:51:32.671101 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 16:51:32.671101 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 16:51:32.671101 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 16:51:32.671101 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 16:51:32.671101 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 16:51:32.671101 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 16:51:32.671101 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 16:51:32.671101 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 16:51:32.671101 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 16:51:32.671914 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 16:51:32.671914 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 16:51:32.671914 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception Aug 24 16:51:32.671914 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 16:51:32.671914 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 16:51:32.671914 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 16:51:32.671914 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 16:51:32.671914 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 16:51:32.671914 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 16:51:32.671914 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 16:51:32.671914 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application conn.query(q) Aug 24 16:51:32.671914 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 16:51:32.671914 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 16:51:32.671914 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 16:51:32.671914 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application result.read() Aug 24 16:51:32.671914 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 16:51:32.671914 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 16:51:32.672772 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 16:51:32.672772 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 16:51:32.672772 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 16:51:32.672772 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 16:51:32.672772 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 16:51:32.672772 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 16:51:32.672772 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 16:51:32.672772 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 16:51:32.672772 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [parameters: {'id': '9cf7236381a44e979ca3f1e51c08100c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 16:51:32.672772 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 16:51:32.672772 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:32.672772 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:51:32.672772 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:32.672772 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:32.672772 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 16:51:32.673555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 16:51:32.673555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 16:51:32.673555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 16:51:32.673555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 16:51:32.673555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:32.673555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:51:32.673555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:32.673555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:32.673555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:32.673555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:32.673555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:32.673555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:32.673555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:32.673555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:32.673555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:32.673555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:32.673555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:32.674450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:32.674450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 16:51:32.674450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 16:51:32.674450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:32.674450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:32.674450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 16:51:32.674450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 16:51:32.674450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 9cf7236381a44e979ca3f1e51c08100c. Aug 24 16:51:32.674450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:32.674450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 467/943] 10.222.0.55 () {60 vars in 1140 bytes} [Wed Aug 24 16:51:32 2022] POST /identity/v3/projects => generated 262 bytes in 262 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:51:32.676156 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f767d9-0043-4670-9018-1c9142595b7b None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:32.693488 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20bc0b-ce87-45e6-8ab3-64b711d6bed8 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:32.745652 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396eb755-f162-4e14-ac4e-fffd0500c1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:32.746589 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396eb755-f162-4e14-ac4e-fffd0500c1bc None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:32.747034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396eb755-f162-4e14-ac4e-fffd0500c1bc None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:32.747481 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396eb755-f162-4e14-ac4e-fffd0500c1bc None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:32.748426 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396eb755-f162-4e14-ac4e-fffd0500c1bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:32.748885 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396eb755-f162-4e14-ac4e-fffd0500c1bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:32.750391 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396eb755-f162-4e14-ac4e-fffd0500c1bc None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:32.763689 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 477/944] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:32.775161 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396eb755-f162-4e14-ac4e-fffd0500c1bc None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:32.815645 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f767d9-0043-4670-9018-1c9142595b7b None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:32.848736 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:32.881420 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc655a9f-45c9-48e9-9ef4-fa415da148ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:32.882350 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc655a9f-45c9-48e9-9ef4-fa415da148ad None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:32.882781 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc655a9f-45c9-48e9-9ef4-fa415da148ad None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:32.883235 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc655a9f-45c9-48e9-9ef4-fa415da148ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:32.890955 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc655a9f-45c9-48e9-9ef4-fa415da148ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:32.892958 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc655a9f-45c9-48e9-9ef4-fa415da148ad None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:32.905412 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-bc655a9f-45c9-48e9-9ef4-fa415da148ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:32.905412 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:32.905412 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:32.905412 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:32.905412 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:32.905412 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:32.905412 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:32.905412 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:32.905412 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:32.905412 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:32.905412 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:32.905412 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:32.905412 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:51:32.905412 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:51:32.905412 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:51:32.906524 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:51:32.906524 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:32.906524 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:32.906524 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:32.906524 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:32.906524 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:32.906524 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:32.906524 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:32.906524 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:32.906524 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:32.906524 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:32.906524 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:32.906524 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:32.906524 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:32.906524 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:32.906524 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:32.906524 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:32.907600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:51:32.907600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:51:32.907600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:51:32.907600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:51:32.907600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:51:32.907600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:51:32.907600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:32.907600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:32.909660 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 468/945] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:51:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:32.916293 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc655a9f-45c9-48e9-9ef4-fa415da148ad None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:32.923623 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396eb755-f162-4e14-ac4e-fffd0500c1bc None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:32.949016 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:32.971873 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e36f4-16b2-47de-97b6-d7e18f3a3a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:32.972508 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e36f4-16b2-47de-97b6-d7e18f3a3a58 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:32.973691 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e36f4-16b2-47de-97b6-d7e18f3a3a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:32.975162 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e36f4-16b2-47de-97b6-d7e18f3a3a58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:32.984493 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e36f4-16b2-47de-97b6-d7e18f3a3a58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:32.986583 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e36f4-16b2-47de-97b6-d7e18f3a3a58 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:33.002081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-e90e36f4-16b2-47de-97b6-d7e18f3a3a58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:33.002081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:33.002081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:33.002081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:33.002081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:33.002081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:33.002081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:33.002081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:33.002081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:33.002081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:33.002081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:33.002081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:33.002081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:51:33.002081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:51:33.002081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:51:33.003243 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:51:33.003243 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:33.003243 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:33.003243 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:33.003243 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:33.003243 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:33.003243 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:33.003243 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:33.003243 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:33.003243 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:33.003243 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:33.003243 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:33.003243 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:33.003243 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:33.003243 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:33.003243 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:33.003243 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:33.004298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:51:33.004298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:51:33.004298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:51:33.004298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:51:33.004298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:51:33.004298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:51:33.004298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:33.004298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:33.004298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 478/946] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:51:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:33.011289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e36f4-16b2-47de-97b6-d7e18f3a3a58 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:33.054193 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc655a9f-45c9-48e9-9ef4-fa415da148ad None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:33.090920 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d7996-897a-421a-804c-d6bc17da5738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:33.091555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d7996-897a-421a-804c-d6bc17da5738 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:33.091834 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d7996-897a-421a-804c-d6bc17da5738 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:33.092103 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d7996-897a-421a-804c-d6bc17da5738 None admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:33.092797 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d7996-897a-421a-804c-d6bc17da5738 None admin] RBAC: Adding query filter params (name=service) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:33.093099 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d7996-897a-421a-804c-d6bc17da5738 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:33.094524 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0d7996-897a-421a-804c-d6bc17da5738 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:33.120908 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 469/947] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Aug 24 16:51:32 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:33.149997 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e36f4-16b2-47de-97b6-d7e18f3a3a58 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:33.188189 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1146da-6a09-4978-a6b2-2428886e1c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:33.188839 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1146da-6a09-4978-a6b2-2428886e1c76 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:33.189120 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1146da-6a09-4978-a6b2-2428886e1c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:33.189392 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1146da-6a09-4978-a6b2-2428886e1c76 None admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:33.190227 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1146da-6a09-4978-a6b2-2428886e1c76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:33.190537 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1146da-6a09-4978-a6b2-2428886e1c76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:33.192181 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1146da-6a09-4978-a6b2-2428886e1c76 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:33.207164 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 479/948] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:51:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:33.216305 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d7996-897a-421a-804c-d6bc17da5738 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:33.271965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:33.335866 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0d7996-897a-421a-804c-d6bc17da5738 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:33.373600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80407bc-a834-4d14-8e4c-3abcdf262935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:33.374430 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80407bc-a834-4d14-8e4c-3abcdf262935 None admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:33.374720 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80407bc-a834-4d14-8e4c-3abcdf262935 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:33.375063 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80407bc-a834-4d14-8e4c-3abcdf262935 None admin] PATH_INFO: `/v3/projects/ebae6aa9c60343e6ba0ff1cd62619642/users/ae9fc5f06a0441da80e656fa1e88db5d/roles/c25ffa9ed2f3481697f2ff740bc34e8e` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:33.377549 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80407bc-a834-4d14-8e4c-3abcdf262935 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebae6aa9c60343e6ba0ff1cd62619642, user_id=ae9fc5f06a0441da80e656fa1e88db5d, role_id=c25ffa9ed2f3481697f2ff740bc34e8e)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:33.379016 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80407bc-a834-4d14-8e4c-3abcdf262935 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:33.461299 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 470/949] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Aug 24 16:51:33 2022] PUT /identity/v3/projects/ebae6aa9c60343e6ba0ff1cd62619642/users/ae9fc5f06a0441da80e656fa1e88db5d/roles/c25ffa9ed2f3481697f2ff740bc34e8e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:51:33.889616 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430973e-2aaf-44ed-a428-e9e6b2569677 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:33.890155 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430973e-2aaf-44ed-a428-e9e6b2569677 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:33.890155 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3430973e-2aaf-44ed-a428-e9e6b2569677 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:33.891968 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 480/950] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:33.898355 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bf770-0ae8-4c0a-a704-a504ca972615 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:33.898654 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bf770-0ae8-4c0a-a704-a504ca972615 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:33.898914 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bf770-0ae8-4c0a-a704-a504ca972615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:33.925422 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-361bf770-0ae8-4c0a-a704-a504ca972615 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:33.926960 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-361bf770-0ae8-4c0a-a704-a504ca972615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:34.015302 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 471/951] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:51:34.064402 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bfae4-e1fb-441c-95be-898aa6df7f2e None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:34.064717 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bfae4-e1fb-441c-95be-898aa6df7f2e None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:34.064948 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4bfae4-e1fb-441c-95be-898aa6df7f2e None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:34.066575 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 481/952] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:34.072826 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab89de7-21b4-4270-b5dc-5cb1c3597f82 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:34.073493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab89de7-21b4-4270-b5dc-5cb1c3597f82 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:34.073493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab89de7-21b4-4270-b5dc-5cb1c3597f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:34.098499 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-4ab89de7-21b4-4270-b5dc-5cb1c3597f82 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:34.100629 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-4ab89de7-21b4-4270-b5dc-5cb1c3597f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:34.134028 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:34.194190 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 472/953] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:51:34.340407 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bfae4-e1fb-441c-95be-898aa6df7f2e None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:34.383206 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:34.459598 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4bfae4-e1fb-441c-95be-898aa6df7f2e None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:34.466503 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab89de7-21b4-4270-b5dc-5cb1c3597f82 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:34.512931 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02919197-a9ef-4684-be59-bb34c8959789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:34.513571 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02919197-a9ef-4684-be59-bb34c8959789 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:34.513876 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02919197-a9ef-4684-be59-bb34c8959789 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:34.514117 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02919197-a9ef-4684-be59-bb34c8959789 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:34.514697 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02919197-a9ef-4684-be59-bb34c8959789 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:34.516066 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02919197-a9ef-4684-be59-bb34c8959789 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:34.525331 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-02919197-a9ef-4684-be59-bb34c8959789 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 16:51:34.525331 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:34.525331 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:51:34.525331 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:51:34.525331 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:51:34.525331 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:51:34.525331 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:51:34.525331 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:34.525331 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 16:51:34.525331 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:34.525331 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:51:34.525331 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:34.525331 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:34.525331 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:34.525331 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:34.525331 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:34.525331 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:34.526549 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:34.526549 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:34.526549 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:34.526549 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:34.526549 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:34.526549 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:34.526549 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:51:34.526549 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:51:34.526549 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:51:34.526549 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:51:34.526549 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:34.526549 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:34.526549 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:34.526549 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:34.526549 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:34.526549 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:34.527517 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:34.527517 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:34.527517 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:34.527517 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:34.527517 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:34.527517 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:34.527517 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:34.527517 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:34.527517 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:34.527517 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:34.527517 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:51:34.527517 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:34.527517 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 16:51:34.527517 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:34.527517 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 482/954] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:51:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:34.532769 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02919197-a9ef-4684-be59-bb34c8959789 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:34.606317 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab89de7-21b4-4270-b5dc-5cb1c3597f82 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:34.650211 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe86ae-c2e7-49b1-aecd-45fe35d975ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:34.651138 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe86ae-c2e7-49b1-aecd-45fe35d975ac None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:34.651871 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe86ae-c2e7-49b1-aecd-45fe35d975ac None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:34.652158 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe86ae-c2e7-49b1-aecd-45fe35d975ac None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:34.653043 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe86ae-c2e7-49b1-aecd-45fe35d975ac None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:34.655191 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:34.655903 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe86ae-c2e7-49b1-aecd-45fe35d975ac None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:34.658576 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02919197-a9ef-4684-be59-bb34c8959789 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:34.666671 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-d2fe86ae-c2e7-49b1-aecd-45fe35d975ac None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:51:34.666671 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:34.666671 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:51:34.666671 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:51:34.666671 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:51:34.666671 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:51:34.666671 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:51:34.666671 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:34.666671 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:51:34.666671 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:34.666671 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:51:34.666671 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:34.666671 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:34.666671 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:34.666671 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:34.666671 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:34.666671 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:34.667826 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:34.667826 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:34.667826 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:34.667826 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:34.667826 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:34.667826 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:34.667826 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:51:34.667826 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:51:34.667826 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:51:34.667826 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:51:34.667826 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:34.667826 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:34.667826 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:34.667826 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:34.667826 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:34.667826 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:34.668704 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:34.668704 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:34.668704 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:34.668704 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:34.668704 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:34.668704 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:34.668704 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:34.668704 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:34.668704 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:34.668704 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:34.668704 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:51:34.668704 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:34.668704 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:51:34.668704 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:34.669509 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 473/955] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Aug 24 16:51:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:51:34.675019 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe86ae-c2e7-49b1-aecd-45fe35d975ac None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:34.703325 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db51098-5831-451b-b794-d58c4a49be50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:34.704139 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db51098-5831-451b-b794-d58c4a49be50 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:34.704565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db51098-5831-451b-b794-d58c4a49be50 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:34.704994 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db51098-5831-451b-b794-d58c4a49be50 None admin] PATH_INFO: `/v3/services` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:34.705753 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db51098-5831-451b-b794-d58c4a49be50 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:34.706180 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db51098-5831-451b-b794-d58c4a49be50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:34.708060 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db51098-5831-451b-b794-d58c4a49be50 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:34.711568 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:34.714602 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 483/956] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Aug 24 16:51:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:34.722079 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db51098-5831-451b-b794-d58c4a49be50 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:34.820595 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe86ae-c2e7-49b1-aecd-45fe35d975ac None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:34.864429 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79f04b-1ed2-4b5b-88d5-f24dfba9bd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:34.865213 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79f04b-1ed2-4b5b-88d5-f24dfba9bd5e None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:34.865489 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79f04b-1ed2-4b5b-88d5-f24dfba9bd5e None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:34.865758 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a79f04b-1ed2-4b5b-88d5-f24dfba9bd5e None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:34.867692 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79f04b-1ed2-4b5b-88d5-f24dfba9bd5e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:34.868275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79f04b-1ed2-4b5b-88d5-f24dfba9bd5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:34.870550 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db51098-5831-451b-b794-d58c4a49be50 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:34.874082 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a79f04b-1ed2-4b5b-88d5-f24dfba9bd5e None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:34.884201 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 474/957] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Aug 24 16:51:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:34.897439 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79f04b-1ed2-4b5b-88d5-f24dfba9bd5e None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:34.915094 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57633c79-f78c-4dcf-b938-8d3b063f9a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:34.915725 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57633c79-f78c-4dcf-b938-8d3b063f9a75 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:34.916002 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57633c79-f78c-4dcf-b938-8d3b063f9a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:34.916328 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57633c79-f78c-4dcf-b938-8d3b063f9a75 None admin] PATH_INFO: `/v3/services` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:34.917284 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57633c79-f78c-4dcf-b938-8d3b063f9a75 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:34.917284 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57633c79-f78c-4dcf-b938-8d3b063f9a75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:34.918648 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57633c79-f78c-4dcf-b938-8d3b063f9a75 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:34.924010 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 484/958] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Aug 24 16:51:34 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:35.033825 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:35.053588 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a79f04b-1ed2-4b5b-88d5-f24dfba9bd5e None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:35.093500 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe8110-3e61-4840-be3b-8bb1c5f4d494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:35.094177 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe8110-3e61-4840-be3b-8bb1c5f4d494 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:35.094422 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe8110-3e61-4840-be3b-8bb1c5f4d494 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:35.094637 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe8110-3e61-4840-be3b-8bb1c5f4d494 None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:35.095300 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe8110-3e61-4840-be3b-8bb1c5f4d494 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:35.095600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe8110-3e61-4840-be3b-8bb1c5f4d494 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:35.097033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe8110-3e61-4840-be3b-8bb1c5f4d494 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:35.103000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 475/959] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Aug 24 16:51:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:35.110488 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57633c79-f78c-4dcf-b938-8d3b063f9a75 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:35.144611 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:35.223433 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57633c79-f78c-4dcf-b938-8d3b063f9a75 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:35.261854 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e8beb4-05de-4fed-bfd9-c72293198ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:35.262822 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8beb4-05de-4fed-bfd9-c72293198ae5 None admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:35.263350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8beb4-05de-4fed-bfd9-c72293198ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:35.263831 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e8beb4-05de-4fed-bfd9-c72293198ae5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:35.264696 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e8beb4-05de-4fed-bfd9-c72293198ae5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:35.266261 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e8beb4-05de-4fed-bfd9-c72293198ae5 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:35.343836 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aebb3d-2720-4ddb-b6b9-92f64e545819 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:35.344033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aebb3d-2720-4ddb-b6b9-92f64e545819 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:35.344289 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1aebb3d-2720-4ddb-b6b9-92f64e545819 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:35.345889 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 476/960] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:35.348403 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 485/961] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 16:51:35 2022] POST /identity/v3/endpoints => generated 349 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:51:35.352916 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79ccab-7039-4f38-bb32-408f42672475 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:35.354895 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79ccab-7039-4f38-bb32-408f42672475 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:35.354895 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79ccab-7039-4f38-bb32-408f42672475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:35.376538 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-4c79ccab-7039-4f38-bb32-408f42672475 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:35.378358 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-4c79ccab-7039-4f38-bb32-408f42672475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:35.479261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 477/962] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:51:35.635806 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ede7f7-756a-461d-9a04-c8f0f54be6bd None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:35.636479 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ede7f7-756a-461d-9a04-c8f0f54be6bd None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:35.636967 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ede7f7-756a-461d-9a04-c8f0f54be6bd None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:35.638777 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 486/963] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:35.644365 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d2592-b7dd-48f7-8fa7-ebe6ac0679f7 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:35.644925 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d2592-b7dd-48f7-8fa7-ebe6ac0679f7 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:35.645425 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d2592-b7dd-48f7-8fa7-ebe6ac0679f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:35.666178 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-f73d2592-b7dd-48f7-8fa7-ebe6ac0679f7 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:35.667822 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-f73d2592-b7dd-48f7-8fa7-ebe6ac0679f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:35.745045 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 478/964] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:51:35.760574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ede7f7-756a-461d-9a04-c8f0f54be6bd None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:35.871506 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:35.878574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ede7f7-756a-461d-9a04-c8f0f54be6bd None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:35.916738 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b47a4c-a12e-43f2-924f-5c4aae99313e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:35.917354 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b47a4c-a12e-43f2-924f-5c4aae99313e None admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:35.917531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b47a4c-a12e-43f2-924f-5c4aae99313e None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:35.917809 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b47a4c-a12e-43f2-924f-5c4aae99313e None admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:35.918465 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b47a4c-a12e-43f2-924f-5c4aae99313e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:35.919920 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b47a4c-a12e-43f2-924f-5c4aae99313e None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:35.922466 dv-cinder-779578-5-smb devstack@keystone.service[81761]: WARNING keystone.server.flask.common [None req-f6b47a4c-a12e-43f2-924f-5c4aae99313e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 16:51:35.973493 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.sql.core [None req-f6b47a4c-a12e-43f2-924f-5c4aae99313e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 16:51:35.973493 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 16:51:35.973493 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [parameters: {'user_id': 'e576c4f50c224279958c9b6d76c9eb4a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 16:51:35.973493 dv-cinder-779578-5-smb devstack@keystone.service[81761]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81761) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 16:51:35.980531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-f6b47a4c-a12e-43f2-924f-5c4aae99313e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 16:51:35.980531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:35.980531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 16:51:35.980531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 16:51:35.980531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 16:51:35.980531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 16:51:35.980531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 16:51:35.980531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 16:51:35.980531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 16:51:35.980531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application conn.query(q) Aug 24 16:51:35.980531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 16:51:35.980531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 16:51:35.980531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 16:51:35.980531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application result.read() Aug 24 16:51:35.980531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 16:51:35.981399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 16:51:35.981399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 16:51:35.981399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 16:51:35.981399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 16:51:35.981399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 16:51:35.981399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 16:51:35.981399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 16:51:35.981399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 16:51:35.981399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:35.981399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 16:51:35.981399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:35.981399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:35.981399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 16:51:35.981399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 16:51:35.981399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 16:51:35.981399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 16:51:35.981399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 16:51:35.981399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application next(self.gen) Aug 24 16:51:35.982337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 16:51:35.982337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application yield resource Aug 24 16:51:35.982337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 16:51:35.982337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application next(self.gen) Aug 24 16:51:35.982337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 16:51:35.982337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 16:51:35.982337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 16:51:35.982337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 16:51:35.982337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 16:51:35.982337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise self.value Aug 24 16:51:35.982337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 16:51:35.982337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 16:51:35.982337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 16:51:35.982337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application session.commit() Aug 24 16:51:35.982337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 16:51:35.982337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 16:51:35.982337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 16:51:35.983253 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 16:51:35.983253 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 16:51:35.983253 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self.session.flush() Aug 24 16:51:35.983253 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 16:51:35.983253 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 16:51:35.983253 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 16:51:35.983253 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 16:51:35.983253 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 16:51:35.983253 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application compat.raise_( Aug 24 16:51:35.983253 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 16:51:35.983253 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception Aug 24 16:51:35.983253 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 16:51:35.983253 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 16:51:35.983253 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 16:51:35.983253 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 16:51:35.983253 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 16:51:35.983253 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 16:51:35.984180 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 16:51:35.984180 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 16:51:35.984180 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 16:51:35.984180 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 16:51:35.984180 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 16:51:35.984180 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 16:51:35.984180 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 16:51:35.984180 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 16:51:35.984180 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 16:51:35.984180 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 16:51:35.984180 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 16:51:35.984180 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 16:51:35.984180 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 16:51:35.984180 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 16:51:35.984180 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 16:51:35.984180 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception Aug 24 16:51:35.985026 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 16:51:35.985026 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 16:51:35.985026 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 16:51:35.985026 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 16:51:35.985026 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 16:51:35.985026 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 16:51:35.985026 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 16:51:35.985026 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application conn.query(q) Aug 24 16:51:35.985026 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 16:51:35.985026 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 16:51:35.985026 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 16:51:35.985026 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application result.read() Aug 24 16:51:35.985026 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 16:51:35.985026 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 16:51:35.985026 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 16:51:35.985026 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 16:51:35.985875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 16:51:35.985875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 16:51:35.985875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 16:51:35.985875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 16:51:35.985875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 16:51:35.985875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 16:51:35.985875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e576c4f50c224279958c9b6d76c9eb4a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 16:51:35.985875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 16:51:35.985875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:35.985875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:51:35.985875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:35.985875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:35.985875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:35.985875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:35.985875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:35.986667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:35.986667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:35.986667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:35.986667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:35.986667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:35.986667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:35.986667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:35.986667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 16:51:35.986667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 16:51:35.986667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:35.986667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:35.986667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:51:35.986667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:35.986667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:51:35.986667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:35.986667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 16:51:35.986667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 16:51:35.988038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 16:51:35.988038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 16:51:35.988038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 16:51:35.988038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 16:51:35.988038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 16:51:35.988038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:35.988038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 487/965] 10.222.0.55 () {60 vars in 1131 bytes} [Wed Aug 24 16:51:35 2022] POST /identity/v3/users => generated 160 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:35.988743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d2592-b7dd-48f7-8fa7-ebe6ac0679f7 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:35.997995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:36.031542 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b47a4c-a12e-43f2-924f-5c4aae99313e None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:36.111457 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d2592-b7dd-48f7-8fa7-ebe6ac0679f7 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:36.152395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a625150-d247-48e7-ac06-ba93a721e517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:36.153407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a625150-d247-48e7-ac06-ba93a721e517 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:36.153890 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a625150-d247-48e7-ac06-ba93a721e517 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:36.154421 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a625150-d247-48e7-ac06-ba93a721e517 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:36.163076 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a625150-d247-48e7-ac06-ba93a721e517 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:36.164891 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a625150-d247-48e7-ac06-ba93a721e517 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:36.168057 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b47a4c-a12e-43f2-924f-5c4aae99313e None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:36.180353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-9a625150-d247-48e7-ac06-ba93a721e517 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 16:51:36.180353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:36.180353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:36.180353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:36.180353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:36.180353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:36.180353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:36.180353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:36.180353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:36.180353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:36.180353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:36.180353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:36.180353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:51:36.180353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:51:36.180353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:51:36.180353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:51:36.181395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:36.181395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:36.181395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:51:36.181395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:36.181395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:51:36.181395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:36.181395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:36.181395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:36.181395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:36.181395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:36.181395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:36.181395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:36.181395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:36.181395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:36.181395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:36.181395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:36.181395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:36.181395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:36.182350 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:36.182350 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:36.182350 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:51:36.182350 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:51:36.182350 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:51:36.182350 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:51:36.182350 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:51:36.182350 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:51:36.182350 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 16:51:36.182350 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:36.185258 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 479/966] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:51:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:36.195198 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a625150-d247-48e7-ac06-ba93a721e517 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:36.211491 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14601f-fd25-436a-8597-f11939e89f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:36.212136 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14601f-fd25-436a-8597-f11939e89f6d None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:36.212698 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14601f-fd25-436a-8597-f11939e89f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:36.212979 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b14601f-fd25-436a-8597-f11939e89f6d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:36.227602 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b14601f-fd25-436a-8597-f11939e89f6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:51:36.234582 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-0b14601f-fd25-436a-8597-f11939e89f6d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:51:36.234582 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:36.234582 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:36.234582 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:36.234582 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:36.234582 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:36.234582 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:36.234582 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:36.234582 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:36.234582 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:36.234582 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:36.234582 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:36.234582 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:51:36.234582 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:51:36.234582 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:51:36.234582 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:51:36.235823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:51:36.235823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:51:36.235823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:51:36.235823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:51:36.235823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:36.235823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:36.235823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:36.235823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:36.235823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:36.235823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:36.235823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:36.235823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:36.235823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:36.235823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:36.235823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:36.235823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:36.236858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:36.236858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:36.236858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:36.236858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:36.236858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:51:36.236858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:51:36.236858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:51:36.236858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:51:36.236858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:51:36.236858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:51:36.236858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:51:36.236858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:36.241472 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 488/967] 10.222.0.55 () {56 vars in 1120 bytes} [Wed Aug 24 16:51:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:36.243022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14601f-fd25-436a-8597-f11939e89f6d None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:36.256895 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:36.279585 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:36.329615 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a625150-d247-48e7-ac06-ba93a721e517 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:36.360026 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b14601f-fd25-436a-8597-f11939e89f6d None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:36.376534 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a7c37-1aea-4a69-9328-45286d57abd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:36.377330 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a7c37-1aea-4a69-9328-45286d57abd6 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:36.377732 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a7c37-1aea-4a69-9328-45286d57abd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:36.378151 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a7c37-1aea-4a69-9328-45286d57abd6 None admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:36.379245 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a7c37-1aea-4a69-9328-45286d57abd6 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:36.379462 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a7c37-1aea-4a69-9328-45286d57abd6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:36.381504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a7c37-1aea-4a69-9328-45286d57abd6 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:36.403627 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e430eaf-67f7-4e8a-aa67-b470508c3f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:36.404494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e430eaf-67f7-4e8a-aa67-b470508c3f5b None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:36.404944 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e430eaf-67f7-4e8a-aa67-b470508c3f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:36.405383 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e430eaf-67f7-4e8a-aa67-b470508c3f5b None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:36.406204 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e430eaf-67f7-4e8a-aa67-b470508c3f5b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:36.406659 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e430eaf-67f7-4e8a-aa67-b470508c3f5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:36.409507 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e430eaf-67f7-4e8a-aa67-b470508c3f5b None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:36.428441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 489/969] 10.222.0.55 () {56 vars in 1115 bytes} [Wed Aug 24 16:51:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:36.428674 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 480/969] 10.222.0.55 () {56 vars in 1101 bytes} [Wed Aug 24 16:51:36 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:36.429644 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a7c37-1aea-4a69-9328-45286d57abd6 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:36.580527 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a7c37-1aea-4a69-9328-45286d57abd6 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:36.609539 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:36.621401 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb229c-1fe0-4343-b06b-ecbfdb468ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:36.622043 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb229c-1fe0-4343-b06b-ecbfdb468ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:36.626908 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb229c-1fe0-4343-b06b-ecbfdb468ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:36.626908 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fb229c-1fe0-4343-b06b-ecbfdb468ea9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:36.633347 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb229c-1fe0-4343-b06b-ecbfdb468ea9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:36.634823 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fb229c-1fe0-4343-b06b-ecbfdb468ea9 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:36.650878 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-b5fb229c-1fe0-4343-b06b-ecbfdb468ea9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:36.650878 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:36.650878 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:36.650878 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:36.650878 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:36.650878 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:36.650878 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:36.650878 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:36.650878 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:36.650878 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:36.650878 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:36.650878 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:36.650878 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:36.650878 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:36.650878 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:36.650878 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:36.651996 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:36.651996 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:36.651996 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:36.651996 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:36.651996 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:36.651996 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:36.651996 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:36.651996 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:36.651996 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:36.651996 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:36.651996 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:36.651996 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:36.651996 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:36.651996 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:36.651996 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:36.651996 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:36.651996 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:36.653535 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:36.653535 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:36.653535 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:36.653535 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 481/970] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:36.658218 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e430eaf-67f7-4e8a-aa67-b470508c3f5b None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:36.733684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:36.766755 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e430eaf-67f7-4e8a-aa67-b470508c3f5b None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:36.815866 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d3637-855a-4399-b1f2-bfa7fd9bccd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:36.816860 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d3637-855a-4399-b1f2-bfa7fd9bccd2 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:36.817367 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d3637-855a-4399-b1f2-bfa7fd9bccd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:36.817915 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628d3637-855a-4399-b1f2-bfa7fd9bccd2 None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:36.819218 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d3637-855a-4399-b1f2-bfa7fd9bccd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:36.819763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d3637-855a-4399-b1f2-bfa7fd9bccd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:36.821355 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628d3637-855a-4399-b1f2-bfa7fd9bccd2 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:36.835779 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 490/971] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:36.841887 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb229c-1fe0-4343-b06b-ecbfdb468ea9 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:36.959852 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fb229c-1fe0-4343-b06b-ecbfdb468ea9 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:36.995773 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711488a-37df-4fc5-9ee5-1c9c2689b5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:36.996636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711488a-37df-4fc5-9ee5-1c9c2689b5af None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:36.997062 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711488a-37df-4fc5-9ee5-1c9c2689b5af None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:36.997492 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711488a-37df-4fc5-9ee5-1c9c2689b5af None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:37.006188 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711488a-37df-4fc5-9ee5-1c9c2689b5af None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:37.007904 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711488a-37df-4fc5-9ee5-1c9c2689b5af None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:37.019429 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-3711488a-37df-4fc5-9ee5-1c9c2689b5af None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:51:37.019429 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:37.019429 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:37.019429 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:37.019429 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:37.019429 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:37.019429 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:37.019429 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:37.019429 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:37.019429 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:37.019429 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:37.019429 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:37.019429 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:51:37.019429 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:51:37.019429 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:51:37.019429 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:51:37.020618 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:37.020618 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:37.020618 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:51:37.020618 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:37.020618 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:51:37.020618 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:37.020618 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:37.020618 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:37.020618 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:37.020618 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:37.020618 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:37.020618 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:37.020618 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:37.020618 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:37.020618 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:37.020618 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:37.020618 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:37.020618 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:37.022877 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:37.022877 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:37.022877 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:51:37.022877 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:51:37.022877 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:51:37.022877 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:51:37.022877 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:51:37.022877 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:51:37.022877 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 16:51:37.022877 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:37.029136 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 482/972] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Aug 24 16:51:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:37.030678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d3637-855a-4399-b1f2-bfa7fd9bccd2 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:37.055043 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda712e3-e974-42de-a9f8-f718827db776 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:37.055381 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda712e3-e974-42de-a9f8-f718827db776 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:37.055684 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda712e3-e974-42de-a9f8-f718827db776 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:37.057042 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 483/973] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:51:37.062153 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6ae3d-80d2-4c36-9e0c-15a775545c50 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:37.062440 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6ae3d-80d2-4c36-9e0c-15a775545c50 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:37.062718 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6ae3d-80d2-4c36-9e0c-15a775545c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:37.081731 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-b8e6ae3d-80d2-4c36-9e0c-15a775545c50 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:37.084405 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-b8e6ae3d-80d2-4c36-9e0c-15a775545c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:37.115804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:37.164648 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628d3637-855a-4399-b1f2-bfa7fd9bccd2 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:37.179194 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 484/974] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:51:37.210260 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:37.218798 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d93ee-de37-44dd-bcb3-8b6555fb5b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:37.219503 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d93ee-de37-44dd-bcb3-8b6555fb5b8f None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:37.219782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d93ee-de37-44dd-bcb3-8b6555fb5b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:37.229478 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d93ee-de37-44dd-bcb3-8b6555fb5b8f None admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:37.229478 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d93ee-de37-44dd-bcb3-8b6555fb5b8f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:37.229478 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d93ee-de37-44dd-bcb3-8b6555fb5b8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:37.229478 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d93ee-de37-44dd-bcb3-8b6555fb5b8f None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:37.249441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 491/975] 10.222.0.55 () {56 vars in 1149 bytes} [Wed Aug 24 16:51:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:37.254470 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e6ae3d-80d2-4c36-9e0c-15a775545c50 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:37.340164 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0fbeb-973b-4fb7-b9b3-7df91408239f None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:37.340447 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0fbeb-973b-4fb7-b9b3-7df91408239f None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:37.340723 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0fbeb-973b-4fb7-b9b3-7df91408239f None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:37.342201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 492/976] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:51:37.346959 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293005e-7008-41f7-a54a-8ef42a272e60 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:37.347279 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293005e-7008-41f7-a54a-8ef42a272e60 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:37.347549 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293005e-7008-41f7-a54a-8ef42a272e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:37.363418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e6ae3d-80d2-4c36-9e0c-15a775545c50 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:37.368725 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-2293005e-7008-41f7-a54a-8ef42a272e60 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:37.371369 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-2293005e-7008-41f7-a54a-8ef42a272e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:37.400164 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618b654-bd94-4dee-b2b2-7c922ab3c771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:37.400783 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618b654-bd94-4dee-b2b2-7c922ab3c771 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:37.401372 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618b654-bd94-4dee-b2b2-7c922ab3c771 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:37.401651 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618b654-bd94-4dee-b2b2-7c922ab3c771 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:37.456591 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:37.459401 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 493/977] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:51:37.460155 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293005e-7008-41f7-a54a-8ef42a272e60 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:37.497392 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618b654-bd94-4dee-b2b2-7c922ab3c771 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:37.498841 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618b654-bd94-4dee-b2b2-7c922ab3c771 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:37.592281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293005e-7008-41f7-a54a-8ef42a272e60 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:37.613200 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:37.628733 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 485/978] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:51:37 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:51:37.634376 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618b654-bd94-4dee-b2b2-7c922ab3c771 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:37.636551 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1cce0-ffb1-4b96-aa6d-bb2089539892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:37.637160 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1cce0-ffb1-4b96-aa6d-bb2089539892 None admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:37.638241 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1cce0-ffb1-4b96-aa6d-bb2089539892 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:37.638241 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac1cce0-ffb1-4b96-aa6d-bb2089539892 None admin] PATH_INFO: `/v3/services` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:37.638414 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1cce0-ffb1-4b96-aa6d-bb2089539892 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:37.639709 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac1cce0-ffb1-4b96-aa6d-bb2089539892 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:37.702043 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:37.713073 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 494/979] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Aug 24 16:51:37 2022] POST /identity/v3/services => generated 242 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:51:37.733804 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1cce0-ffb1-4b96-aa6d-bb2089539892 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:37.746774 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618b654-bd94-4dee-b2b2-7c922ab3c771 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:37.798162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3461f-cf27-410a-a883-29c7d3a17287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:37.801040 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3461f-cf27-410a-a883-29c7d3a17287 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:37.801040 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3461f-cf27-410a-a883-29c7d3a17287 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:37.801040 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c3461f-cf27-410a-a883-29c7d3a17287 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:37.816075 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3461f-cf27-410a-a883-29c7d3a17287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:37.817552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c3461f-cf27-410a-a883-29c7d3a17287 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:37.839757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-30c3461f-cf27-410a-a883-29c7d3a17287 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:37.839757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:37.839757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:37.839757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:37.839757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:37.839757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:37.839757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:37.839757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:37.839757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:37.839757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:37.839757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:37.839757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:37.839757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:37.839757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:37.839757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:37.839757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:37.840800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:37.840800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:37.840800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:37.840800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:37.840800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:37.840800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:37.840800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:37.840800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:37.840800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:37.840800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:37.840800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:37.840800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:37.840800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:37.840800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:37.840800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:37.840800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:37.840800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:37.841784 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:37.841784 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:37.841784 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:37.841784 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 486/980] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:37.846968 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3461f-cf27-410a-a883-29c7d3a17287 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:37.863543 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac1cce0-ffb1-4b96-aa6d-bb2089539892 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:37.908761 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec84dc5-1317-4dcb-849c-19517ba94afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:37.909414 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec84dc5-1317-4dcb-849c-19517ba94afb None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:37.909692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec84dc5-1317-4dcb-849c-19517ba94afb None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:37.910065 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec84dc5-1317-4dcb-849c-19517ba94afb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:37.910549 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec84dc5-1317-4dcb-849c-19517ba94afb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:37.912908 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec84dc5-1317-4dcb-849c-19517ba94afb None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:37.922692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-bec84dc5-1317-4dcb-849c-19517ba94afb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:51:37.922692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:37.922692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:51:37.922692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:51:37.922692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:51:37.922692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:51:37.922692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:51:37.922692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:37.922692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:51:37.922692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:37.922692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:51:37.922692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:37.922692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:37.922692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:37.922692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:37.922692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:37.922692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:37.923769 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:37.923769 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:37.923769 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:37.923769 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:37.923769 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:37.923769 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:37.923769 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:51:37.923769 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:51:37.923769 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:51:37.923769 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:51:37.923769 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:37.923769 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:37.923769 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:37.923769 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:37.923769 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:37.923769 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:37.924619 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:37.924619 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:37.924619 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:37.924619 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:37.924619 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:37.924619 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:37.924619 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:37.924619 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:37.924619 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:37.924619 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:37.924619 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:51:37.924619 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:37.924619 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:51:37.924619 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:37.924619 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 495/981] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Aug 24 16:51:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:51:37.930740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec84dc5-1317-4dcb-849c-19517ba94afb None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:37.972938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c3461f-cf27-410a-a883-29c7d3a17287 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:37.977216 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:37.988914 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:38.012072 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239aea8f-abc2-45ff-be3c-1a5b7086b221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:38.012753 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239aea8f-abc2-45ff-be3c-1a5b7086b221 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:38.013031 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239aea8f-abc2-45ff-be3c-1a5b7086b221 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:38.013311 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239aea8f-abc2-45ff-be3c-1a5b7086b221 None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:38.013962 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239aea8f-abc2-45ff-be3c-1a5b7086b221 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:38.014268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239aea8f-abc2-45ff-be3c-1a5b7086b221 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:38.015715 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239aea8f-abc2-45ff-be3c-1a5b7086b221 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:38.028691 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 487/982] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:38.034338 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239aea8f-abc2-45ff-be3c-1a5b7086b221 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:38.038655 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec84dc5-1317-4dcb-849c-19517ba94afb None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:38.079907 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6fe02-6734-4534-a5f2-f0c963fea312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:38.080576 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6fe02-6734-4534-a5f2-f0c963fea312 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:38.080850 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6fe02-6734-4534-a5f2-f0c963fea312 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:38.081121 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d6fe02-6734-4534-a5f2-f0c963fea312 None admin] PATH_INFO: `/v3/services` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:38.081753 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6fe02-6734-4534-a5f2-f0c963fea312 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:38.082059 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6fe02-6734-4534-a5f2-f0c963fea312 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:38.083744 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d6fe02-6734-4534-a5f2-f0c963fea312 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:38.089114 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 496/983] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Aug 24 16:51:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:38.094871 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6fe02-6734-4534-a5f2-f0c963fea312 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:38.151079 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239aea8f-abc2-45ff-be3c-1a5b7086b221 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:38.188966 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc3b738-aacb-43ce-8591-74e56d31b219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:38.189696 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3b738-aacb-43ce-8591-74e56d31b219 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:38.189977 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3b738-aacb-43ce-8591-74e56d31b219 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:38.190274 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc3b738-aacb-43ce-8591-74e56d31b219 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:38.197274 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc3b738-aacb-43ce-8591-74e56d31b219 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:38.198725 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc3b738-aacb-43ce-8591-74e56d31b219 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:38.211627 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d6fe02-6734-4534-a5f2-f0c963fea312 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:38.213493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-4fc3b738-aacb-43ce-8591-74e56d31b219 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:38.213493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:38.213493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:38.213493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:38.213493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:38.213493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:38.213493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:38.213493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:38.213493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:38.213493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:38.213493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:38.213493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:38.213493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:51:38.213493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:51:38.213493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:51:38.214558 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:51:38.214558 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:38.214558 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:38.214558 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:38.214558 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:38.214558 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:38.214558 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:38.214558 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:38.214558 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:38.214558 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:38.214558 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:38.214558 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:38.214558 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:38.214558 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:38.214558 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:38.214558 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:38.214558 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:38.215686 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:51:38.215686 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:51:38.215686 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:51:38.215686 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:51:38.215686 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:51:38.215686 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:51:38.215686 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:38.215686 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:38.217806 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:38.219573 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 488/984] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:51:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:51:38.220277 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc3b738-aacb-43ce-8591-74e56d31b219 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:38.250420 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e458cb-7aea-4ffd-9e8f-acfa8758174d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:38.251036 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e458cb-7aea-4ffd-9e8f-acfa8758174d None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:38.251339 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e458cb-7aea-4ffd-9e8f-acfa8758174d None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:38.251617 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e458cb-7aea-4ffd-9e8f-acfa8758174d None admin] PATH_INFO: `/v3/services` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:38.252245 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e458cb-7aea-4ffd-9e8f-acfa8758174d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:38.252548 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e458cb-7aea-4ffd-9e8f-acfa8758174d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:38.253900 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e458cb-7aea-4ffd-9e8f-acfa8758174d None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:38.257511 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:38.263605 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 497/985] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Aug 24 16:51:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:38.264752 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e458cb-7aea-4ffd-9e8f-acfa8758174d None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:38.333877 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc3b738-aacb-43ce-8591-74e56d31b219 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:38.375959 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e458cb-7aea-4ffd-9e8f-acfa8758174d None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:38.376935 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b41166-60b5-4624-9cf0-00fcc35ca942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:38.377637 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b41166-60b5-4624-9cf0-00fcc35ca942 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:38.377977 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b41166-60b5-4624-9cf0-00fcc35ca942 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:38.378338 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b41166-60b5-4624-9cf0-00fcc35ca942 None admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:38.379008 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b41166-60b5-4624-9cf0-00fcc35ca942 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:38.379344 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b41166-60b5-4624-9cf0-00fcc35ca942 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:38.381419 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b41166-60b5-4624-9cf0-00fcc35ca942 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:38.398378 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 489/986] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:51:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:38.408429 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b41166-60b5-4624-9cf0-00fcc35ca942 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:38.441045 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937b32e-17ab-49b2-a3ad-99e5e40cb55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:38.442384 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937b32e-17ab-49b2-a3ad-99e5e40cb55a None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:38.443698 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937b32e-17ab-49b2-a3ad-99e5e40cb55a None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:38.444233 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e937b32e-17ab-49b2-a3ad-99e5e40cb55a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:38.445123 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937b32e-17ab-49b2-a3ad-99e5e40cb55a None admin] RBAC: Adding query filter params (interface=admin, service_id=082889913f5d4069a104c4b0c9cbc42a, region_id=RegionOne) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:38.445745 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937b32e-17ab-49b2-a3ad-99e5e40cb55a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:38.448045 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e937b32e-17ab-49b2-a3ad-99e5e40cb55a None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:38.455207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 498/987] 10.222.0.55 () {56 vars in 1249 bytes} [Wed Aug 24 16:51:38 2022] GET /identity/v3/endpoints?service_id=082889913f5d4069a104c4b0c9cbc42a&interface=admin®ion_id=RegionOne => generated 193 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:38.461923 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937b32e-17ab-49b2-a3ad-99e5e40cb55a None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:38.505919 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:38.532844 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:38.541467 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b41166-60b5-4624-9cf0-00fcc35ca942 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:38.586945 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22168ced-0a8e-4274-a2bc-3dc7167b2a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:38.588217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22168ced-0a8e-4274-a2bc-3dc7167b2a63 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:38.588725 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22168ced-0a8e-4274-a2bc-3dc7167b2a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:38.589153 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22168ced-0a8e-4274-a2bc-3dc7167b2a63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:38.590026 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22168ced-0a8e-4274-a2bc-3dc7167b2a63 None admin] RBAC: Adding query filter params (role.id=c25ffa9ed2f3481697f2ff740bc34e8e, scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642, user.id=ae9fc5f06a0441da80e656fa1e88db5d) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:38.591003 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22168ced-0a8e-4274-a2bc-3dc7167b2a63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:38.592872 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22168ced-0a8e-4274-a2bc-3dc7167b2a63 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:38.602473 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 490/988] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:51:38 2022] GET /identity/v3/role_assignments?user.id=ae9fc5f06a0441da80e656fa1e88db5d&scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642&role.id=c25ffa9ed2f3481697f2ff740bc34e8e => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:38.608687 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e937b32e-17ab-49b2-a3ad-99e5e40cb55a None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:38.666690 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aed236-32ec-4dc5-bb9d-7a1bcb23208b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:38.667443 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aed236-32ec-4dc5-bb9d-7a1bcb23208b None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:38.667826 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aed236-32ec-4dc5-bb9d-7a1bcb23208b None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:38.668202 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aed236-32ec-4dc5-bb9d-7a1bcb23208b None admin] PATH_INFO: `/v3/services` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:38.668925 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aed236-32ec-4dc5-bb9d-7a1bcb23208b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:38.670435 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aed236-32ec-4dc5-bb9d-7a1bcb23208b None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:38.678433 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 499/989] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Aug 24 16:51:38 2022] GET /identity/v3/services => generated 1727 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:51:39.720976 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c795c-c790-40d4-81a7-d4bc19a5a70b None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:39.721557 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c795c-c790-40d4-81a7-d4bc19a5a70b None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:39.721557 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c795c-c790-40d4-81a7-d4bc19a5a70b None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:39.722947 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 491/990] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:39.729103 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3323ad1-ee01-49dc-bda4-984fb3f45cc9 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:39.729600 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3323ad1-ee01-49dc-bda4-984fb3f45cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:39.729705 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3323ad1-ee01-49dc-bda4-984fb3f45cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:39.749449 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-b3323ad1-ee01-49dc-bda4-984fb3f45cc9 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:39.750666 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-b3323ad1-ee01-49dc-bda4-984fb3f45cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:39.827747 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 500/991] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:39 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:51:40.101764 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c795c-c790-40d4-81a7-d4bc19a5a70b None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:40.212970 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c795c-c790-40d4-81a7-d4bc19a5a70b None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:40.249631 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad581290-a9fc-43ff-967b-563e6143fca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:40.250268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad581290-a9fc-43ff-967b-563e6143fca6 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:40.250546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad581290-a9fc-43ff-967b-563e6143fca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:40.250809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad581290-a9fc-43ff-967b-563e6143fca6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:40.251426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad581290-a9fc-43ff-967b-563e6143fca6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:40.252799 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad581290-a9fc-43ff-967b-563e6143fca6 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:40.262120 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-ad581290-a9fc-43ff-967b-563e6143fca6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 16:51:40.262120 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:40.262120 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:51:40.262120 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:51:40.262120 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:51:40.262120 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:51:40.262120 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:51:40.262120 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:40.262120 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 16:51:40.262120 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:40.262120 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:51:40.262120 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:40.262120 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:40.262120 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:40.262120 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:40.262120 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:40.262120 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:40.263500 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:40.263500 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:40.263500 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:40.263500 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:40.263500 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:40.263500 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:40.263500 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:51:40.263500 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:51:40.263500 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:51:40.263500 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:51:40.263500 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:40.263500 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:40.263500 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:40.263500 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:40.263500 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:40.263500 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:40.264371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:40.264371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:40.264371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:40.264371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:40.264371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:40.264371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:40.264371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:40.264371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:40.264371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:40.264371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:40.264371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:51:40.264371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:40.264371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 16:51:40.264371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:40.267449 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 492/992] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:51:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:40.269306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3323ad1-ee01-49dc-bda4-984fb3f45cc9 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:40.297698 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:40.374692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3323ad1-ee01-49dc-bda4-984fb3f45cc9 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:40.409874 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09113bc1-0181-4a61-bcb5-62a31d13d60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:40.410486 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09113bc1-0181-4a61-bcb5-62a31d13d60e None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:40.410768 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09113bc1-0181-4a61-bcb5-62a31d13d60e None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:40.411602 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09113bc1-0181-4a61-bcb5-62a31d13d60e None admin] PATH_INFO: `/v3/services` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:40.412584 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09113bc1-0181-4a61-bcb5-62a31d13d60e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:40.413036 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09113bc1-0181-4a61-bcb5-62a31d13d60e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:40.414409 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09113bc1-0181-4a61-bcb5-62a31d13d60e None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:40.424482 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 501/993] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Aug 24 16:51:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:40.425742 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad581290-a9fc-43ff-967b-563e6143fca6 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:40.453514 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:40.540293 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad581290-a9fc-43ff-967b-563e6143fca6 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:40.575127 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead636a6-d47f-482d-b0f6-fb2d3688b08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:40.575738 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead636a6-d47f-482d-b0f6-fb2d3688b08b None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:40.576017 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead636a6-d47f-482d-b0f6-fb2d3688b08b None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:40.576288 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead636a6-d47f-482d-b0f6-fb2d3688b08b None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:40.576923 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead636a6-d47f-482d-b0f6-fb2d3688b08b None admin] RBAC: Adding query filter params (type=compute) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:40.577223 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead636a6-d47f-482d-b0f6-fb2d3688b08b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:40.578588 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead636a6-d47f-482d-b0f6-fb2d3688b08b None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:40.589467 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 493/994] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Aug 24 16:51:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:40.590596 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09113bc1-0181-4a61-bcb5-62a31d13d60e None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:40.615413 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c342e16-cf40-4734-96a1-f0e028c83d06 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:40.615699 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c342e16-cf40-4734-96a1-f0e028c83d06 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:40.615977 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c342e16-cf40-4734-96a1-f0e028c83d06 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:40.617474 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 494/995] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:51:40.622959 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c7ea0-a933-477b-9f53-4327cac57b8a None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:40.623288 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c7ea0-a933-477b-9f53-4327cac57b8a None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:40.623588 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c7ea0-a933-477b-9f53-4327cac57b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:40.642162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-9a0c7ea0-a933-477b-9f53-4327cac57b8a None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:40.643306 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-9a0c7ea0-a933-477b-9f53-4327cac57b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:40.688844 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:40.698450 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09113bc1-0181-4a61-bcb5-62a31d13d60e None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:40.714888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 495/996] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:40 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:51:40.716380 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaee401-33e0-4c2b-b24d-564199b04aff None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:40.716660 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaee401-33e0-4c2b-b24d-564199b04aff None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:40.716934 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaee401-33e0-4c2b-b24d-564199b04aff None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:40.718233 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 496/997] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:40.726034 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7907723-8b49-4eda-8ab5-b5c7f2be49e3 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:40.726687 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7907723-8b49-4eda-8ab5-b5c7f2be49e3 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:40.726687 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7907723-8b49-4eda-8ab5-b5c7f2be49e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:40.736319 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8dc596-3261-4cd4-823c-0c3f1758cf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:40.737512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8dc596-3261-4cd4-823c-0c3f1758cf29 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:40.737945 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8dc596-3261-4cd4-823c-0c3f1758cf29 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:40.738490 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8dc596-3261-4cd4-823c-0c3f1758cf29 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:40.739621 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8dc596-3261-4cd4-823c-0c3f1758cf29 None admin] RBAC: Adding query filter params (interface=public, service_id=e07afdf98e654130b519d853dee2e4fd, region_id=RegionOne) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:40.740453 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8dc596-3261-4cd4-823c-0c3f1758cf29 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:40.742135 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8dc596-3261-4cd4-823c-0c3f1758cf29 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:40.747001 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-c7907723-8b49-4eda-8ab5-b5c7f2be49e3 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:40.748219 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-c7907723-8b49-4eda-8ab5-b5c7f2be49e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:40.748581 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 502/998] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Aug 24 16:51:40 2022] GET /identity/v3/endpoints?service_id=e07afdf98e654130b519d853dee2e4fd&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:40.753838 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8dc596-3261-4cd4-823c-0c3f1758cf29 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:40.762397 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:40.830285 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 497/999] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:40 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:51:40.881798 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8dc596-3261-4cd4-823c-0c3f1758cf29 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:40.917713 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccccda7-22f3-4304-a188-470a4f284478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:40.918257 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccccda7-22f3-4304-a188-470a4f284478 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:40.918530 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccccda7-22f3-4304-a188-470a4f284478 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:40.918800 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccccda7-22f3-4304-a188-470a4f284478 None admin] PATH_INFO: `/v3/services` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:40.919424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccccda7-22f3-4304-a188-470a4f284478 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:40.920769 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccccda7-22f3-4304-a188-470a4f284478 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:40.928276 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 503/1000] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Aug 24 16:51:40 2022] GET /identity/v3/services => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 16:51:40.992190 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7907723-8b49-4eda-8ab5-b5c7f2be49e3 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:41.106937 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccccda7-22f3-4304-a188-470a4f284478 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:41.117255 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7907723-8b49-4eda-8ab5-b5c7f2be49e3 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:41.132279 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:41.158223 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d2014-4e56-431a-a654-4da5c6f91650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:41.158991 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d2014-4e56-431a-a654-4da5c6f91650 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:41.159299 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d2014-4e56-431a-a654-4da5c6f91650 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:41.159574 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d2014-4e56-431a-a654-4da5c6f91650 None admin] PATH_INFO: `/v3/services/image` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:41.160333 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d2014-4e56-431a-a654-4da5c6f91650 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:41.163426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d2014-4e56-431a-a654-4da5c6f91650 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:41.175297 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-158d2014-4e56-431a-a654-4da5c6f91650 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 16:51:41.175297 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:41.175297 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:51:41.175297 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:51:41.175297 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:51:41.175297 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:51:41.175297 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:51:41.175297 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:41.175297 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 16:51:41.175297 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:41.175297 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:51:41.175297 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:41.175297 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:41.175297 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:41.175297 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:41.175297 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:41.175297 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:41.176371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:41.176371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:41.176371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:41.176371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:41.176371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:41.176371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:41.176371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:51:41.176371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:51:41.176371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:51:41.176371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:51:41.176371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:41.176371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:41.176371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:41.176371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:41.176371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:41.176371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:41.177963 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:41.177963 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:41.177963 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:41.177963 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:41.177963 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:41.177963 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:41.177963 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:41.177963 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:41.177963 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:41.177963 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:41.177963 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:51:41.177963 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:41.177963 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 16:51:41.177963 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:41.177963 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 498/1001] 10.222.0.55 () {56 vars in 1105 bytes} [Wed Aug 24 16:51:40 2022] GET /identity/v3/services/image => generated 86 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:41.183806 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d2014-4e56-431a-a654-4da5c6f91650 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:41.198149 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:41.229512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccccda7-22f3-4304-a188-470a4f284478 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:41.265784 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf8c97-e680-4c01-a73e-fa81d3f6d897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:41.266424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf8c97-e680-4c01-a73e-fa81d3f6d897 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:41.266706 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf8c97-e680-4c01-a73e-fa81d3f6d897 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:41.266981 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf8c97-e680-4c01-a73e-fa81d3f6d897 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:41.267625 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf8c97-e680-4c01-a73e-fa81d3f6d897 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:41.269001 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf8c97-e680-4c01-a73e-fa81d3f6d897 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:41.278631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-1acf8c97-e680-4c01-a73e-fa81d3f6d897 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:51:41.278631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:41.278631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:51:41.278631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:51:41.278631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:51:41.278631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:51:41.278631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:51:41.278631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:41.278631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:51:41.278631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:41.278631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:51:41.278631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:41.278631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:41.278631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:41.278631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:41.278631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:41.278631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:41.279737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:41.279737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:41.279737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:41.279737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:41.279737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:41.279737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:41.279737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:51:41.279737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:51:41.279737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:51:41.279737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:51:41.279737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:41.279737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:41.279737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:41.279737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:41.279737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:41.279737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:41.280575 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:41.280575 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:41.280575 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:41.280575 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:41.280575 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:41.280575 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:41.280575 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:41.280575 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:41.280575 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:41.280575 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:41.280575 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:51:41.280575 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:41.280575 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 16:51:41.280575 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:41.280575 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 504/1002] 10.222.0.55 () {56 vars in 1126 bytes} [Wed Aug 24 16:51:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:41.285644 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf8c97-e680-4c01-a73e-fa81d3f6d897 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:41.304367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d2014-4e56-431a-a654-4da5c6f91650 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:41.346854 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb9549-3fe2-46a0-8c5f-5cd28d778abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:41.347497 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb9549-3fe2-46a0-8c5f-5cd28d778abb None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:41.347781 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb9549-3fe2-46a0-8c5f-5cd28d778abb None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:41.348053 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb9549-3fe2-46a0-8c5f-5cd28d778abb None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:41.348736 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb9549-3fe2-46a0-8c5f-5cd28d778abb None admin] RBAC: Adding query filter params (name=image) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:41.349110 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb9549-3fe2-46a0-8c5f-5cd28d778abb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:41.350634 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb9549-3fe2-46a0-8c5f-5cd28d778abb None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:41.355984 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 499/1003] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:41.361530 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb9549-3fe2-46a0-8c5f-5cd28d778abb None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:41.378740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:41.403374 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf8c97-e680-4c01-a73e-fa81d3f6d897 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:41.445458 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:41.445662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b55dd7-98ef-4ec1-9b1a-9d732b080d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:41.446201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b55dd7-98ef-4ec1-9b1a-9d732b080d78 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:41.446481 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b55dd7-98ef-4ec1-9b1a-9d732b080d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:41.446820 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b55dd7-98ef-4ec1-9b1a-9d732b080d78 None admin] PATH_INFO: `/v3/services` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:41.447931 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b55dd7-98ef-4ec1-9b1a-9d732b080d78 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:41.448180 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b55dd7-98ef-4ec1-9b1a-9d732b080d78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:41.450074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b55dd7-98ef-4ec1-9b1a-9d732b080d78 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:41.460799 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 505/1004] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Aug 24 16:51:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:41.461953 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b55dd7-98ef-4ec1-9b1a-9d732b080d78 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:41.484987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb9549-3fe2-46a0-8c5f-5cd28d778abb None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:41.525909 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83843d-c8d5-4c46-8de0-dbb60a308139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:41.526660 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83843d-c8d5-4c46-8de0-dbb60a308139 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:41.527070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83843d-c8d5-4c46-8de0-dbb60a308139 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:41.527373 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d83843d-c8d5-4c46-8de0-dbb60a308139 None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:41.528166 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83843d-c8d5-4c46-8de0-dbb60a308139 None admin] RBAC: Adding query filter params (type=image) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:41.528471 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83843d-c8d5-4c46-8de0-dbb60a308139 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:41.530445 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d83843d-c8d5-4c46-8de0-dbb60a308139 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:41.535999 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 500/1005] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:41 2022] GET /identity/v3/services?type=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:41.585073 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b55dd7-98ef-4ec1-9b1a-9d732b080d78 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:41.627623 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455c97d-4ecf-4ea8-8d3e-d29a75bfed7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:41.628245 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455c97d-4ecf-4ea8-8d3e-d29a75bfed7b None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:41.628523 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455c97d-4ecf-4ea8-8d3e-d29a75bfed7b None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:41.628794 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455c97d-4ecf-4ea8-8d3e-d29a75bfed7b None admin] PATH_INFO: `/v3/services` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:41.629440 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455c97d-4ecf-4ea8-8d3e-d29a75bfed7b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:41.630221 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455c97d-4ecf-4ea8-8d3e-d29a75bfed7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:41.631656 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455c97d-4ecf-4ea8-8d3e-d29a75bfed7b None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:41.641982 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 506/1006] 10.222.0.55 () {56 vars in 1122 bytes} [Wed Aug 24 16:51:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:41.643568 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83843d-c8d5-4c46-8de0-dbb60a308139 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:41.754577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d83843d-c8d5-4c46-8de0-dbb60a308139 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:41.790252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d6d38-9137-4b04-bd90-3f9500992cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:41.790878 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d6d38-9137-4b04-bd90-3f9500992cb6 None admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:41.791190 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d6d38-9137-4b04-bd90-3f9500992cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:41.791470 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d6d38-9137-4b04-bd90-3f9500992cb6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:41.792140 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d6d38-9137-4b04-bd90-3f9500992cb6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:41.793528 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d6d38-9137-4b04-bd90-3f9500992cb6 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:41.884554 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:41.897403 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 501/1007] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 16:51:41 2022] POST /identity/v3/endpoints => generated 325 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:51:42.905863 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec02ded-bb3e-4e75-9356-74f1e554d415 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:42.906383 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec02ded-bb3e-4e75-9356-74f1e554d415 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:42.906513 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec02ded-bb3e-4e75-9356-74f1e554d415 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:42.907985 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 507/1008] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:42.914026 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa7987-80a5-4517-a10f-9c2b4a42c602 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:42.914541 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa7987-80a5-4517-a10f-9c2b4a42c602 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:42.914621 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa7987-80a5-4517-a10f-9c2b4a42c602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:42.933317 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-84fa7987-80a5-4517-a10f-9c2b4a42c602 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:42.934780 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-84fa7987-80a5-4517-a10f-9c2b4a42c602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:43.016044 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 502/1009] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:42 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:51:43.288202 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec02ded-bb3e-4e75-9356-74f1e554d415 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:43.301448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:43.396776 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec02ded-bb3e-4e75-9356-74f1e554d415 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:43.433734 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102f084-fa94-4fba-800b-435d02cdaf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:43.434649 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102f084-fa94-4fba-800b-435d02cdaf2f None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:43.435002 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102f084-fa94-4fba-800b-435d02cdaf2f None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:43.435259 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102f084-fa94-4fba-800b-435d02cdaf2f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:43.435855 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102f084-fa94-4fba-800b-435d02cdaf2f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:43.437235 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102f084-fa94-4fba-800b-435d02cdaf2f None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:43.446536 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-a102f084-fa94-4fba-800b-435d02cdaf2f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 16:51:43.446536 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:43.446536 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:51:43.446536 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:51:43.446536 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:51:43.446536 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:51:43.446536 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:51:43.446536 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:43.446536 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 16:51:43.446536 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:43.446536 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:51:43.446536 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:43.446536 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:43.446536 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:43.446536 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:43.446536 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:43.446536 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:43.447845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:43.447845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:43.447845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:43.447845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:43.447845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:43.447845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:43.447845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:51:43.447845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:51:43.447845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:51:43.447845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:51:43.447845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:43.447845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:43.447845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:43.447845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:43.447845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:43.447845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:43.448728 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:43.448728 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:43.448728 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:43.448728 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:43.448728 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:43.448728 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:43.448728 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:43.448728 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:43.448728 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:43.448728 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:43.448728 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:51:43.448728 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:43.448728 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 16:51:43.448728 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:43.452592 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 508/1010] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:51:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:51:43.454149 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa7987-80a5-4517-a10f-9c2b4a42c602 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:43.479000 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425b230-4172-48e4-a8e5-4e4c908df71c None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:43.479395 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425b230-4172-48e4-a8e5-4e4c908df71c None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:43.479680 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7425b230-4172-48e4-a8e5-4e4c908df71c None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:43.481151 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 509/1011] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:51:43.486843 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13122732-b046-4f9a-ab43-7b127b57b5ed None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:43.487168 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13122732-b046-4f9a-ab43-7b127b57b5ed None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:43.487426 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13122732-b046-4f9a-ab43-7b127b57b5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:43.506159 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-13122732-b046-4f9a-ab43-7b127b57b5ed None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:43.507420 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-13122732-b046-4f9a-ab43-7b127b57b5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:43.565956 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa7987-80a5-4517-a10f-9c2b4a42c602 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:43.580947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 510/1012] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:43 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:51:43.598160 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:43.609993 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f48e21-e231-4971-b839-c175e1d1a98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:43.610609 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f48e21-e231-4971-b839-c175e1d1a98e None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:43.612640 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f48e21-e231-4971-b839-c175e1d1a98e None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:43.612640 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f48e21-e231-4971-b839-c175e1d1a98e None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:43.612640 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f48e21-e231-4971-b839-c175e1d1a98e None admin] RBAC: Adding query filter params (name=compute) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:43.612640 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f48e21-e231-4971-b839-c175e1d1a98e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:43.613558 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f48e21-e231-4971-b839-c175e1d1a98e None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:43.623000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 503/1013] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Aug 24 16:51:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:43.624515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13122732-b046-4f9a-ab43-7b127b57b5ed None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:43.628344 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:43.735525 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13122732-b046-4f9a-ab43-7b127b57b5ed None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:43.770986 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a5906-a930-4e49-9efc-a86536c725eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:43.771705 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a5906-a930-4e49-9efc-a86536c725eb None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:43.771986 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a5906-a930-4e49-9efc-a86536c725eb None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:43.772255 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a5906-a930-4e49-9efc-a86536c725eb None admin] PATH_INFO: `/v3/services` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:43.772893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a5906-a930-4e49-9efc-a86536c725eb None admin] RBAC: Adding query filter params (type=compute) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:43.773194 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a5906-a930-4e49-9efc-a86536c725eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:43.774567 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a5906-a930-4e49-9efc-a86536c725eb None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:43.780459 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 511/1014] 10.222.0.55 () {56 vars in 1112 bytes} [Wed Aug 24 16:51:43 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:43.786540 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f48e21-e231-4971-b839-c175e1d1a98e None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:43.830012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace2c2d-49ed-483c-90e2-4a4c9dded9d4 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:43.830367 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace2c2d-49ed-483c-90e2-4a4c9dded9d4 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:43.830746 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace2c2d-49ed-483c-90e2-4a4c9dded9d4 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:43.832207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 512/1015] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:51:43.838786 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d4810-9afa-497c-a5fc-e4d727dab00e None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:43.839075 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d4810-9afa-497c-a5fc-e4d727dab00e None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:43.839379 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d4810-9afa-497c-a5fc-e4d727dab00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:43.858523 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-751d4810-9afa-497c-a5fc-e4d727dab00e None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:43.859847 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-751d4810-9afa-497c-a5fc-e4d727dab00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:43.895087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f48e21-e231-4971-b839-c175e1d1a98e None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:43.927696 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:43.933533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 513/1016] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:43 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:51:43.934583 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d4810-9afa-497c-a5fc-e4d727dab00e None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:43.938198 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044423a-8ae4-4b94-b8b0-4dbb9d8de1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:43.938198 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044423a-8ae4-4b94-b8b0-4dbb9d8de1bf None admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:43.938793 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044423a-8ae4-4b94-b8b0-4dbb9d8de1bf None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:43.938793 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044423a-8ae4-4b94-b8b0-4dbb9d8de1bf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:43.949675 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044423a-8ae4-4b94-b8b0-4dbb9d8de1bf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:43.949675 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044423a-8ae4-4b94-b8b0-4dbb9d8de1bf None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:44.031901 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 504/1017] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 16:51:43 2022] POST /identity/v3/endpoints => generated 334 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:51:44.044370 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d4810-9afa-497c-a5fc-e4d727dab00e None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:44.094172 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01404f3-fa33-4f97-8a0a-37267b628df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:44.094721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01404f3-fa33-4f97-8a0a-37267b628df0 None admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:44.094999 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01404f3-fa33-4f97-8a0a-37267b628df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:44.095306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01404f3-fa33-4f97-8a0a-37267b628df0 None admin] PATH_INFO: `/v3/services` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:44.095966 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01404f3-fa33-4f97-8a0a-37267b628df0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:44.097377 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01404f3-fa33-4f97-8a0a-37267b628df0 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:44.174277 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 514/1018] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Aug 24 16:51:43 2022] POST /identity/v3/services => generated 242 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:51:44.208604 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044423a-8ae4-4b94-b8b0-4dbb9d8de1bf None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:44.266804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:44.345284 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044423a-8ae4-4b94-b8b0-4dbb9d8de1bf None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:44.405007 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75314bda-59d2-40c1-9034-2e71320a7c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:44.405751 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75314bda-59d2-40c1-9034-2e71320a7c1a None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:44.406036 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75314bda-59d2-40c1-9034-2e71320a7c1a None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:44.406370 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75314bda-59d2-40c1-9034-2e71320a7c1a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:44.407729 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75314bda-59d2-40c1-9034-2e71320a7c1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:44.409589 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75314bda-59d2-40c1-9034-2e71320a7c1a None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:44.415207 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 505/1019] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:44.419948 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01404f3-fa33-4f97-8a0a-37267b628df0 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:44.483062 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:44.544968 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01404f3-fa33-4f97-8a0a-37267b628df0 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:44.582721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d581cf9-2dd7-4cba-8868-274df6a22598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:44.583777 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d581cf9-2dd7-4cba-8868-274df6a22598 None admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:44.584333 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d581cf9-2dd7-4cba-8868-274df6a22598 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:44.584748 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d581cf9-2dd7-4cba-8868-274df6a22598 None admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:44.585546 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d581cf9-2dd7-4cba-8868-274df6a22598 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:44.587201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d581cf9-2dd7-4cba-8868-274df6a22598 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:44.673349 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 515/1020] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Aug 24 16:51:44 2022] POST /identity/v3/projects => generated 311 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:51:46.129005 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f4aee-e4bd-46ef-af02-95f131c4b668 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:46.129526 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f4aee-e4bd-46ef-af02-95f131c4b668 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:46.129526 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f4aee-e4bd-46ef-af02-95f131c4b668 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:46.131055 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 506/1021] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:51:46.136279 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2ebbf-e03e-43bc-b6fd-ee07df485925 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:46.136699 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2ebbf-e03e-43bc-b6fd-ee07df485925 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:46.136885 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2ebbf-e03e-43bc-b6fd-ee07df485925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:46.151697 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b7c70-28e2-43b3-b062-45269251128c None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:46.152002 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b7c70-28e2-43b3-b062-45269251128c None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:46.152228 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99b7c70-28e2-43b3-b062-45269251128c None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:46.153713 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 507/1022] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:51:46.155459 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-60f2ebbf-e03e-43bc-b6fd-ee07df485925 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:46.156665 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-60f2ebbf-e03e-43bc-b6fd-ee07df485925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:46.158915 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3321d4-ca94-4a03-b4ed-db6017391588 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:46.159521 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3321d4-ca94-4a03-b4ed-db6017391588 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:46.159808 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3321d4-ca94-4a03-b4ed-db6017391588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:46.182258 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-0f3321d4-ca94-4a03-b4ed-db6017391588 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:46.183527 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-0f3321d4-ca94-4a03-b4ed-db6017391588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:46.239854 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 516/1023] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:51:46.254008 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 508/1024] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:51:46.493983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2ebbf-e03e-43bc-b6fd-ee07df485925 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:46.526563 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3321d4-ca94-4a03-b4ed-db6017391588 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:46.531306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:46.575452 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:46.610927 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2ebbf-e03e-43bc-b6fd-ee07df485925 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:46.648546 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf919999-9d7f-44b5-a1df-698a7d39d275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:46.649484 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf919999-9d7f-44b5-a1df-698a7d39d275 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:46.649951 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf919999-9d7f-44b5-a1df-698a7d39d275 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:46.650225 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf919999-9d7f-44b5-a1df-698a7d39d275 None admin] PATH_INFO: `/v3/services/image` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:46.650819 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf919999-9d7f-44b5-a1df-698a7d39d275 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:46.652223 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf919999-9d7f-44b5-a1df-698a7d39d275 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:46.652553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3321d4-ca94-4a03-b4ed-db6017391588 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:46.662335 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-bf919999-9d7f-44b5-a1df-698a7d39d275 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 16:51:46.662335 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:46.662335 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:51:46.662335 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:51:46.662335 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:51:46.662335 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:51:46.662335 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:51:46.662335 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:46.662335 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 16:51:46.662335 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:46.662335 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:51:46.662335 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:46.662335 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:46.662335 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:46.662335 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:46.662335 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:46.662335 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:46.663464 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:46.663464 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:46.663464 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:46.663464 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:46.663464 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:46.663464 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:46.663464 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:51:46.663464 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:51:46.663464 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:51:46.663464 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:51:46.663464 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:46.663464 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:46.663464 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:46.663464 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:46.663464 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:46.663464 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:46.664310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:46.664310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:46.664310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:46.664310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:46.664310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:46.664310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:46.664310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:46.664310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:46.664310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:46.664310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:46.664310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:51:46.664310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:46.664310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 16:51:46.664310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:46.664310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 517/1025] 10.222.0.55 () {56 vars in 1105 bytes} [Wed Aug 24 16:51:46 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:46.669591 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf919999-9d7f-44b5-a1df-698a7d39d275 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:46.692879 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b369107-fe9d-4501-8045-02b40549ac52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:46.693952 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b369107-fe9d-4501-8045-02b40549ac52 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:46.694459 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b369107-fe9d-4501-8045-02b40549ac52 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:46.694961 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b369107-fe9d-4501-8045-02b40549ac52 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:46.707329 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b369107-fe9d-4501-8045-02b40549ac52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:51:46.713865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-1b369107-fe9d-4501-8045-02b40549ac52 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:51:46.713865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:46.713865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:46.713865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:46.713865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:46.713865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:46.713865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:46.713865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:46.713865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:46.713865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:46.713865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:46.713865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:46.713865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:51:46.713865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:51:46.713865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:51:46.713865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:51:46.714847 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:51:46.714847 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:51:46.714847 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:51:46.714847 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:51:46.714847 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:46.714847 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:46.714847 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:46.714847 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:46.714847 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:46.714847 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:46.714847 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:46.714847 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:46.714847 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:46.714847 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:46.714847 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:46.714847 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:46.716885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:46.716885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:46.716885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:46.716885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:46.716885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:51:46.716885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:51:46.716885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:51:46.716885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:51:46.716885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:51:46.716885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:51:46.716885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:51:46.716885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:46.716885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 509/1026] 10.222.0.55 () {56 vars in 1120 bytes} [Wed Aug 24 16:51:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:51:46.716885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32774157-9580-42e4-88c6-c40589e35759 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:46.717692 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32774157-9580-42e4-88c6-c40589e35759 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:46.717763 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32774157-9580-42e4-88c6-c40589e35759 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:46.719500 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 510/1027] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:46.720920 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32774157-9580-42e4-88c6-c40589e35759 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:46.777126 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:46.780260 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf919999-9d7f-44b5-a1df-698a7d39d275 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:46.815654 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ca405-1f35-41a3-81f5-6a85a8585279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:46.816268 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ca405-1f35-41a3-81f5-6a85a8585279 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:46.816541 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ca405-1f35-41a3-81f5-6a85a8585279 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:46.817302 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ca405-1f35-41a3-81f5-6a85a8585279 None admin] PATH_INFO: `/v3/services` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:46.817931 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ca405-1f35-41a3-81f5-6a85a8585279 None admin] RBAC: Adding query filter params (name=image) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:46.818304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ca405-1f35-41a3-81f5-6a85a8585279 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:46.819786 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ca405-1f35-41a3-81f5-6a85a8585279 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:46.825006 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 518/1028] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:46.826179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcfcb9-e97b-400e-9fad-01e178a21049 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:46.826459 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcfcb9-e97b-400e-9fad-01e178a21049 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:46.826724 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddcfcb9-e97b-400e-9fad-01e178a21049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:46.828829 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:46.834831 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32774157-9580-42e4-88c6-c40589e35759 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:46.845083 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-bddcfcb9-e97b-400e-9fad-01e178a21049 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:46.846296 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-bddcfcb9-e97b-400e-9fad-01e178a21049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:46.870414 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705cef8d-565e-4412-a3ea-e90144739256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:46.871035 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cef8d-565e-4412-a3ea-e90144739256 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:46.871348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cef8d-565e-4412-a3ea-e90144739256 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:46.871624 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705cef8d-565e-4412-a3ea-e90144739256 None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:46.872302 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705cef8d-565e-4412-a3ea-e90144739256 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:46.872610 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705cef8d-565e-4412-a3ea-e90144739256 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:46.873995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705cef8d-565e-4412-a3ea-e90144739256 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:46.887147 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 511/1029] 10.222.0.55 () {56 vars in 1115 bytes} [Wed Aug 24 16:51:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:46.887147 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705cef8d-565e-4412-a3ea-e90144739256 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:46.919892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 519/1030] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:51:46.920801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddcfcb9-e97b-400e-9fad-01e178a21049 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:46.993764 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705cef8d-565e-4412-a3ea-e90144739256 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:47.029191 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:47.035266 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93555b58-c2e4-42c5-ab5f-aecb6e83b19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:47.036464 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93555b58-c2e4-42c5-ab5f-aecb6e83b19a None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:47.036649 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddcfcb9-e97b-400e-9fad-01e178a21049 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:47.036749 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93555b58-c2e4-42c5-ab5f-aecb6e83b19a None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:47.036998 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93555b58-c2e4-42c5-ab5f-aecb6e83b19a None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:47.037637 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93555b58-c2e4-42c5-ab5f-aecb6e83b19a None admin] RBAC: Adding query filter params (type=image) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:47.037941 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93555b58-c2e4-42c5-ab5f-aecb6e83b19a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:47.039390 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93555b58-c2e4-42c5-ab5f-aecb6e83b19a None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:47.044787 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 512/1031] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:47.050896 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93555b58-c2e4-42c5-ab5f-aecb6e83b19a None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:47.074217 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e23be-b3f3-4408-a35a-2a19033e8f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:47.074874 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e23be-b3f3-4408-a35a-2a19033e8f8e None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:47.075180 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e23be-b3f3-4408-a35a-2a19033e8f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:47.075458 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e23be-b3f3-4408-a35a-2a19033e8f8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:47.079205 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:47.086560 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e23be-b3f3-4408-a35a-2a19033e8f8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:47.096466 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e23be-b3f3-4408-a35a-2a19033e8f8e None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:47.105154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-108e23be-b3f3-4408-a35a-2a19033e8f8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:47.105154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:47.105154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:47.105154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:47.105154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:47.105154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:47.105154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:47.105154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:47.105154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:47.105154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:47.105154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:47.105154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:47.105154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:47.105154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:47.105154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:47.105154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:47.106130 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:47.106130 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:47.106130 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:47.106130 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:47.106130 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:47.106130 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:47.106130 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:47.106130 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:47.106130 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:47.106130 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:47.106130 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:47.106130 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:47.106130 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:47.106130 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:47.106130 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:47.106130 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:47.106130 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:47.107050 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:47.107050 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:47.107050 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:47.107050 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 520/1032] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:47.112035 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e23be-b3f3-4408-a35a-2a19033e8f8e None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:47.168681 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93555b58-c2e4-42c5-ab5f-aecb6e83b19a None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:47.205616 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8199d-b3de-4743-b623-a1241452247c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:47.206254 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8199d-b3de-4743-b623-a1241452247c None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:47.206537 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8199d-b3de-4743-b623-a1241452247c None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:47.206814 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d8199d-b3de-4743-b623-a1241452247c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:47.208126 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d8199d-b3de-4743-b623-a1241452247c None admin] RBAC: Adding query filter params (interface=public, service_id=68b42f7aaccc4e32afda084b9886fcb9, region_id=RegionOne) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:47.208437 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d8199d-b3de-4743-b623-a1241452247c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:47.209821 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d8199d-b3de-4743-b623-a1241452247c None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:47.215223 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 513/1033] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Aug 24 16:51:47 2022] GET /identity/v3/endpoints?service_id=68b42f7aaccc4e32afda084b9886fcb9&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:47.216014 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8199d-b3de-4743-b623-a1241452247c None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:47.224322 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e23be-b3f3-4408-a35a-2a19033e8f8e None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:47.261287 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b513a-9490-42c9-8a5c-8242538a5314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:47.261898 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b513a-9490-42c9-8a5c-8242538a5314 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:47.262170 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b513a-9490-42c9-8a5c-8242538a5314 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:47.262439 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b513a-9490-42c9-8a5c-8242538a5314 None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:47.263130 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b513a-9490-42c9-8a5c-8242538a5314 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:47.263512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b513a-9490-42c9-8a5c-8242538a5314 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:47.264819 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02b513a-9490-42c9-8a5c-8242538a5314 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:47.278479 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 521/1034] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:47.279182 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b513a-9490-42c9-8a5c-8242538a5314 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:47.288339 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:47.318233 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:47.330365 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d8199d-b3de-4743-b623-a1241452247c None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:47.364670 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955ef85-442f-4b20-a227-3a03e0acc9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:47.365304 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955ef85-442f-4b20-a227-3a03e0acc9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:47.365578 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955ef85-442f-4b20-a227-3a03e0acc9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:47.365895 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955ef85-442f-4b20-a227-3a03e0acc9a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:47.367593 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955ef85-442f-4b20-a227-3a03e0acc9a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:47.369633 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6955ef85-442f-4b20-a227-3a03e0acc9a9 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:47.371587 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 514/1035] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:47.372191 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955ef85-442f-4b20-a227-3a03e0acc9a9 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:47.384880 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02b513a-9490-42c9-8a5c-8242538a5314 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:47.420620 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955c78f-1d6d-4d7d-a969-879175af543f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:47.421228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955c78f-1d6d-4d7d-a969-879175af543f None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:47.421504 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955c78f-1d6d-4d7d-a969-879175af543f None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:47.421776 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955c78f-1d6d-4d7d-a969-879175af543f None admin] PATH_INFO: `/v3/services` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:47.422391 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955c78f-1d6d-4d7d-a969-879175af543f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:47.423798 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955c78f-1d6d-4d7d-a969-879175af543f None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:47.430353 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 522/1036] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Aug 24 16:51:47 2022] GET /identity/v3/services => generated 1957 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:51:47.431154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955c78f-1d6d-4d7d-a969-879175af543f None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:47.482902 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955ef85-442f-4b20-a227-3a03e0acc9a9 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:47.509563 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:47.526104 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a894ee0-6b61-4c1e-95dd-88db54fe2c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:47.526104 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a894ee0-6b61-4c1e-95dd-88db54fe2c97 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:47.526104 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a894ee0-6b61-4c1e-95dd-88db54fe2c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:47.526104 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a894ee0-6b61-4c1e-95dd-88db54fe2c97 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:47.533806 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a894ee0-6b61-4c1e-95dd-88db54fe2c97 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:47.535309 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a894ee0-6b61-4c1e-95dd-88db54fe2c97 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:47.549070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-4a894ee0-6b61-4c1e-95dd-88db54fe2c97 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:51:47.549070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:47.549070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:47.549070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:47.549070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:47.549070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:47.549070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:47.549070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:47.549070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:47.549070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:47.549070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:47.549070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:47.549070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:51:47.549070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:51:47.549070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:51:47.549070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:51:47.550320 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:47.550320 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:47.550320 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:51:47.550320 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:47.550320 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:51:47.550320 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:47.550320 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:47.550320 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:47.550320 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:47.550320 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:47.550320 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:47.550320 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:47.550320 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:47.550320 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:47.550320 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:47.550320 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:47.550320 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:47.550320 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:47.551858 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:47.551858 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:47.551858 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:51:47.551858 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:51:47.551858 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:51:47.551858 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:51:47.551858 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:51:47.551858 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:51:47.551858 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:51:47.551858 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:47.551858 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 515/1037] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Aug 24 16:51:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:47.557234 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a894ee0-6b61-4c1e-95dd-88db54fe2c97 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:47.557419 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955c78f-1d6d-4d7d-a969-879175af543f None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:47.577992 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:47.602817 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c755e7-5308-46d4-bbe3-b4a34d31df02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:47.603530 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c755e7-5308-46d4-bbe3-b4a34d31df02 None admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:47.603814 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c755e7-5308-46d4-bbe3-b4a34d31df02 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:47.604088 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c755e7-5308-46d4-bbe3-b4a34d31df02 None admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:47.604783 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c755e7-5308-46d4-bbe3-b4a34d31df02 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:47.606304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c755e7-5308-46d4-bbe3-b4a34d31df02 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:47.673894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a894ee0-6b61-4c1e-95dd-88db54fe2c97 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:47.722217 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 523/1038] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Aug 24 16:51:47 2022] POST /identity/v3/users => generated 285 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:51:47.732191 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2220d96-bba6-4e50-8619-80a8482c9f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:47.732834 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2220d96-bba6-4e50-8619-80a8482c9f58 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:47.733128 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2220d96-bba6-4e50-8619-80a8482c9f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:47.733388 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2220d96-bba6-4e50-8619-80a8482c9f58 None admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:47.734197 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2220d96-bba6-4e50-8619-80a8482c9f58 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:47.734506 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2220d96-bba6-4e50-8619-80a8482c9f58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:47.736161 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2220d96-bba6-4e50-8619-80a8482c9f58 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:47.759214 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 516/1039] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Aug 24 16:51:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:47.764901 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c755e7-5308-46d4-bbe3-b4a34d31df02 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:47.903075 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c755e7-5308-46d4-bbe3-b4a34d31df02 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:47.933395 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:47.945591 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9baa96-a5d6-4035-9453-01b357a5b928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:47.946245 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9baa96-a5d6-4035-9453-01b357a5b928 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:47.946532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9baa96-a5d6-4035-9453-01b357a5b928 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:47.946812 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9baa96-a5d6-4035-9453-01b357a5b928 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:48.031832 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9baa96-a5d6-4035-9453-01b357a5b928 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:48.033363 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9baa96-a5d6-4035-9453-01b357a5b928 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:48.157782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 524/1040] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:51:47 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:51:48.163834 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2220d96-bba6-4e50-8619-80a8482c9f58 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:48.260260 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:48.289476 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2220d96-bba6-4e50-8619-80a8482c9f58 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:48.327652 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d0c24-91df-4392-a5e3-9c11efc61f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:48.328102 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d0c24-91df-4392-a5e3-9c11efc61f22 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:48.328326 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d0c24-91df-4392-a5e3-9c11efc61f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:48.328600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d0c24-91df-4392-a5e3-9c11efc61f22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:48.339700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d0c24-91df-4392-a5e3-9c11efc61f22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:48.341174 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d0c24-91df-4392-a5e3-9c11efc61f22 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:48.356865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-815d0c24-91df-4392-a5e3-9c11efc61f22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:48.356865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:48.356865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:48.356865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:48.356865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:48.356865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:48.356865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:48.356865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:48.356865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:48.356865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:48.356865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:48.356865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:48.356865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:48.356865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:48.356865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:48.356865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:48.357978 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:48.357978 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:48.357978 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:48.357978 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:48.357978 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:48.357978 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:48.357978 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:48.357978 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:48.357978 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:48.357978 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:48.357978 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:48.357978 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:48.357978 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:48.357978 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:48.357978 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:48.357978 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:48.357978 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:48.359392 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:48.359392 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:48.359392 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:48.359841 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 517/1041] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:48.364556 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9baa96-a5d6-4035-9453-01b357a5b928 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:48.393093 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:48.486944 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9baa96-a5d6-4035-9453-01b357a5b928 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:48.529033 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2ec6f-7d0d-45f9-b7df-2b237537ffc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:48.529378 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2ec6f-7d0d-45f9-b7df-2b237537ffc6 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:48.529610 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2ec6f-7d0d-45f9-b7df-2b237537ffc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:48.530466 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2ec6f-7d0d-45f9-b7df-2b237537ffc6 None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:48.530575 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2ec6f-7d0d-45f9-b7df-2b237537ffc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:48.530859 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2ec6f-7d0d-45f9-b7df-2b237537ffc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:48.532196 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2ec6f-7d0d-45f9-b7df-2b237537ffc6 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:48.545572 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 525/1042] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:48.551274 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d0c24-91df-4392-a5e3-9c11efc61f22 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:48.673618 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d0c24-91df-4392-a5e3-9c11efc61f22 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:48.703637 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:48.716506 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ceedb-b748-4dee-87d1-8834ca3625ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:48.717142 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ceedb-b748-4dee-87d1-8834ca3625ae None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:48.730629 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ceedb-b748-4dee-87d1-8834ca3625ae None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:48.730629 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ceedb-b748-4dee-87d1-8834ca3625ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:48.730629 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ceedb-b748-4dee-87d1-8834ca3625ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:48.730629 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ceedb-b748-4dee-87d1-8834ca3625ae None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:48.741572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-5b5ceedb-b748-4dee-87d1-8834ca3625ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:48.741572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:48.741572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:48.741572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:48.741572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:48.741572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:48.741572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:48.741572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:48.741572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:48.741572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:48.741572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:48.741572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:48.741572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:51:48.741572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:51:48.741572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:51:48.742479 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:51:48.742479 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:48.742479 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:48.742479 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:48.742479 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:48.742479 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:48.742479 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:48.742479 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:48.742479 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:48.742479 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:48.742479 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:48.742479 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:48.742479 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:48.742479 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:48.742479 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:48.742479 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:48.742479 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:48.749927 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:51:48.749927 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:51:48.749927 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:51:48.749927 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:51:48.749927 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:51:48.749927 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:51:48.749927 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:48.749927 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:48.749927 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 518/1043] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:51:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:48.750420 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2ec6f-7d0d-45f9-b7df-2b237537ffc6 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:48.874053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:48.890985 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2ec6f-7d0d-45f9-b7df-2b237537ffc6 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:48.931082 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccb3385-b6a8-4835-b643-b6aec259c9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:48.931953 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb3385-b6a8-4835-b643-b6aec259c9fa None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:48.932086 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb3385-b6a8-4835-b643-b6aec259c9fa None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:48.932256 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccb3385-b6a8-4835-b643-b6aec259c9fa None admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:48.932940 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb3385-b6a8-4835-b643-b6aec259c9fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:48.933240 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb3385-b6a8-4835-b643-b6aec259c9fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:48.934914 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccb3385-b6a8-4835-b643-b6aec259c9fa None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:48.954899 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 526/1044] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:51:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:48.956549 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ceedb-b748-4dee-87d1-8834ca3625ae None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:49.085138 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ceedb-b748-4dee-87d1-8834ca3625ae None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:49.132295 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e5e91-7fd4-4686-bc4a-83a524f0e11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:49.132906 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e5e91-7fd4-4686-bc4a-83a524f0e11f None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:49.133179 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e5e91-7fd4-4686-bc4a-83a524f0e11f None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:49.133444 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e5e91-7fd4-4686-bc4a-83a524f0e11f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:49.134170 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e5e91-7fd4-4686-bc4a-83a524f0e11f None admin] RBAC: Adding query filter params (role.id=c25ffa9ed2f3481697f2ff740bc34e8e, scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642, user.id=28a1c617fc264b118e61f2a97ecb3f39) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:49.134475 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e5e91-7fd4-4686-bc4a-83a524f0e11f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:49.135930 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4e5e91-7fd4-4686-bc4a-83a524f0e11f None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:49.141997 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 519/1045] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:51:48 2022] GET /identity/v3/role_assignments?user.id=28a1c617fc264b118e61f2a97ecb3f39&scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642&role.id=c25ffa9ed2f3481697f2ff740bc34e8e => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:49.431423 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6e0c8-04e9-4b5c-924b-4c3b605c8f48 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:49.431924 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6e0c8-04e9-4b5c-924b-4c3b605c8f48 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:49.431924 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6e0c8-04e9-4b5c-924b-4c3b605c8f48 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:49.433451 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 527/1046] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:49.439070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b5221-b9c9-46a4-b55a-4f867179a6eb None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:49.439568 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b5221-b9c9-46a4-b55a-4f867179a6eb None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:49.439673 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b5221-b9c9-46a4-b55a-4f867179a6eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:49.459351 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-2a1b5221-b9c9-46a4-b55a-4f867179a6eb None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:49.460564 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-2a1b5221-b9c9-46a4-b55a-4f867179a6eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:49.516833 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:49.542414 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 520/1047] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:49 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:51:49.767968 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca419f0b-1777-4083-bd47-6dd0c246251d None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:49.768266 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca419f0b-1777-4083-bd47-6dd0c246251d None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:49.768432 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca419f0b-1777-4083-bd47-6dd0c246251d None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:49.770405 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 528/1048] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:49.775739 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b743af5-4de7-47ee-9daf-01d9a22c02db None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:49.776020 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b743af5-4de7-47ee-9daf-01d9a22c02db None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:49.776295 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b743af5-4de7-47ee-9daf-01d9a22c02db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:49.794991 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-1b743af5-4de7-47ee-9daf-01d9a22c02db None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:49.796223 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-1b743af5-4de7-47ee-9daf-01d9a22c02db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:49.811531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca419f0b-1777-4083-bd47-6dd0c246251d None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:49.894668 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 521/1049] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:49 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:51:49.941157 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca419f0b-1777-4083-bd47-6dd0c246251d None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:49.982777 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce7fdd-cda4-47eb-8895-41f09ce3d413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:49.983460 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce7fdd-cda4-47eb-8895-41f09ce3d413 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:49.983739 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce7fdd-cda4-47eb-8895-41f09ce3d413 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:49.984011 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfce7fdd-cda4-47eb-8895-41f09ce3d413 None admin] PATH_INFO: `/v3/services/image` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:49.984598 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce7fdd-cda4-47eb-8895-41f09ce3d413 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:49.985961 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfce7fdd-cda4-47eb-8895-41f09ce3d413 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:49.997070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-bfce7fdd-cda4-47eb-8895-41f09ce3d413 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 16:51:49.997070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:49.997070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:51:49.997070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:51:49.997070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:51:49.997070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:51:49.997070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:51:49.997070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:49.997070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 16:51:49.997070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:49.997070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:51:49.997070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:49.997070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:49.997070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:49.997070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:49.997070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:49.997070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:49.998110 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:49.998110 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:49.998110 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:49.998110 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:49.998110 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:49.998110 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:49.998110 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:51:49.998110 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:51:49.998110 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:51:49.998110 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:51:49.998110 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:49.998110 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:49.998110 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:49.998110 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:49.998110 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:49.998110 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:49.998956 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:49.998956 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:49.998956 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:49.998956 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:49.998956 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:49.998956 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:49.998956 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:49.998956 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:49.998956 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:49.998956 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:49.998956 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:51:49.998956 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:51:49.998956 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 16:51:49.998956 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:49.998956 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 529/1050] 10.222.0.55 () {56 vars in 1105 bytes} [Wed Aug 24 16:51:49 2022] GET /identity/v3/services/image => generated 86 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:51:50.008248 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b743af5-4de7-47ee-9daf-01d9a22c02db None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:50.126912 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b743af5-4de7-47ee-9daf-01d9a22c02db None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:50.141823 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:50.168123 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0c61e-bd35-4d69-8955-f69b58f41665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:50.168736 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0c61e-bd35-4d69-8955-f69b58f41665 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:50.169006 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0c61e-bd35-4d69-8955-f69b58f41665 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:50.169274 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd0c61e-bd35-4d69-8955-f69b58f41665 None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:50.169903 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0c61e-bd35-4d69-8955-f69b58f41665 None admin] RBAC: Adding query filter params (name=image) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:50.170201 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0c61e-bd35-4d69-8955-f69b58f41665 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:50.171660 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd0c61e-bd35-4d69-8955-f69b58f41665 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:50.175353 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce7fdd-cda4-47eb-8895-41f09ce3d413 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:50.182669 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 522/1051] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:50.184480 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0c61e-bd35-4d69-8955-f69b58f41665 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:50.190486 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:50.301798 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd0c61e-bd35-4d69-8955-f69b58f41665 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:50.303931 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfce7fdd-cda4-47eb-8895-41f09ce3d413 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:50.353898 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94dc22a-a696-4566-9af8-cc2ee76455ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:50.354766 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dc22a-a696-4566-9af8-cc2ee76455ab None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:50.355270 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dc22a-a696-4566-9af8-cc2ee76455ab None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:50.355702 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94dc22a-a696-4566-9af8-cc2ee76455ab None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:50.356543 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94dc22a-a696-4566-9af8-cc2ee76455ab None admin] RBAC: Adding query filter params (type=image) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:50.357070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94dc22a-a696-4566-9af8-cc2ee76455ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:50.359383 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94dc22a-a696-4566-9af8-cc2ee76455ab None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:50.366343 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbeba47-85d8-4fb0-a46e-03c4f91eb718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:50.367640 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbeba47-85d8-4fb0-a46e-03c4f91eb718 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:50.368279 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbeba47-85d8-4fb0-a46e-03c4f91eb718 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:50.368801 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 523/1052] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:50 2022] GET /identity/v3/services?type=image => generated 350 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:50.369041 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbeba47-85d8-4fb0-a46e-03c4f91eb718 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:50.374467 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94dc22a-a696-4566-9af8-cc2ee76455ab None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:50.386622 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbeba47-85d8-4fb0-a46e-03c4f91eb718 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:51:50.393306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-1bbeba47-85d8-4fb0-a46e-03c4f91eb718 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:51:50.393306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:50.393306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:50.393306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:50.393306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:50.393306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:50.393306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:50.393306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:50.393306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:50.393306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:50.393306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:50.393306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:50.393306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:51:50.393306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:51:50.393306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:51:50.393306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:51:50.395836 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:51:50.395836 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:51:50.395836 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:51:50.395836 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:51:50.395836 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:50.395836 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:50.395836 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:50.395836 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:50.395836 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:50.395836 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:50.395836 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:50.395836 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:50.395836 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:50.395836 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:50.395836 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:50.395836 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:50.396791 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:50.396791 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:50.396791 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:50.396791 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:50.396791 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:51:50.396791 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:51:50.396791 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:51:50.396791 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:51:50.396791 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:51:50.396791 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:51:50.396791 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:51:50.396791 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:50.396791 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 530/1053] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:51:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:51:50.409695 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbeba47-85d8-4fb0-a46e-03c4f91eb718 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:50.426202 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:50.506371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94dc22a-a696-4566-9af8-cc2ee76455ab None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:50.512254 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:50.547704 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbeba47-85d8-4fb0-a46e-03c4f91eb718 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:50.548345 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09313d-d8ed-4c3e-9cec-adbe7414d959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:50.548965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09313d-d8ed-4c3e-9cec-adbe7414d959 None admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:50.549414 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09313d-d8ed-4c3e-9cec-adbe7414d959 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:50.549687 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09313d-d8ed-4c3e-9cec-adbe7414d959 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:50.551346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09313d-d8ed-4c3e-9cec-adbe7414d959 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:50.552881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09313d-d8ed-4c3e-9cec-adbe7414d959 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:50.587907 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657aeb2-cbc4-49b6-92a0-6c3ff3200270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:50.588556 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657aeb2-cbc4-49b6-92a0-6c3ff3200270 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:50.588840 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657aeb2-cbc4-49b6-92a0-6c3ff3200270 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:50.589117 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0657aeb2-cbc4-49b6-92a0-6c3ff3200270 None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:50.589786 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657aeb2-cbc4-49b6-92a0-6c3ff3200270 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:50.590094 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657aeb2-cbc4-49b6-92a0-6c3ff3200270 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:50.591498 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0657aeb2-cbc4-49b6-92a0-6c3ff3200270 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:50.604008 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 531/1054] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:51:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:50.609844 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657aeb2-cbc4-49b6-92a0-6c3ff3200270 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:50.647372 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 524/1055] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 16:51:50 2022] POST /identity/v3/endpoints => generated 327 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:51:50.746161 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0657aeb2-cbc4-49b6-92a0-6c3ff3200270 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:50.785464 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:50.798165 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e6f99-2c29-4149-9aaf-d4f314a27c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:50.798803 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e6f99-2c29-4149-9aaf-d4f314a27c68 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:50.799080 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e6f99-2c29-4149-9aaf-d4f314a27c68 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:50.799381 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e6f99-2c29-4149-9aaf-d4f314a27c68 None admin] PATH_INFO: `/v3/users/37835ffd724849b7a00e05900de94991` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:50.817996 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e6f99-2c29-4149-9aaf-d4f314a27c68 None admin] RBAC: Authorizing `identity:get_user(user_id=37835ffd724849b7a00e05900de94991)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:50.819724 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e6f99-2c29-4149-9aaf-d4f314a27c68 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:50.821723 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 532/1056] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:51:50 2022] GET /identity/v3/users/37835ffd724849b7a00e05900de94991 => generated 285 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:50.828169 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09313d-d8ed-4c3e-9cec-adbe7414d959 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:50.953964 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:50.961959 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09313d-d8ed-4c3e-9cec-adbe7414d959 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:50.996866 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d770a-6fb2-4417-8067-bd2600d2652d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:50.997481 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d770a-6fb2-4417-8067-bd2600d2652d None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:50.997761 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d770a-6fb2-4417-8067-bd2600d2652d None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:50.998031 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635d770a-6fb2-4417-8067-bd2600d2652d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:51.071810 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d770a-6fb2-4417-8067-bd2600d2652d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:51.073306 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635d770a-6fb2-4417-8067-bd2600d2652d None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:51.089827 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafefe5e-14a6-4c95-be41-e73c6f900a42 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:51.089827 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafefe5e-14a6-4c95-be41-e73c6f900a42 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:51.090115 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafefe5e-14a6-4c95-be41-e73c6f900a42 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:51.091688 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 533/1057] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:51:51.096981 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8c233-92cb-4699-a7ff-58b424915f52 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:51.097260 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8c233-92cb-4699-a7ff-58b424915f52 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:51.097536 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8c233-92cb-4699-a7ff-58b424915f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:51.121581 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-9cc8c233-92cb-4699-a7ff-58b424915f52 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:51.124745 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-9cc8c233-92cb-4699-a7ff-58b424915f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:51.209593 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:51.219165 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 534/1058] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:51:51.225694 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 525/1059] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:51:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:51:51.227276 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8c233-92cb-4699-a7ff-58b424915f52 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:51.337516 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8c233-92cb-4699-a7ff-58b424915f52 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:51.355977 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:51.377549 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f577396-f821-4c55-a51a-279fab55c9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:51.378185 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f577396-f821-4c55-a51a-279fab55c9de None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:51.378459 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f577396-f821-4c55-a51a-279fab55c9de None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:51.378757 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f577396-f821-4c55-a51a-279fab55c9de None admin] PATH_INFO: `/v3/projects/4560fa628682484d834d2f4d78432c98` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:51.380349 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f577396-f821-4c55-a51a-279fab55c9de None admin] RBAC: Authorizing `identity:get_project(project_id=4560fa628682484d834d2f4d78432c98)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:51.382328 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f577396-f821-4c55-a51a-279fab55c9de None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:51.384202 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 535/1060] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:51:51 2022] GET /identity/v3/projects/4560fa628682484d834d2f4d78432c98 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:51.390537 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d770a-6fb2-4417-8067-bd2600d2652d None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:51.500804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635d770a-6fb2-4417-8067-bd2600d2652d None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:51.502691 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f577396-f821-4c55-a51a-279fab55c9de None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:51.537086 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9411ea-8a64-497e-aaaf-72435eb92690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:51.537713 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9411ea-8a64-497e-aaaf-72435eb92690 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:51.537961 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9411ea-8a64-497e-aaaf-72435eb92690 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:51.538231 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9411ea-8a64-497e-aaaf-72435eb92690 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:51.538961 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9411ea-8a64-497e-aaaf-72435eb92690 None admin] RBAC: Adding query filter params (role.id=99f0ace9fc4d4d028ca52fa9730cab4b, scope.project.id=4560fa628682484d834d2f4d78432c98, user.id=37835ffd724849b7a00e05900de94991) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:51.539297 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9411ea-8a64-497e-aaaf-72435eb92690 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:51.540726 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9411ea-8a64-497e-aaaf-72435eb92690 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:51.546651 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 526/1061] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:51:51 2022] GET /identity/v3/role_assignments?user.id=37835ffd724849b7a00e05900de94991&scope.project.id=4560fa628682484d834d2f4d78432c98&role.id=99f0ace9fc4d4d028ca52fa9730cab4b => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:51.624752 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f577396-f821-4c55-a51a-279fab55c9de None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:51.662552 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281e350-ad85-4ebe-a6d8-77e3d6bb764d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:51.663265 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281e350-ad85-4ebe-a6d8-77e3d6bb764d None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:51.663538 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281e350-ad85-4ebe-a6d8-77e3d6bb764d None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:51.663803 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281e350-ad85-4ebe-a6d8-77e3d6bb764d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:51.675358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281e350-ad85-4ebe-a6d8-77e3d6bb764d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:51:51.680922 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-8281e350-ad85-4ebe-a6d8-77e3d6bb764d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:51:51.680922 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:51.680922 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:51.680922 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:51.680922 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:51.680922 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:51.680922 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:51.680922 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:51.680922 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:51.680922 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:51.680922 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:51.680922 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:51.680922 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:51:51.680922 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:51:51.680922 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:51:51.680922 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:51:51.681947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:51:51.681947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:51:51.681947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:51:51.681947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:51:51.681947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:51.681947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:51.681947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:51.681947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:51.681947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:51.681947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:51.681947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:51.681947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:51.681947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:51.681947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:51.681947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:51.681947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:51.687768 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:51.687768 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:51.687768 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:51.687768 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:51.687768 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:51:51.687768 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:51:51.687768 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:51:51.687768 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:51:51.687768 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:51:51.687768 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:51:51.687768 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:51:51.687768 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:51.687768 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 536/1062] 10.222.0.55 () {56 vars in 1120 bytes} [Wed Aug 24 16:51:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:51:51.688481 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9411ea-8a64-497e-aaaf-72435eb92690 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:51.756498 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:51.798696 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9411ea-8a64-497e-aaaf-72435eb92690 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:51.841435 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710cfc1-ae6d-4ed5-9d9b-f75c2a458b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:51.842289 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710cfc1-ae6d-4ed5-9d9b-f75c2a458b0a None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:51.842711 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710cfc1-ae6d-4ed5-9d9b-f75c2a458b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:51.843179 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4710cfc1-ae6d-4ed5-9d9b-f75c2a458b0a None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:51.843981 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710cfc1-ae6d-4ed5-9d9b-f75c2a458b0a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:51.844423 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710cfc1-ae6d-4ed5-9d9b-f75c2a458b0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:51.845931 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4710cfc1-ae6d-4ed5-9d9b-f75c2a458b0a None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:51.855738 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 527/1063] 10.222.0.55 () {56 vars in 1115 bytes} [Wed Aug 24 16:51:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:51.861028 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281e350-ad85-4ebe-a6d8-77e3d6bb764d None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:51.910198 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:51.966147 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281e350-ad85-4ebe-a6d8-77e3d6bb764d None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:52.002924 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb641a-e68c-489c-9f75-e9bd276e6453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:52.003585 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb641a-e68c-489c-9f75-e9bd276e6453 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:52.003861 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb641a-e68c-489c-9f75-e9bd276e6453 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:52.004190 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb641a-e68c-489c-9f75-e9bd276e6453 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:52.014692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb641a-e68c-489c-9f75-e9bd276e6453 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:52.016074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb641a-e68c-489c-9f75-e9bd276e6453 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:52.030958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-a0bb641a-e68c-489c-9f75-e9bd276e6453 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:52.030958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:52.030958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:52.030958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:52.030958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:52.030958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:52.030958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:52.030958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:52.030958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:52.030958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:52.030958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:52.030958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:52.030958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:52.030958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:52.030958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:52.030958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:52.031962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:52.031962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:52.031962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:52.031962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:52.031962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:52.031962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:52.031962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:52.031962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:52.031962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:52.031962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:52.031962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:52.031962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:52.031962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:52.031962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:52.031962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:52.031962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:52.031962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:52.032891 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:52.032891 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:52.032891 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:52.036075 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 537/1064] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:52.038358 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710cfc1-ae6d-4ed5-9d9b-f75c2a458b0a None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:52.149349 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4710cfc1-ae6d-4ed5-9d9b-f75c2a458b0a None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:52.170266 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:52.185211 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e201987-29a6-464c-923a-f0a766c1b102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:52.185824 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e201987-29a6-464c-923a-f0a766c1b102 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:52.186100 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e201987-29a6-464c-923a-f0a766c1b102 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:52.186369 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e201987-29a6-464c-923a-f0a766c1b102 None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:52.187019 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e201987-29a6-464c-923a-f0a766c1b102 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:52.187394 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e201987-29a6-464c-923a-f0a766c1b102 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:52.188708 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e201987-29a6-464c-923a-f0a766c1b102 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:52.202388 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 528/1065] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:52.208434 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb641a-e68c-489c-9f75-e9bd276e6453 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:52.304564 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:52.311127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb641a-e68c-489c-9f75-e9bd276e6453 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:52.346528 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7cd5be-2778-48a3-91cd-4886eabbdcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:52.347194 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7cd5be-2778-48a3-91cd-4886eabbdcf2 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:52.347474 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7cd5be-2778-48a3-91cd-4886eabbdcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:52.347772 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7cd5be-2778-48a3-91cd-4886eabbdcf2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:52.355384 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7cd5be-2778-48a3-91cd-4886eabbdcf2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:52.356830 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7cd5be-2778-48a3-91cd-4886eabbdcf2 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:52.368515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-ef7cd5be-2778-48a3-91cd-4886eabbdcf2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:51:52.368515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:52.368515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:52.368515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:52.368515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:52.368515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:52.368515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:52.368515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:52.368515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:52.368515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:52.368515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:52.368515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:52.368515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:51:52.368515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:51:52.368515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:51:52.368515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:51:52.369480 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:52.369480 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:52.369480 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:51:52.369480 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:52.369480 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:51:52.369480 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:52.369480 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:52.369480 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:52.369480 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:52.369480 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:52.369480 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:52.369480 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:52.369480 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:52.369480 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:52.369480 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:52.369480 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:52.369480 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:52.369480 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:52.370448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:52.370448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:52.370448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:51:52.370448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:51:52.370448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:51:52.370448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:51:52.370448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:51:52.370448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:51:52.370448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:51:52.370448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:52.371771 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 538/1066] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Aug 24 16:51:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:52.375485 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e201987-29a6-464c-923a-f0a766c1b102 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:52.485534 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e201987-29a6-464c-923a-f0a766c1b102 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:52.522008 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75575a4-c5bb-4570-ad5c-274781a9734d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:52.522637 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75575a4-c5bb-4570-ad5c-274781a9734d None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:52.522925 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75575a4-c5bb-4570-ad5c-274781a9734d None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:52.523235 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75575a4-c5bb-4570-ad5c-274781a9734d None admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:52.523985 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75575a4-c5bb-4570-ad5c-274781a9734d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:52.524293 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75575a4-c5bb-4570-ad5c-274781a9734d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:52.525743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75575a4-c5bb-4570-ad5c-274781a9734d None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:52.549153 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 529/1067] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Aug 24 16:51:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:52.551549 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7cd5be-2778-48a3-91cd-4886eabbdcf2 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:52.662842 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7cd5be-2778-48a3-91cd-4886eabbdcf2 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:52.676133 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c6e0b-2b7f-4867-90cd-09520753c647 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:52.676643 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c6e0b-2b7f-4867-90cd-09520753c647 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:52.677055 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c6e0b-2b7f-4867-90cd-09520753c647 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:52.678578 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 530/1068] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:52.683997 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c791659-f58a-42e8-8315-8fdad6cd85d5 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:52.684279 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c791659-f58a-42e8-8315-8fdad6cd85d5 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:52.684556 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c791659-f58a-42e8-8315-8fdad6cd85d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:52.701162 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797ad1c-7195-402c-8a69-61e8f909cd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:52.702077 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797ad1c-7195-402c-8a69-61e8f909cd80 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:52.702498 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797ad1c-7195-402c-8a69-61e8f909cd80 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:52.702781 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-8c791659-f58a-42e8-8315-8fdad6cd85d5 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:52.703073 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797ad1c-7195-402c-8a69-61e8f909cd80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:52.704013 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-8c791659-f58a-42e8-8315-8fdad6cd85d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:52.716067 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797ad1c-7195-402c-8a69-61e8f909cd80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:52.717736 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797ad1c-7195-402c-8a69-61e8f909cd80 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:52.733574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-9797ad1c-7195-402c-8a69-61e8f909cd80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:52.733574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:52.733574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:52.733574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:52.733574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:52.733574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:52.733574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:52.733574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:52.733574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:52.733574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:52.733574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:52.733574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:52.733574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:52.733574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:52.733574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:52.733574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:52.734739 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:52.734739 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:52.734739 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:52.734739 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:52.734739 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:52.734739 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:52.734739 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:52.734739 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:52.734739 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:52.734739 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:52.734739 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:52.734739 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:52.734739 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:52.734739 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:52.734739 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:52.734739 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:52.734739 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:52.735779 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:52.735779 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:52.735779 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:52.736535 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 539/1069] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:52.742566 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797ad1c-7195-402c-8a69-61e8f909cd80 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:52.744671 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:52.754447 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:52.790589 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 531/1070] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:51:52.849173 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797ad1c-7195-402c-8a69-61e8f909cd80 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:52.890923 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8434e-5597-4a51-9141-3b0aae713b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:52.891702 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8434e-5597-4a51-9141-3b0aae713b03 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:52.892100 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8434e-5597-4a51-9141-3b0aae713b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:52.892472 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8434e-5597-4a51-9141-3b0aae713b03 None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:52.893219 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8434e-5597-4a51-9141-3b0aae713b03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:52.893621 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8434e-5597-4a51-9141-3b0aae713b03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:52.896082 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8434e-5597-4a51-9141-3b0aae713b03 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:52.908760 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 540/1071] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:52.914402 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c791659-f58a-42e8-8315-8fdad6cd85d5 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:53.016756 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c791659-f58a-42e8-8315-8fdad6cd85d5 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:53.053512 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739237db-a14d-4d0a-9801-697dcb9ac7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:53.053934 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739237db-a14d-4d0a-9801-697dcb9ac7fe None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:53.054213 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739237db-a14d-4d0a-9801-697dcb9ac7fe None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:53.054484 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739237db-a14d-4d0a-9801-697dcb9ac7fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:53.054609 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8434e-5597-4a51-9141-3b0aae713b03 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:53.062032 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739237db-a14d-4d0a-9801-697dcb9ac7fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:53.063534 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739237db-a14d-4d0a-9801-697dcb9ac7fe None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:53.075324 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-739237db-a14d-4d0a-9801-697dcb9ac7fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:53.075324 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:53.075324 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:53.075324 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:53.075324 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:53.075324 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:53.075324 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:53.075324 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:53.075324 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:53.075324 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:53.075324 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:53.075324 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:53.075324 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:51:53.075324 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:51:53.075324 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:51:53.076343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:51:53.076343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:53.076343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:53.076343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:53.076343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:53.076343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:53.076343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:53.076343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:53.076343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:53.076343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:53.076343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:53.076343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:53.076343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:53.076343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:53.076343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:53.076343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:53.076343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:53.077260 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:51:53.077260 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:51:53.077260 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:51:53.077260 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:51:53.077260 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:51:53.077260 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:51:53.077260 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:53.077260 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:53.081357 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 532/1072] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:51:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:53.082092 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739237db-a14d-4d0a-9801-697dcb9ac7fe None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:53.113029 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:53.127256 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:53.163645 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8434e-5597-4a51-9141-3b0aae713b03 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:53.195244 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739237db-a14d-4d0a-9801-697dcb9ac7fe None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:53.200710 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6afe3-aa45-485a-a39d-8e2bd4a35fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:53.201546 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6afe3-aa45-485a-a39d-8e2bd4a35fed None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:53.201968 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6afe3-aa45-485a-a39d-8e2bd4a35fed None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:53.202468 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6afe3-aa45-485a-a39d-8e2bd4a35fed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:53.231631 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fb57e-e366-429b-a16f-295c20743738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:53.232242 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fb57e-e366-429b-a16f-295c20743738 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:53.232523 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fb57e-e366-429b-a16f-295c20743738 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:53.232793 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fb57e-e366-429b-a16f-295c20743738 None admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:53.233486 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644fb57e-e366-429b-a16f-295c20743738 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:53.233790 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644fb57e-e366-429b-a16f-295c20743738 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:53.235240 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644fb57e-e366-429b-a16f-295c20743738 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:53.248342 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 533/1073] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:51:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:53.255679 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fb57e-e366-429b-a16f-295c20743738 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:53.287227 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6afe3-aa45-485a-a39d-8e2bd4a35fed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:53.288796 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6afe3-aa45-485a-a39d-8e2bd4a35fed None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:53.346806 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:53.358605 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:53.359412 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fb57e-e366-429b-a16f-295c20743738 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:53.396241 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 541/1074] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:51:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 16:51:53.396439 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3bbf64-874f-49a2-b3dd-f509ba162225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:53.397098 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3bbf64-874f-49a2-b3dd-f509ba162225 None admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:53.401762 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3bbf64-874f-49a2-b3dd-f509ba162225 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:53.401762 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3bbf64-874f-49a2-b3dd-f509ba162225 None admin] PATH_INFO: `/v3/projects/ebae6aa9c60343e6ba0ff1cd62619642/users/28a1c617fc264b118e61f2a97ecb3f39/roles/c25ffa9ed2f3481697f2ff740bc34e8e` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:53.401762 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3bbf64-874f-49a2-b3dd-f509ba162225 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebae6aa9c60343e6ba0ff1cd62619642, user_id=28a1c617fc264b118e61f2a97ecb3f39, role_id=c25ffa9ed2f3481697f2ff740bc34e8e)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:53.401762 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3bbf64-874f-49a2-b3dd-f509ba162225 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:53.402077 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6afe3-aa45-485a-a39d-8e2bd4a35fed None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:53.502693 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6afe3-aa45-485a-a39d-8e2bd4a35fed None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:53.503596 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 534/1075] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Aug 24 16:51:53 2022] PUT /identity/v3/projects/ebae6aa9c60343e6ba0ff1cd62619642/users/28a1c617fc264b118e61f2a97ecb3f39/roles/c25ffa9ed2f3481697f2ff740bc34e8e => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 16:51:53.512262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed31951-26c3-427b-a720-ef726c237705 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:53.512262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed31951-26c3-427b-a720-ef726c237705 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:53.512262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed31951-26c3-427b-a720-ef726c237705 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:53.512262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 535/1076] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:53.513489 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6e8b9-93dc-4954-902a-d63f91358088 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:53.513792 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6e8b9-93dc-4954-902a-d63f91358088 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:53.514059 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d6e8b9-93dc-4954-902a-d63f91358088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:53.533557 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-84d6e8b9-93dc-4954-902a-d63f91358088 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:53.534780 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-84d6e8b9-93dc-4954-902a-d63f91358088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:53.548106 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b775044-dd6e-4e57-869a-7007a87852e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:53.548755 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b775044-dd6e-4e57-869a-7007a87852e1 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:53.549028 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b775044-dd6e-4e57-869a-7007a87852e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:53.549295 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b775044-dd6e-4e57-869a-7007a87852e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:53.561100 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b775044-dd6e-4e57-869a-7007a87852e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:53.562586 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b775044-dd6e-4e57-869a-7007a87852e1 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:53.579068 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-8b775044-dd6e-4e57-869a-7007a87852e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:53.579068 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:53.579068 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:53.579068 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:53.579068 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:53.579068 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:53.579068 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:53.579068 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:53.579068 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:53.579068 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:53.579068 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:53.579068 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:53.579068 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:53.579068 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:53.579068 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:53.579068 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:53.580178 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:53.580178 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:53.580178 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:53.580178 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:53.580178 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:53.580178 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:53.580178 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:53.580178 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:53.580178 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:53.580178 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:53.580178 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:53.580178 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:53.580178 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:53.580178 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:53.580178 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:53.580178 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:53.580178 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:53.581109 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:53.581109 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:53.581109 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:53.581109 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 542/1077] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:51:53.587486 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b775044-dd6e-4e57-869a-7007a87852e1 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:53.611563 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:53.623152 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 536/1078] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:51:53.697924 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b775044-dd6e-4e57-869a-7007a87852e1 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:53.732427 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364bede-d3fc-44b9-992a-363e74e2c64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:53.733038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364bede-d3fc-44b9-992a-363e74e2c64a None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:53.733313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364bede-d3fc-44b9-992a-363e74e2c64a None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:53.733583 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1364bede-d3fc-44b9-992a-363e74e2c64a None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:53.734219 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364bede-d3fc-44b9-992a-363e74e2c64a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:53.734515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364bede-d3fc-44b9-992a-363e74e2c64a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:53.735886 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1364bede-d3fc-44b9-992a-363e74e2c64a None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:53.747614 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 543/1079] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:53.889962 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6e8b9-93dc-4954-902a-d63f91358088 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:53.975441 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:53.997764 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d6e8b9-93dc-4954-902a-d63f91358088 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:54.038304 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e362b1-5489-4093-8ca2-c0b12e4d5026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:54.038955 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e362b1-5489-4093-8ca2-c0b12e4d5026 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:54.039278 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e362b1-5489-4093-8ca2-c0b12e4d5026 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:54.039546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e362b1-5489-4093-8ca2-c0b12e4d5026 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:54.050392 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e362b1-5489-4093-8ca2-c0b12e4d5026 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:51:54.055831 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-94e362b1-5489-4093-8ca2-c0b12e4d5026 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:51:54.055831 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:54.055831 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:54.055831 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:54.055831 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:54.055831 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:54.055831 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:54.055831 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:54.055831 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:54.055831 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:54.055831 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:54.055831 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:54.055831 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:51:54.055831 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:51:54.055831 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:51:54.055831 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:51:54.056781 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:51:54.056781 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:51:54.056781 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:51:54.056781 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:51:54.056781 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:54.056781 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:54.056781 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:54.056781 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:54.056781 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:54.056781 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:54.056781 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:54.056781 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:54.056781 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:54.056781 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:54.056781 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:54.056781 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:54.057663 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:54.057663 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:54.057663 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:54.057663 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:54.057663 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:51:54.057663 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:51:54.057663 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:51:54.057663 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:51:54.057663 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:51:54.057663 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:51:54.057663 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:51:54.057663 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:54.057663 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 537/1080] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:51:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:54.063239 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364bede-d3fc-44b9-992a-363e74e2c64a None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:54.150076 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:54.170028 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1364bede-d3fc-44b9-992a-363e74e2c64a None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:54.206158 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d087ad9-bab9-4a1f-b635-9ebba34c7cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:54.206748 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d087ad9-bab9-4a1f-b635-9ebba34c7cf3 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:54.207588 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d087ad9-bab9-4a1f-b635-9ebba34c7cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:54.208009 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d087ad9-bab9-4a1f-b635-9ebba34c7cf3 None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:54.208676 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d087ad9-bab9-4a1f-b635-9ebba34c7cf3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:54.208981 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d087ad9-bab9-4a1f-b635-9ebba34c7cf3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:54.210348 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d087ad9-bab9-4a1f-b635-9ebba34c7cf3 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:54.221647 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 544/1081] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:51:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:54.228093 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e362b1-5489-4093-8ca2-c0b12e4d5026 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:54.330642 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e362b1-5489-4093-8ca2-c0b12e4d5026 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:54.365553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8d339-2121-4921-8bb2-5dd97b4c7749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:54.366178 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8d339-2121-4921-8bb2-5dd97b4c7749 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:54.366463 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8d339-2121-4921-8bb2-5dd97b4c7749 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:54.366733 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8d339-2121-4921-8bb2-5dd97b4c7749 None admin] PATH_INFO: `/v3/users/37835ffd724849b7a00e05900de94991` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:54.367891 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8d339-2121-4921-8bb2-5dd97b4c7749 None admin] RBAC: Authorizing `identity:get_user(user_id=37835ffd724849b7a00e05900de94991)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:54.369328 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8d339-2121-4921-8bb2-5dd97b4c7749 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:54.370927 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 538/1082] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:51:54 2022] GET /identity/v3/users/37835ffd724849b7a00e05900de94991 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:54.376721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d087ad9-bab9-4a1f-b635-9ebba34c7cf3 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:54.478487 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d087ad9-bab9-4a1f-b635-9ebba34c7cf3 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:54.512064 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbf2b4e-f30a-4af2-8e29-9693b45f29d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:54.512692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf2b4e-f30a-4af2-8e29-9693b45f29d3 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:54.512964 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf2b4e-f30a-4af2-8e29-9693b45f29d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:54.513231 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbf2b4e-f30a-4af2-8e29-9693b45f29d3 None admin] PATH_INFO: `/v3/projects/4560fa628682484d834d2f4d78432c98` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:54.514328 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf2b4e-f30a-4af2-8e29-9693b45f29d3 None admin] RBAC: Authorizing `identity:get_project(project_id=4560fa628682484d834d2f4d78432c98)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:54.515924 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbf2b4e-f30a-4af2-8e29-9693b45f29d3 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:54.517548 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 545/1083] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:51:54 2022] GET /identity/v3/projects/4560fa628682484d834d2f4d78432c98 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:54.524297 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8d339-2121-4921-8bb2-5dd97b4c7749 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:54.533646 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:54.624453 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8d339-2121-4921-8bb2-5dd97b4c7749 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:54.658830 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1fd18e-fd3d-4c3c-aeb2-ff58e3c0a31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:54.659516 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fd18e-fd3d-4c3c-aeb2-ff58e3c0a31b None admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:54.659795 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fd18e-fd3d-4c3c-aeb2-ff58e3c0a31b None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:54.660097 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1fd18e-fd3d-4c3c-aeb2-ff58e3c0a31b None admin] PATH_INFO: `/v3/projects/4560fa628682484d834d2f4d78432c98/users/37835ffd724849b7a00e05900de94991/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:54.662185 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1fd18e-fd3d-4c3c-aeb2-ff58e3c0a31b None admin] RBAC: Authorizing `identity:create_grant(project_id=4560fa628682484d834d2f4d78432c98, user_id=37835ffd724849b7a00e05900de94991, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:54.663650 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1fd18e-fd3d-4c3c-aeb2-ff58e3c0a31b None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:54.732215 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 539/1084] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Aug 24 16:51:54 2022] PUT /identity/v3/projects/4560fa628682484d834d2f4d78432c98/users/37835ffd724849b7a00e05900de94991/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:51:55.471915 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496a73d-7ee0-42d0-9da5-fa4c49d6a952 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:55.472532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496a73d-7ee0-42d0-9da5-fa4c49d6a952 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:55.472532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496a73d-7ee0-42d0-9da5-fa4c49d6a952 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:55.474119 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 546/1085] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:55.479392 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177704dc-4f9a-42dc-ae70-01e77541b00e None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:55.479685 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177704dc-4f9a-42dc-ae70-01e77541b00e None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:55.479964 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177704dc-4f9a-42dc-ae70-01e77541b00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:55.498275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-177704dc-4f9a-42dc-ae70-01e77541b00e None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:55.499512 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-177704dc-4f9a-42dc-ae70-01e77541b00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:55.560052 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:55.568061 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 540/1086] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:51:55.839230 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496a73d-7ee0-42d0-9da5-fa4c49d6a952 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:55.852595 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:55.945197 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496a73d-7ee0-42d0-9da5-fa4c49d6a952 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:55.983609 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009929d-c9a0-4945-b670-9ab385e782f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:55.984239 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009929d-c9a0-4945-b670-9ab385e782f7 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:55.984518 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009929d-c9a0-4945-b670-9ab385e782f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:55.984788 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009929d-c9a0-4945-b670-9ab385e782f7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:55.996172 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009929d-c9a0-4945-b670-9ab385e782f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:51:56.001382 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-8009929d-c9a0-4945-b670-9ab385e782f7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:51:56.001382 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:56.001382 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:56.001382 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:56.001382 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:56.001382 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:56.001382 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:56.001382 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:56.001382 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:56.001382 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:56.001382 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:56.001382 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:56.001382 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:51:56.001382 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:51:56.001382 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:51:56.001382 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:51:56.002473 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:51:56.002473 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:51:56.002473 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:51:56.002473 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:51:56.002473 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:56.002473 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:56.002473 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:56.002473 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:56.002473 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:56.002473 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:56.002473 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:56.002473 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:56.002473 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:56.002473 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:56.002473 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:56.002473 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:56.004082 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:56.004082 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:56.004082 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:56.004082 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:56.004082 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:51:56.004082 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:51:56.004082 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:51:56.004082 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:51:56.004082 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:51:56.004082 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:51:56.004082 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 16:51:56.004082 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:56.004082 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 547/1087] 10.222.0.55 () {56 vars in 1120 bytes} [Wed Aug 24 16:51:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:56.008802 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177704dc-4f9a-42dc-ae70-01e77541b00e None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:56.108497 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177704dc-4f9a-42dc-ae70-01e77541b00e None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:56.158750 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89de6f-af13-424f-aad8-aceb39d299f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:56.159389 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89de6f-af13-424f-aad8-aceb39d299f6 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:56.159666 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89de6f-af13-424f-aad8-aceb39d299f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:56.160484 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89de6f-af13-424f-aad8-aceb39d299f6 None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:56.161148 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e89de6f-af13-424f-aad8-aceb39d299f6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:56.161446 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e89de6f-af13-424f-aad8-aceb39d299f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:56.162814 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e89de6f-af13-424f-aad8-aceb39d299f6 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:56.179058 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 541/1088] 10.222.0.55 () {56 vars in 1115 bytes} [Wed Aug 24 16:51:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:56.185090 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009929d-c9a0-4945-b670-9ab385e782f7 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:56.258686 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:56.290284 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009929d-c9a0-4945-b670-9ab385e782f7 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:56.324897 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb19ea-adce-47a4-afc4-376e006fd7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:56.325525 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb19ea-adce-47a4-afc4-376e006fd7b9 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:56.325802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb19ea-adce-47a4-afc4-376e006fd7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:56.326071 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb19ea-adce-47a4-afc4-376e006fd7b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:56.338429 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb19ea-adce-47a4-afc4-376e006fd7b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:56.339910 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb19ea-adce-47a4-afc4-376e006fd7b9 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:56.355746 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-01cb19ea-adce-47a4-afc4-376e006fd7b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:56.355746 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:56.355746 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:56.355746 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:56.355746 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:56.355746 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:56.355746 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:56.355746 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:56.355746 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:56.355746 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:56.355746 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:56.355746 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:56.355746 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:56.355746 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:56.355746 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:56.355746 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:56.356803 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:56.356803 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:56.356803 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:56.356803 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:56.356803 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:56.356803 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:56.356803 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:56.356803 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:56.356803 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:56.356803 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:56.356803 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:56.356803 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:56.356803 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:56.356803 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:56.356803 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:56.356803 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:56.356803 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:56.357900 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:56.357900 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:56.357900 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:56.357900 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 548/1089] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:56.362922 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89de6f-af13-424f-aad8-aceb39d299f6 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:56.422354 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:56.464808 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e89de6f-af13-424f-aad8-aceb39d299f6 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:56.498307 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520d791b-9b5e-435a-b61d-ab6d0a9b7641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:56.498915 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d791b-9b5e-435a-b61d-ab6d0a9b7641 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:56.499226 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d791b-9b5e-435a-b61d-ab6d0a9b7641 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:56.499499 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520d791b-9b5e-435a-b61d-ab6d0a9b7641 None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:56.500139 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d791b-9b5e-435a-b61d-ab6d0a9b7641 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:56.500441 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d791b-9b5e-435a-b61d-ab6d0a9b7641 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:56.501801 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520d791b-9b5e-435a-b61d-ab6d0a9b7641 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:56.514000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 542/1090] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:56.520253 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb19ea-adce-47a4-afc4-376e006fd7b9 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:56.619260 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb19ea-adce-47a4-afc4-376e006fd7b9 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:56.642796 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:56.649015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c4b1c-bae0-4571-87dc-942aba4abe2e None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:56.649304 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c4b1c-bae0-4571-87dc-942aba4abe2e None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:56.649574 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c4b1c-bae0-4571-87dc-942aba4abe2e None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:56.650904 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 543/1091] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:51:56.655925 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353475c9-5daa-4d87-9d0d-4de494df49c5 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:56.660015 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181d353-9d5f-4752-90db-fceca86faaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:56.660168 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353475c9-5daa-4d87-9d0d-4de494df49c5 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:56.660168 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353475c9-5daa-4d87-9d0d-4de494df49c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:56.660347 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181d353-9d5f-4752-90db-fceca86faaa6 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:56.660347 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181d353-9d5f-4752-90db-fceca86faaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:56.660347 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1181d353-9d5f-4752-90db-fceca86faaa6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:56.665372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181d353-9d5f-4752-90db-fceca86faaa6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:56.666810 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1181d353-9d5f-4752-90db-fceca86faaa6 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:56.676587 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-353475c9-5daa-4d87-9d0d-4de494df49c5 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:51:56.677802 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-353475c9-5daa-4d87-9d0d-4de494df49c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:51:56.678543 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-1181d353-9d5f-4752-90db-fceca86faaa6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:51:56.678543 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:56.678543 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:56.678543 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:56.678543 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:56.678543 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:56.678543 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:56.678543 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:56.678543 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:56.678543 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:56.678543 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:56.678543 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:56.678543 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:51:56.678543 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:51:56.678543 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:51:56.678543 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:51:56.679578 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:56.679578 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:56.679578 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:51:56.679578 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:56.679578 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:51:56.679578 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:51:56.679578 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:56.679578 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:56.679578 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:56.679578 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:56.679578 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:56.679578 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:56.679578 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:56.679578 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:56.679578 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:56.679578 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:56.679578 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:56.679578 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:56.680554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:56.680554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:56.680554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:51:56.680554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:51:56.680554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:51:56.680554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:51:56.680554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:51:56.680554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:51:56.680554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 16:51:56.680554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:56.681969 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 549/1092] 10.222.0.55 () {56 vars in 1093 bytes} [Wed Aug 24 16:51:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:51:56.685589 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181d353-9d5f-4752-90db-fceca86faaa6 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:56.748738 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 544/1093] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:51:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:51:56.787337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1181d353-9d5f-4752-90db-fceca86faaa6 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:56.819708 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540e39d-7005-45be-ac40-d204707dccc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:56.820304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540e39d-7005-45be-ac40-d204707dccc7 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:56.820579 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540e39d-7005-45be-ac40-d204707dccc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:56.820846 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540e39d-7005-45be-ac40-d204707dccc7 None admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:56.821555 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540e39d-7005-45be-ac40-d204707dccc7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:56.821856 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540e39d-7005-45be-ac40-d204707dccc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:56.823284 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540e39d-7005-45be-ac40-d204707dccc7 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:56.840692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 550/1094] 10.222.0.55 () {56 vars in 1133 bytes} [Wed Aug 24 16:51:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:56.846427 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353475c9-5daa-4d87-9d0d-4de494df49c5 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:56.897275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:56.949944 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353475c9-5daa-4d87-9d0d-4de494df49c5 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:56.982855 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f7dc2-d7d8-455c-bb8d-1e7913d7fd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:56.983490 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f7dc2-d7d8-455c-bb8d-1e7913d7fd34 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:56.983770 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f7dc2-d7d8-455c-bb8d-1e7913d7fd34 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:56.984038 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f7dc2-d7d8-455c-bb8d-1e7913d7fd34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:57.029038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540e39d-7005-45be-ac40-d204707dccc7 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:57.057990 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f7dc2-d7d8-455c-bb8d-1e7913d7fd34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:57.059758 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f7dc2-d7d8-455c-bb8d-1e7913d7fd34 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:57.074315 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:57.108158 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:57.133382 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540e39d-7005-45be-ac40-d204707dccc7 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:57.163246 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 545/1095] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:51:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:51:57.168708 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea00af-281a-4570-a8ea-f21349c93405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:57.168962 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f7dc2-d7d8-455c-bb8d-1e7913d7fd34 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:57.169345 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea00af-281a-4570-a8ea-f21349c93405 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:57.169624 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea00af-281a-4570-a8ea-f21349c93405 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:57.169895 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea00af-281a-4570-a8ea-f21349c93405 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:57.181640 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea00af-281a-4570-a8ea-f21349c93405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:51:57.186559 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-43ea00af-281a-4570-a8ea-f21349c93405 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:51:57.186559 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:57.186559 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:57.186559 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:57.186559 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:57.186559 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:57.186559 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:57.186559 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:57.186559 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:57.186559 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:57.186559 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:57.186559 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:57.186559 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:51:57.186559 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:51:57.186559 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:51:57.186559 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:51:57.187562 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:51:57.187562 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:51:57.187562 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:51:57.187562 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:51:57.187562 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:57.187562 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:57.187562 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:57.187562 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:57.187562 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:57.187562 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:57.187562 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:57.187562 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:57.187562 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:57.187562 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:57.187562 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:57.187562 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:57.189074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:57.189074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:57.189074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:57.189074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:57.189074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:51:57.189074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:51:57.189074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:51:57.189074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:51:57.189074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:51:57.189074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:51:57.189074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:51:57.189074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:57.189074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 551/1096] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:51:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:51:57.194805 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea00af-281a-4570-a8ea-f21349c93405 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:57.270149 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f7dc2-d7d8-455c-bb8d-1e7913d7fd34 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:57.292480 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:57.295450 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea00af-281a-4570-a8ea-f21349c93405 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:57.303715 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8ec4b-d10e-47a9-9c91-233562d22677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:57.307216 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8ec4b-d10e-47a9-9c91-233562d22677 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:57.307216 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8ec4b-d10e-47a9-9c91-233562d22677 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:57.307216 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a8ec4b-d10e-47a9-9c91-233562d22677 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:57.315075 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a8ec4b-d10e-47a9-9c91-233562d22677 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:57.317193 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a8ec4b-d10e-47a9-9c91-233562d22677 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:57.325597 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:57.331199 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73e4c6-7faf-4fc0-81e5-89d3c4bc147c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:57.331552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-50a8ec4b-d10e-47a9-9c91-233562d22677 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:57.331552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:57.331552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:57.331552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:57.331552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:57.331552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:57.331552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:57.331552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:57.331552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:57.331552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:57.331552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:57.331552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:57.331552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:51:57.331552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:51:57.331552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:51:57.331552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:51:57.332680 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:57.332680 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:57.332680 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:57.332680 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:57.332680 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:57.332680 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:57.332680 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:57.332680 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:57.332680 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:57.332680 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:57.332680 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:57.332680 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:57.332680 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:57.332680 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:57.332680 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:57.332680 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:57.332680 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:51:57.333645 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:51:57.333645 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:51:57.333645 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:51:57.333830 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73e4c6-7faf-4fc0-81e5-89d3c4bc147c None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:57.333830 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73e4c6-7faf-4fc0-81e5-89d3c4bc147c None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:57.333830 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73e4c6-7faf-4fc0-81e5-89d3c4bc147c None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:57.334011 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 546/1097] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:51:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:57.334079 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73e4c6-7faf-4fc0-81e5-89d3c4bc147c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:57.334079 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73e4c6-7faf-4fc0-81e5-89d3c4bc147c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:57.335034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73e4c6-7faf-4fc0-81e5-89d3c4bc147c None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:57.338444 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8ec4b-d10e-47a9-9c91-233562d22677 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:57.344751 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 552/1098] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:51:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:57.350956 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73e4c6-7faf-4fc0-81e5-89d3c4bc147c None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:57.438293 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a8ec4b-d10e-47a9-9c91-233562d22677 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:57.452455 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73e4c6-7faf-4fc0-81e5-89d3c4bc147c None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:57.471470 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbae0e-0cc4-4bad-906f-330cc4b336ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:57.472077 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbae0e-0cc4-4bad-906f-330cc4b336ad None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:57.472927 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbae0e-0cc4-4bad-906f-330cc4b336ad None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:57.473328 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbae0e-0cc4-4bad-906f-330cc4b336ad None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:57.473972 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbae0e-0cc4-4bad-906f-330cc4b336ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:57.474269 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbae0e-0cc4-4bad-906f-330cc4b336ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:57.475658 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbae0e-0cc4-4bad-906f-330cc4b336ad None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:57.487091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00c56c-61a8-40b6-b828-876433f14e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:57.487764 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00c56c-61a8-40b6-b828-876433f14e37 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:57.487987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 547/1099] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:51:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:57.488102 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00c56c-61a8-40b6-b828-876433f14e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:57.488849 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a00c56c-61a8-40b6-b828-876433f14e37 None admin] PATH_INFO: `/v3/users/37835ffd724849b7a00e05900de94991` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:57.490274 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a00c56c-61a8-40b6-b828-876433f14e37 None admin] RBAC: Authorizing `identity:get_user(user_id=37835ffd724849b7a00e05900de94991)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:57.491757 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a00c56c-61a8-40b6-b828-876433f14e37 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:57.493438 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 553/1100] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:51:57 2022] GET /identity/v3/users/37835ffd724849b7a00e05900de94991 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:51:57.499361 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00c56c-61a8-40b6-b828-876433f14e37 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:57.499526 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbae0e-0cc4-4bad-906f-330cc4b336ad None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:57.533500 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:57.566711 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:57.605831 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbae0e-0cc4-4bad-906f-330cc4b336ad None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:57.606054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a00c56c-61a8-40b6-b828-876433f14e37 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:57.640026 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4ae23-90dc-46bd-a044-e5a0b04b064f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:57.640628 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4ae23-90dc-46bd-a044-e5a0b04b064f None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:57.640903 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4ae23-90dc-46bd-a044-e5a0b04b064f None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:57.641104 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c28a01-6986-42e4-9177-fa84f12296d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:57.641219 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea4ae23-90dc-46bd-a044-e5a0b04b064f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:57.641532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c28a01-6986-42e4-9177-fa84f12296d7 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:57.641811 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c28a01-6986-42e4-9177-fa84f12296d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:57.642086 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c28a01-6986-42e4-9177-fa84f12296d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:57.650431 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c28a01-6986-42e4-9177-fa84f12296d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:57.651830 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c28a01-6986-42e4-9177-fa84f12296d7 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:57.662927 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-f1c28a01-6986-42e4-9177-fa84f12296d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:57.662927 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:51:57.662927 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:51:57.662927 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:51:57.662927 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:51:57.662927 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:51:57.662927 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:51:57.662927 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:51:57.662927 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:51:57.662927 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:51:57.662927 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:51:57.662927 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:51:57.662927 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:51:57.662927 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:51:57.662927 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:51:57.663958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:51:57.663958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:51:57.663958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:51:57.663958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:51:57.663958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:51:57.663958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:51:57.663958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:51:57.663958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:51:57.663958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:51:57.663958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:51:57.663958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:51:57.663958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:51:57.663958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:51:57.663958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:51:57.663958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:51:57.663958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:51:57.663958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:51:57.664925 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:51:57.664925 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:51:57.664925 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:51:57.664925 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:51:57.664925 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:51:57.664925 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:51:57.664925 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:51:57.664925 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:51:57.664925 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 554/1101] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:51:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:51:57.669885 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c28a01-6986-42e4-9177-fa84f12296d7 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:57.709569 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4ae23-90dc-46bd-a044-e5a0b04b064f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:57.710941 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea4ae23-90dc-46bd-a044-e5a0b04b064f None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:57.760468 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:57.768954 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:57.770410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c28a01-6986-42e4-9177-fa84f12296d7 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:57.803801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e7e6b-b788-4116-a700-c43871767460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:57.804404 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e7e6b-b788-4116-a700-c43871767460 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:57.804678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e7e6b-b788-4116-a700-c43871767460 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:57.804943 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e7e6b-b788-4116-a700-c43871767460 None admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:57.805617 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e7e6b-b788-4116-a700-c43871767460 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:57.805914 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e7e6b-b788-4116-a700-c43871767460 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:57.807376 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e7e6b-b788-4116-a700-c43871767460 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:57.810281 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 548/1102] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:51:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:51:57.816894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4ae23-90dc-46bd-a044-e5a0b04b064f None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:57.820079 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 555/1103] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:51:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:57.825596 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e7e6b-b788-4116-a700-c43871767460 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:57.916183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea4ae23-90dc-46bd-a044-e5a0b04b064f None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:57.932089 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e7e6b-b788-4116-a700-c43871767460 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:57.951262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6510277-a918-4009-b2db-e2ecfd3fd365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:57.951894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6510277-a918-4009-b2db-e2ecfd3fd365 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:57.952167 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6510277-a918-4009-b2db-e2ecfd3fd365 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:57.952434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6510277-a918-4009-b2db-e2ecfd3fd365 None admin] PATH_INFO: `/v3/projects/4560fa628682484d834d2f4d78432c98` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:57.953644 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6510277-a918-4009-b2db-e2ecfd3fd365 None admin] RBAC: Authorizing `identity:get_project(project_id=4560fa628682484d834d2f4d78432c98)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:57.955072 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6510277-a918-4009-b2db-e2ecfd3fd365 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:57.957249 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 549/1104] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:51:57 2022] GET /identity/v3/projects/4560fa628682484d834d2f4d78432c98 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:57.962923 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6510277-a918-4009-b2db-e2ecfd3fd365 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:51:57.967294 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231b0e9-5a0d-4184-a716-1a1adbc51888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:57.967900 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231b0e9-5a0d-4184-a716-1a1adbc51888 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:57.968181 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231b0e9-5a0d-4184-a716-1a1adbc51888 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:57.968452 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231b0e9-5a0d-4184-a716-1a1adbc51888 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:57.969204 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d231b0e9-5a0d-4184-a716-1a1adbc51888 None admin] RBAC: Adding query filter params (role.id=c25ffa9ed2f3481697f2ff740bc34e8e, scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642, user.id=28a1c617fc264b118e61f2a97ecb3f39) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:57.969510 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d231b0e9-5a0d-4184-a716-1a1adbc51888 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:57.971362 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d231b0e9-5a0d-4184-a716-1a1adbc51888 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:57.979332 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 556/1105] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:51:57 2022] GET /identity/v3/role_assignments?user.id=28a1c617fc264b118e61f2a97ecb3f39&scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642&role.id=c25ffa9ed2f3481697f2ff740bc34e8e => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:51:57.993757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:51:58.073874 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6510277-a918-4009-b2db-e2ecfd3fd365 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:51:58.111730 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f5888-68df-4362-992d-51b5e2e7c375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:51:58.112348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f5888-68df-4362-992d-51b5e2e7c375 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:51:58.112629 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f5888-68df-4362-992d-51b5e2e7c375 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:51:58.112986 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f5888-68df-4362-992d-51b5e2e7c375 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:51:58.115025 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f5888-68df-4362-992d-51b5e2e7c375 None admin] RBAC: Adding query filter params (role.id=99f0ace9fc4d4d028ca52fa9730cab4b, scope.project.id=4560fa628682484d834d2f4d78432c98, user.id=37835ffd724849b7a00e05900de94991) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:51:58.115362 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f5888-68df-4362-992d-51b5e2e7c375 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:51:58.116816 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f5888-68df-4362-992d-51b5e2e7c375 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:51:58.123155 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 550/1106] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:51:57 2022] GET /identity/v3/role_assignments?user.id=37835ffd724849b7a00e05900de94991&scope.project.id=4560fa628682484d834d2f4d78432c98&role.id=99f0ace9fc4d4d028ca52fa9730cab4b => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:52:00.075050 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03cf19-dd26-493d-90e8-e0de68787f11 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:00.075603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03cf19-dd26-493d-90e8-e0de68787f11 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:00.075603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd03cf19-dd26-493d-90e8-e0de68787f11 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:00.076951 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 557/1107] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:52:00.082840 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b505d-95f1-4fcd-8cfb-9a84620c76de None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:00.083274 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b505d-95f1-4fcd-8cfb-9a84620c76de None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:00.083417 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b505d-95f1-4fcd-8cfb-9a84620c76de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:00.101390 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-0f3b505d-95f1-4fcd-8cfb-9a84620c76de None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:52:00.102572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-0f3b505d-95f1-4fcd-8cfb-9a84620c76de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:52:00.168641 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 551/1108] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:52:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:52:00.438804 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03cf19-dd26-493d-90e8-e0de68787f11 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:00.455092 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:00.537792 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd03cf19-dd26-493d-90e8-e0de68787f11 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:00.570465 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6a9e4-fa8b-456c-9a0a-1b2f6923ad54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:00.571084 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6a9e4-fa8b-456c-9a0a-1b2f6923ad54 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:00.571387 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6a9e4-fa8b-456c-9a0a-1b2f6923ad54 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:00.571658 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6a9e4-fa8b-456c-9a0a-1b2f6923ad54 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:00.572756 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6a9e4-fa8b-456c-9a0a-1b2f6923ad54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:00.574163 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d6a9e4-fa8b-456c-9a0a-1b2f6923ad54 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:00.575738 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 558/1109] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:52:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:00.582255 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b505d-95f1-4fcd-8cfb-9a84620c76de None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:00.605377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:00.678108 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b505d-95f1-4fcd-8cfb-9a84620c76de None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:00.710686 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a75ae-7539-4df4-a0ca-5bc5d6a512e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:00.711247 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a75ae-7539-4df4-a0ca-5bc5d6a512e6 None admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:00.711521 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a75ae-7539-4df4-a0ca-5bc5d6a512e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:00.711789 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a75ae-7539-4df4-a0ca-5bc5d6a512e6 None admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:00.712415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a75ae-7539-4df4-a0ca-5bc5d6a512e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:00.713839 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a75ae-7539-4df4-a0ca-5bc5d6a512e6 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:00.783705 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 552/1110] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Aug 24 16:52:00 2022] POST /identity/v3/users => generated 286 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:52:02.716533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e1f49-efe2-4a5e-a87f-93dfaa45fdda None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:02.717069 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e1f49-efe2-4a5e-a87f-93dfaa45fdda None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:02.717069 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e1f49-efe2-4a5e-a87f-93dfaa45fdda None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:02.718385 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 559/1111] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:52:02.724189 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf025d-c29f-4baf-8608-99df9ac8df1f None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:02.724594 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf025d-c29f-4baf-8608-99df9ac8df1f None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:02.724738 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf025d-c29f-4baf-8608-99df9ac8df1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:02.742605 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-18bf025d-c29f-4baf-8608-99df9ac8df1f None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:52:02.743818 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-18bf025d-c29f-4baf-8608-99df9ac8df1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:52:02.808698 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 553/1112] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:52:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:52:03.077402 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e1f49-efe2-4a5e-a87f-93dfaa45fdda None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:03.157441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:03.175958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e1f49-efe2-4a5e-a87f-93dfaa45fdda None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:03.210200 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342de09-bac5-4500-b77f-20ecceb8880c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:03.210820 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342de09-bac5-4500-b77f-20ecceb8880c None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:03.211156 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342de09-bac5-4500-b77f-20ecceb8880c None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:03.211437 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342de09-bac5-4500-b77f-20ecceb8880c None admin] PATH_INFO: `/v3/roles/1c6cc7bf29b146b0a9aaf6a07607258a` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:03.212794 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342de09-bac5-4500-b77f-20ecceb8880c None admin] RBAC: Authorizing `identity:get_role(role_id=1c6cc7bf29b146b0a9aaf6a07607258a)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:03.214154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4342de09-bac5-4500-b77f-20ecceb8880c None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:03.215567 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 560/1113] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:52:03 2022] GET /identity/v3/roles/1c6cc7bf29b146b0a9aaf6a07607258a => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:03.221391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf025d-c29f-4baf-8608-99df9ac8df1f None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:03.231970 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:03.417424 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf025d-c29f-4baf-8608-99df9ac8df1f None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:03.451605 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867af7c-2bf8-4fd7-a9d2-81586ea3f6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:03.452232 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867af7c-2bf8-4fd7-a9d2-81586ea3f6b9 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:03.452511 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867af7c-2bf8-4fd7-a9d2-81586ea3f6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:03.452783 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c867af7c-2bf8-4fd7-a9d2-81586ea3f6b9 None admin] PATH_INFO: `/v3/users/7741d8d2eb93425c8010309e0e38be97` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:03.467459 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867af7c-2bf8-4fd7-a9d2-81586ea3f6b9 None admin] RBAC: Authorizing `identity:get_user(user_id=7741d8d2eb93425c8010309e0e38be97)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:03.468906 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c867af7c-2bf8-4fd7-a9d2-81586ea3f6b9 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:03.470637 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 554/1114] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:52:03 2022] GET /identity/v3/users/7741d8d2eb93425c8010309e0e38be97 => generated 286 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:03.476574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342de09-bac5-4500-b77f-20ecceb8880c None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:03.573324 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342de09-bac5-4500-b77f-20ecceb8880c None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:03.607343 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87aeb2-08bf-4fc5-800a-d4969c26ec65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:03.607931 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87aeb2-08bf-4fc5-800a-d4969c26ec65 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:03.608203 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87aeb2-08bf-4fc5-800a-d4969c26ec65 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:03.608470 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87aeb2-08bf-4fc5-800a-d4969c26ec65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:03.626213 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:03.674068 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87aeb2-08bf-4fc5-800a-d4969c26ec65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:03.675976 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87aeb2-08bf-4fc5-800a-d4969c26ec65 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:03.769451 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 561/1115] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:52:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:52:03.775435 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867af7c-2bf8-4fd7-a9d2-81586ea3f6b9 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:03.840546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:03.875067 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c867af7c-2bf8-4fd7-a9d2-81586ea3f6b9 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:03.907975 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b9ef5-8a48-4762-b275-1271bfdc4fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:03.908589 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b9ef5-8a48-4762-b275-1271bfdc4fbc None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:03.908863 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b9ef5-8a48-4762-b275-1271bfdc4fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:03.909130 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b9ef5-8a48-4762-b275-1271bfdc4fbc None admin] PATH_INFO: `/v3/projects/4560fa628682484d834d2f4d78432c98` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:03.910373 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b9ef5-8a48-4762-b275-1271bfdc4fbc None admin] RBAC: Authorizing `identity:get_project(project_id=4560fa628682484d834d2f4d78432c98)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:03.911820 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b9ef5-8a48-4762-b275-1271bfdc4fbc None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:03.913423 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 555/1116] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:52:03 2022] GET /identity/v3/projects/4560fa628682484d834d2f4d78432c98 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:03.919604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87aeb2-08bf-4fc5-800a-d4969c26ec65 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:03.967834 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:04.016966 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87aeb2-08bf-4fc5-800a-d4969c26ec65 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:04.049269 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a0451-a5cd-4f06-9182-f33aa5fb9765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:04.050360 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a0451-a5cd-4f06-9182-f33aa5fb9765 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:04.051021 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a0451-a5cd-4f06-9182-f33aa5fb9765 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:04.051021 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a0451-a5cd-4f06-9182-f33aa5fb9765 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:04.051660 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a0451-a5cd-4f06-9182-f33aa5fb9765 None admin] RBAC: Adding query filter params (role.id=1c6cc7bf29b146b0a9aaf6a07607258a, scope.project.id=4560fa628682484d834d2f4d78432c98, user.id=7741d8d2eb93425c8010309e0e38be97) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:52:04.051968 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a0451-a5cd-4f06-9182-f33aa5fb9765 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:04.053390 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a0451-a5cd-4f06-9182-f33aa5fb9765 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:04.058903 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 562/1117] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:52:03 2022] GET /identity/v3/role_assignments?user.id=7741d8d2eb93425c8010309e0e38be97&scope.project.id=4560fa628682484d834d2f4d78432c98&role.id=1c6cc7bf29b146b0a9aaf6a07607258a => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:05.942953 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab5d2d-9670-4aad-bd93-bfd92844c23b None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:05.943503 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab5d2d-9670-4aad-bd93-bfd92844c23b None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:05.943503 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab5d2d-9670-4aad-bd93-bfd92844c23b None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:05.944867 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 556/1118] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:52:05.950054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65f4d0-3c2a-45fb-b327-55c48a1608a4 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:05.950468 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65f4d0-3c2a-45fb-b327-55c48a1608a4 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:05.950608 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65f4d0-3c2a-45fb-b327-55c48a1608a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:05.968896 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-bf65f4d0-3c2a-45fb-b327-55c48a1608a4 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:52:05.970090 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-bf65f4d0-3c2a-45fb-b327-55c48a1608a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:52:06.036787 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 563/1119] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:52:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:52:06.309832 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab5d2d-9670-4aad-bd93-bfd92844c23b None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:06.409600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab5d2d-9670-4aad-bd93-bfd92844c23b None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:06.443933 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7abb2fc-6f27-49da-b181-3516def2b35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:06.444570 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abb2fc-6f27-49da-b181-3516def2b35b None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:06.444868 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abb2fc-6f27-49da-b181-3516def2b35b None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:06.445144 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abb2fc-6f27-49da-b181-3516def2b35b None admin] PATH_INFO: `/v3/roles/1c6cc7bf29b146b0a9aaf6a07607258a` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:06.446538 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7abb2fc-6f27-49da-b181-3516def2b35b None admin] RBAC: Authorizing `identity:get_role(role_id=1c6cc7bf29b146b0a9aaf6a07607258a)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:06.447953 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7abb2fc-6f27-49da-b181-3516def2b35b None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:06.449456 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 557/1120] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:52:06 2022] GET /identity/v3/roles/1c6cc7bf29b146b0a9aaf6a07607258a => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:06.455131 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65f4d0-3c2a-45fb-b327-55c48a1608a4 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:06.499241 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:06.558175 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65f4d0-3c2a-45fb-b327-55c48a1608a4 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:06.593123 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d2c97-8c4e-4ec6-871d-ca4445aa25e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:06.593675 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d2c97-8c4e-4ec6-871d-ca4445aa25e3 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:06.593957 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d2c97-8c4e-4ec6-871d-ca4445aa25e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:06.594230 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9d2c97-8c4e-4ec6-871d-ca4445aa25e3 None admin] PATH_INFO: `/v3/users/7741d8d2eb93425c8010309e0e38be97` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:06.595394 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d2c97-8c4e-4ec6-871d-ca4445aa25e3 None admin] RBAC: Authorizing `identity:get_user(user_id=7741d8d2eb93425c8010309e0e38be97)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:06.596859 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9d2c97-8c4e-4ec6-871d-ca4445aa25e3 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:06.598559 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 564/1121] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:52:06 2022] GET /identity/v3/users/7741d8d2eb93425c8010309e0e38be97 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:06.604558 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7abb2fc-6f27-49da-b181-3516def2b35b None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:06.607439 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:06.703430 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7abb2fc-6f27-49da-b181-3516def2b35b None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:06.735702 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e39380-b2ce-4cac-a3b9-57cfe52556a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:06.736324 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e39380-b2ce-4cac-a3b9-57cfe52556a9 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:06.736603 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e39380-b2ce-4cac-a3b9-57cfe52556a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:06.736876 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e39380-b2ce-4cac-a3b9-57cfe52556a9 None admin] PATH_INFO: `/v3/projects/4560fa628682484d834d2f4d78432c98` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:06.738479 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e39380-b2ce-4cac-a3b9-57cfe52556a9 None admin] RBAC: Authorizing `identity:get_project(project_id=4560fa628682484d834d2f4d78432c98)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:06.739934 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e39380-b2ce-4cac-a3b9-57cfe52556a9 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:06.741560 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 558/1122] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:52:06 2022] GET /identity/v3/projects/4560fa628682484d834d2f4d78432c98 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:06.747749 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d2c97-8c4e-4ec6-871d-ca4445aa25e3 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:06.845572 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9d2c97-8c4e-4ec6-871d-ca4445aa25e3 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:06.859083 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:06.882368 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8e3e00-4936-4c1f-bc82-3ce74525b8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:06.883058 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e3e00-4936-4c1f-bc82-3ce74525b8bc None admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:06.883367 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e3e00-4936-4c1f-bc82-3ce74525b8bc None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:06.883685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8e3e00-4936-4c1f-bc82-3ce74525b8bc None admin] PATH_INFO: `/v3/projects/4560fa628682484d834d2f4d78432c98/users/7741d8d2eb93425c8010309e0e38be97/roles/1c6cc7bf29b146b0a9aaf6a07607258a` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:06.886015 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e3e00-4936-4c1f-bc82-3ce74525b8bc None admin] RBAC: Authorizing `identity:create_grant(project_id=4560fa628682484d834d2f4d78432c98, user_id=7741d8d2eb93425c8010309e0e38be97, role_id=1c6cc7bf29b146b0a9aaf6a07607258a)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:06.887487 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8e3e00-4936-4c1f-bc82-3ce74525b8bc None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:06.972316 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 565/1123] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Aug 24 16:52:06 2022] PUT /identity/v3/projects/4560fa628682484d834d2f4d78432c98/users/7741d8d2eb93425c8010309e0e38be97/roles/1c6cc7bf29b146b0a9aaf6a07607258a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:52:08.889386 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4243a73-cbb2-4b4a-89db-a89e46f2308e None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:08.889940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4243a73-cbb2-4b4a-89db-a89e46f2308e None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:08.889940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4243a73-cbb2-4b4a-89db-a89e46f2308e None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:08.891316 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 559/1124] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:52:08.897752 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b5578-f701-4216-ac65-351bb92a5095 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:08.898248 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b5578-f701-4216-ac65-351bb92a5095 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:08.898341 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b5578-f701-4216-ac65-351bb92a5095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:08.917940 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-0c5b5578-f701-4216-ac65-351bb92a5095 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:52:08.919193 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-0c5b5578-f701-4216-ac65-351bb92a5095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:52:08.990600 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 566/1125] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:52:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:52:09.259684 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4243a73-cbb2-4b4a-89db-a89e46f2308e None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:09.330638 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:09.362162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4243a73-cbb2-4b4a-89db-a89e46f2308e None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:09.396806 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f920599-16c0-4ca7-8cd3-ba6ad258d359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:09.397433 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f920599-16c0-4ca7-8cd3-ba6ad258d359 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:09.397714 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f920599-16c0-4ca7-8cd3-ba6ad258d359 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:09.397987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f920599-16c0-4ca7-8cd3-ba6ad258d359 None admin] PATH_INFO: `/v3/roles/1c6cc7bf29b146b0a9aaf6a07607258a` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:09.399466 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f920599-16c0-4ca7-8cd3-ba6ad258d359 None admin] RBAC: Authorizing `identity:get_role(role_id=1c6cc7bf29b146b0a9aaf6a07607258a)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:09.400837 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f920599-16c0-4ca7-8cd3-ba6ad258d359 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:09.402170 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 560/1126] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:52:09 2022] GET /identity/v3/roles/1c6cc7bf29b146b0a9aaf6a07607258a => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:52:09.408036 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b5578-f701-4216-ac65-351bb92a5095 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:09.504977 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b5578-f701-4216-ac65-351bb92a5095 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:09.506452 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:09.538938 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5308e17-aa69-4556-bb82-8dffaa0532ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:09.539597 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5308e17-aa69-4556-bb82-8dffaa0532ad None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:09.539879 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5308e17-aa69-4556-bb82-8dffaa0532ad None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:09.540152 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5308e17-aa69-4556-bb82-8dffaa0532ad None admin] PATH_INFO: `/v3/users/7741d8d2eb93425c8010309e0e38be97` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:09.541277 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5308e17-aa69-4556-bb82-8dffaa0532ad None admin] RBAC: Authorizing `identity:get_user(user_id=7741d8d2eb93425c8010309e0e38be97)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:09.542729 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5308e17-aa69-4556-bb82-8dffaa0532ad None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:09.544357 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 567/1127] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:52:09 2022] GET /identity/v3/users/7741d8d2eb93425c8010309e0e38be97 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:09.550284 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f920599-16c0-4ca7-8cd3-ba6ad258d359 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:09.647941 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f920599-16c0-4ca7-8cd3-ba6ad258d359 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:09.683637 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a317639-a172-44cd-ae44-17dc37b41bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:09.684239 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a317639-a172-44cd-ae44-17dc37b41bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:09.684518 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a317639-a172-44cd-ae44-17dc37b41bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:09.684791 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a317639-a172-44cd-ae44-17dc37b41bd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:09.693996 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:09.749892 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a317639-a172-44cd-ae44-17dc37b41bd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:09.751351 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a317639-a172-44cd-ae44-17dc37b41bd9 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:09.846264 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 561/1128] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:52:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:52:09.852332 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5308e17-aa69-4556-bb82-8dffaa0532ad None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:09.955446 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5308e17-aa69-4556-bb82-8dffaa0532ad None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:09.989777 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60dc249-5d56-42f9-9368-41f7684ec50c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:09.990395 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dc249-5d56-42f9-9368-41f7684ec50c None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:09.990669 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dc249-5d56-42f9-9368-41f7684ec50c None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:09.990936 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60dc249-5d56-42f9-9368-41f7684ec50c None admin] PATH_INFO: `/v3/projects/4560fa628682484d834d2f4d78432c98` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:09.992060 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60dc249-5d56-42f9-9368-41f7684ec50c None admin] RBAC: Authorizing `identity:get_project(project_id=4560fa628682484d834d2f4d78432c98)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:09.993486 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60dc249-5d56-42f9-9368-41f7684ec50c None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:09.995104 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 568/1129] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:52:09 2022] GET /identity/v3/projects/4560fa628682484d834d2f4d78432c98 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:10.001416 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a317639-a172-44cd-ae44-17dc37b41bd9 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:10.040489 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:10.100269 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a317639-a172-44cd-ae44-17dc37b41bd9 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:10.133299 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964aad8-7791-47cd-8725-e3b34a3dcef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:10.133898 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964aad8-7791-47cd-8725-e3b34a3dcef7 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:10.134170 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964aad8-7791-47cd-8725-e3b34a3dcef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:10.134434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964aad8-7791-47cd-8725-e3b34a3dcef7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:10.135176 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964aad8-7791-47cd-8725-e3b34a3dcef7 None admin] RBAC: Adding query filter params (role.id=1c6cc7bf29b146b0a9aaf6a07607258a, scope.project.id=4560fa628682484d834d2f4d78432c98, user.id=7741d8d2eb93425c8010309e0e38be97) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:52:10.135479 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964aad8-7791-47cd-8725-e3b34a3dcef7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:10.136901 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964aad8-7791-47cd-8725-e3b34a3dcef7 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:10.142558 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 562/1130] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:52:10 2022] GET /identity/v3/role_assignments?user.id=7741d8d2eb93425c8010309e0e38be97&scope.project.id=4560fa628682484d834d2f4d78432c98&role.id=1c6cc7bf29b146b0a9aaf6a07607258a => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:12.076687 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ee3fb-35bd-4362-acc9-d1a7ff5b7a00 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:12.077214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ee3fb-35bd-4362-acc9-d1a7ff5b7a00 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:12.077214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ee3fb-35bd-4362-acc9-d1a7ff5b7a00 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:12.078573 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 569/1131] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:52:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:52:12.084590 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffadbec-d123-4730-9d39-a666dec2b529 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:12.085019 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffadbec-d123-4730-9d39-a666dec2b529 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:12.085110 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffadbec-d123-4730-9d39-a666dec2b529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:12.103901 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-fffadbec-d123-4730-9d39-a666dec2b529 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:52:12.105088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-fffadbec-d123-4730-9d39-a666dec2b529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:52:12.171221 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 563/1132] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:52:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:52:12.444493 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ee3fb-35bd-4362-acc9-d1a7ff5b7a00 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:12.484625 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:12.542565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ee3fb-35bd-4362-acc9-d1a7ff5b7a00 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:12.575235 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5bdf4-b481-4fe8-81e9-001795e5c99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:12.575877 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5bdf4-b481-4fe8-81e9-001795e5c99e None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:12.576147 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5bdf4-b481-4fe8-81e9-001795e5c99e None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:12.576413 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5bdf4-b481-4fe8-81e9-001795e5c99e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:12.577503 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab5bdf4-b481-4fe8-81e9-001795e5c99e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:12.578914 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab5bdf4-b481-4fe8-81e9-001795e5c99e None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:12.580543 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 570/1133] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:52:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:12.586476 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffadbec-d123-4730-9d39-a666dec2b529 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:12.617354 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:12.684781 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffadbec-d123-4730-9d39-a666dec2b529 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:12.717946 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243475d7-6871-4c6c-ab41-81228842d608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:12.718484 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243475d7-6871-4c6c-ab41-81228842d608 None admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:12.718762 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243475d7-6871-4c6c-ab41-81228842d608 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:12.719034 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243475d7-6871-4c6c-ab41-81228842d608 None admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:12.719703 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243475d7-6871-4c6c-ab41-81228842d608 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:12.721712 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243475d7-6871-4c6c-ab41-81228842d608 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:12.817415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 564/1134] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Aug 24 16:52:12 2022] POST /identity/v3/projects => generated 311 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:52:14.808371 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8812b-c2a2-4a93-9296-4d3ef5a7a1cc None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:14.808906 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8812b-c2a2-4a93-9296-4d3ef5a7a1cc None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:14.808906 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf8812b-c2a2-4a93-9296-4d3ef5a7a1cc None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:14.810241 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 571/1135] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:52:14.815422 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d12f90-829a-4d8e-ab2b-481acda20087 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:14.815868 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d12f90-829a-4d8e-ab2b-481acda20087 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:14.815964 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d12f90-829a-4d8e-ab2b-481acda20087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:14.834668 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-80d12f90-829a-4d8e-ab2b-481acda20087 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:52:14.835888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-80d12f90-829a-4d8e-ab2b-481acda20087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:52:14.902276 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 565/1136] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:52:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:52:15.176191 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8812b-c2a2-4a93-9296-4d3ef5a7a1cc None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:15.278398 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf8812b-c2a2-4a93-9296-4d3ef5a7a1cc None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:15.285991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:15.312350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55344eef-b7cc-43e7-9daa-761e14227dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:15.312968 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55344eef-b7cc-43e7-9daa-761e14227dee None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:15.313282 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55344eef-b7cc-43e7-9daa-761e14227dee None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:15.313565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55344eef-b7cc-43e7-9daa-761e14227dee None admin] PATH_INFO: `/v3/domains/default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:15.314710 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55344eef-b7cc-43e7-9daa-761e14227dee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:15.316943 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55344eef-b7cc-43e7-9daa-761e14227dee None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:15.318515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 572/1137] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:52:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:15.324358 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d12f90-829a-4d8e-ab2b-481acda20087 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:15.339124 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:15.423968 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d12f90-829a-4d8e-ab2b-481acda20087 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:15.458421 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40e897-ea06-4f7d-afed-9fa08dba96ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:15.458959 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40e897-ea06-4f7d-afed-9fa08dba96ae None admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:15.459265 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40e897-ea06-4f7d-afed-9fa08dba96ae None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:15.459537 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40e897-ea06-4f7d-afed-9fa08dba96ae None admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:15.460171 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40e897-ea06-4f7d-afed-9fa08dba96ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:15.461587 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c40e897-ea06-4f7d-afed-9fa08dba96ae None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:15.559496 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 566/1138] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Aug 24 16:52:15 2022] POST /identity/v3/users => generated 286 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:52:17.499044 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99781a-1e13-416c-89b9-e3539ccffe8a None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:17.499623 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99781a-1e13-416c-89b9-e3539ccffe8a None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:17.499623 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99781a-1e13-416c-89b9-e3539ccffe8a None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:17.500961 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 573/1139] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:52:17.506930 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7ed6f-26cb-4fb0-9abe-a9969ff2c983 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:17.507487 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7ed6f-26cb-4fb0-9abe-a9969ff2c983 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:17.507487 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db7ed6f-26cb-4fb0-9abe-a9969ff2c983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:17.527248 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-5db7ed6f-26cb-4fb0-9abe-a9969ff2c983 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:52:17.528440 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-5db7ed6f-26cb-4fb0-9abe-a9969ff2c983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:52:17.588601 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:17.593027 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 567/1140] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:52:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:52:17.862411 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99781a-1e13-416c-89b9-e3539ccffe8a None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:17.964958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99781a-1e13-416c-89b9-e3539ccffe8a None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:18.000856 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d65dbc-ea7f-4ce2-9aaf-86e26f85d302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:18.001657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d65dbc-ea7f-4ce2-9aaf-86e26f85d302 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:18.001972 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d65dbc-ea7f-4ce2-9aaf-86e26f85d302 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:18.002423 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d65dbc-ea7f-4ce2-9aaf-86e26f85d302 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:18.012885 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d65dbc-ea7f-4ce2-9aaf-86e26f85d302 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:52:18.018215 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-37d65dbc-ea7f-4ce2-9aaf-86e26f85d302 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:52:18.018215 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:52:18.018215 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:52:18.018215 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:52:18.018215 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:52:18.018215 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:52:18.018215 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:52:18.018215 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:52:18.018215 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:52:18.018215 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:52:18.018215 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:52:18.018215 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:52:18.018215 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:52:18.018215 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:52:18.018215 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:52:18.018215 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:52:18.019554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:52:18.019554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:52:18.019554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:52:18.019554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:52:18.019554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:52:18.019554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:52:18.019554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:52:18.019554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:52:18.019554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:52:18.019554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:52:18.019554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:52:18.019554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:52:18.019554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:52:18.019554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:52:18.019554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:52:18.019554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:52:18.020561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:52:18.020561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:52:18.020561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:52:18.020561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:52:18.020561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:52:18.020561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:52:18.020561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:52:18.020561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:52:18.020561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:52:18.020561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:52:18.020561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:52:18.020561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:52:18.020561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 574/1141] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:52:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:52:18.026089 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7ed6f-26cb-4fb0-9abe-a9969ff2c983 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:18.122952 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db7ed6f-26cb-4fb0-9abe-a9969ff2c983 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:18.157326 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1111645-5368-472e-b4c3-ffe138ec21d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:18.157926 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1111645-5368-472e-b4c3-ffe138ec21d2 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:18.158246 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1111645-5368-472e-b4c3-ffe138ec21d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:18.159086 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1111645-5368-472e-b4c3-ffe138ec21d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:18.159771 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1111645-5368-472e-b4c3-ffe138ec21d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:52:18.160064 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1111645-5368-472e-b4c3-ffe138ec21d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:18.161420 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1111645-5368-472e-b4c3-ffe138ec21d2 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:18.169473 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 568/1142] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:52:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:18.175565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d65dbc-ea7f-4ce2-9aaf-86e26f85d302 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:18.211370 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:18.275125 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d65dbc-ea7f-4ce2-9aaf-86e26f85d302 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:18.309186 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1e722-b491-4d1c-9b87-a8d2d7d7d2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:18.309812 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1e722-b491-4d1c-9b87-a8d2d7d7d2ea None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:18.310090 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1e722-b491-4d1c-9b87-a8d2d7d7d2ea None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:18.310361 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc1e722-b491-4d1c-9b87-a8d2d7d7d2ea None admin] PATH_INFO: `/v3/users/c589030c2abc4799b2d0418a389f932a` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:18.324092 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1e722-b491-4d1c-9b87-a8d2d7d7d2ea None admin] RBAC: Authorizing `identity:get_user(user_id=c589030c2abc4799b2d0418a389f932a)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:18.325517 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc1e722-b491-4d1c-9b87-a8d2d7d7d2ea None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:18.327156 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 575/1143] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:52:18 2022] GET /identity/v3/users/c589030c2abc4799b2d0418a389f932a => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:18.333787 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1111645-5368-472e-b4c3-ffe138ec21d2 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:18.392486 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:18.430219 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1111645-5368-472e-b4c3-ffe138ec21d2 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:18.463926 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b07165-e8d0-43c2-9c8a-94df14678156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:18.464523 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b07165-e8d0-43c2-9c8a-94df14678156 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:18.464801 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b07165-e8d0-43c2-9c8a-94df14678156 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:18.465071 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b07165-e8d0-43c2-9c8a-94df14678156 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:18.530381 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b07165-e8d0-43c2-9c8a-94df14678156 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:18.531853 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b07165-e8d0-43c2-9c8a-94df14678156 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:18.590239 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:18.629178 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 569/1144] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:52:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:52:18.635193 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1e722-b491-4d1c-9b87-a8d2d7d7d2ea None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:18.725328 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:18.733586 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc1e722-b491-4d1c-9b87-a8d2d7d7d2ea None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:18.767500 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4b6a1-6bd4-480c-9f47-5747f9280526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:18.768150 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4b6a1-6bd4-480c-9f47-5747f9280526 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:18.768423 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4b6a1-6bd4-480c-9f47-5747f9280526 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:18.768744 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4b6a1-6bd4-480c-9f47-5747f9280526 None admin] PATH_INFO: `/v3/projects/65453cc1830642238c6d0786d56d98e4` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:18.769856 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4b6a1-6bd4-480c-9f47-5747f9280526 None admin] RBAC: Authorizing `identity:get_project(project_id=65453cc1830642238c6d0786d56d98e4)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:18.771316 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4b6a1-6bd4-480c-9f47-5747f9280526 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:18.772958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 576/1145] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:52:18 2022] GET /identity/v3/projects/65453cc1830642238c6d0786d56d98e4 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:18.779294 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b07165-e8d0-43c2-9c8a-94df14678156 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:18.879012 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b07165-e8d0-43c2-9c8a-94df14678156 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:18.911387 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a26563-6792-4fcb-92dc-4aa2515b6124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:18.911981 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a26563-6792-4fcb-92dc-4aa2515b6124 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:18.912258 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a26563-6792-4fcb-92dc-4aa2515b6124 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:18.912528 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a26563-6792-4fcb-92dc-4aa2515b6124 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:18.913245 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a26563-6792-4fcb-92dc-4aa2515b6124 None admin] RBAC: Adding query filter params (role.id=99f0ace9fc4d4d028ca52fa9730cab4b, scope.project.id=65453cc1830642238c6d0786d56d98e4, user.id=c589030c2abc4799b2d0418a389f932a) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:52:18.913547 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a26563-6792-4fcb-92dc-4aa2515b6124 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:18.914961 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a26563-6792-4fcb-92dc-4aa2515b6124 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:18.920172 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 570/1146] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:52:18 2022] GET /identity/v3/role_assignments?user.id=c589030c2abc4799b2d0418a389f932a&scope.project.id=65453cc1830642238c6d0786d56d98e4&role.id=99f0ace9fc4d4d028ca52fa9730cab4b => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:20.825848 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5369a4-d8d3-49f4-abcf-13d934012566 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:20.826419 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5369a4-d8d3-49f4-abcf-13d934012566 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:20.826419 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5369a4-d8d3-49f4-abcf-13d934012566 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:20.827740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 577/1147] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:52:20.832976 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb514c-7ea4-41d6-a815-cb4d2417ad2c None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:20.833389 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb514c-7ea4-41d6-a815-cb4d2417ad2c None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:20.833557 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb514c-7ea4-41d6-a815-cb4d2417ad2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:20.851834 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-49eb514c-7ea4-41d6-a815-cb4d2417ad2c None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:52:20.853031 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-49eb514c-7ea4-41d6-a815-cb4d2417ad2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:52:20.874121 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:20.920093 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 571/1148] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:52:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:52:21.191213 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5369a4-d8d3-49f4-abcf-13d934012566 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:21.290153 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5369a4-d8d3-49f4-abcf-13d934012566 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:21.323132 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62cad0c-8d44-426b-8589-ca1efe7b6e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:21.323750 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cad0c-8d44-426b-8589-ca1efe7b6e70 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:21.324022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cad0c-8d44-426b-8589-ca1efe7b6e70 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:21.324290 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62cad0c-8d44-426b-8589-ca1efe7b6e70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:21.334582 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62cad0c-8d44-426b-8589-ca1efe7b6e70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:52:21.339179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-a62cad0c-8d44-426b-8589-ca1efe7b6e70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:52:21.339179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:52:21.339179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:52:21.339179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:52:21.339179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:52:21.339179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:52:21.339179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:52:21.339179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:52:21.339179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:52:21.339179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:52:21.339179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:52:21.339179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:52:21.339179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:52:21.339179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:52:21.339179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:52:21.339179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:52:21.340281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:52:21.340281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:52:21.340281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:52:21.340281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:52:21.340281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:52:21.340281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:52:21.340281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:52:21.340281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:52:21.340281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:52:21.340281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:52:21.340281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:52:21.340281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:52:21.340281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:52:21.340281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:52:21.340281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:52:21.340281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:52:21.341158 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:52:21.341158 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:52:21.341158 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:52:21.341158 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:52:21.341158 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:52:21.341158 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:52:21.341158 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:52:21.341158 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:52:21.341158 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:52:21.341158 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:52:21.341158 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:52:21.341158 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:52:21.341158 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 578/1149] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:52:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:52:21.346596 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb514c-7ea4-41d6-a815-cb4d2417ad2c None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:21.444669 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb514c-7ea4-41d6-a815-cb4d2417ad2c None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:21.478039 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e678e06-4fef-4325-aca8-a8097daad2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:21.478643 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e678e06-4fef-4325-aca8-a8097daad2bd None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:21.478921 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e678e06-4fef-4325-aca8-a8097daad2bd None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:21.479226 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e678e06-4fef-4325-aca8-a8097daad2bd None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:21.479886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e678e06-4fef-4325-aca8-a8097daad2bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:52:21.480189 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e678e06-4fef-4325-aca8-a8097daad2bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:21.481564 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e678e06-4fef-4325-aca8-a8097daad2bd None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:21.489896 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 572/1150] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:52:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:21.495803 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62cad0c-8d44-426b-8589-ca1efe7b6e70 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:21.518453 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:21.593228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62cad0c-8d44-426b-8589-ca1efe7b6e70 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:21.625024 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3c485-0dfb-4079-af16-afd038ffc1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:21.625635 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3c485-0dfb-4079-af16-afd038ffc1e8 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:21.625914 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3c485-0dfb-4079-af16-afd038ffc1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:21.626179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3c485-0dfb-4079-af16-afd038ffc1e8 None admin] PATH_INFO: `/v3/users/c589030c2abc4799b2d0418a389f932a` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:21.627959 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3c485-0dfb-4079-af16-afd038ffc1e8 None admin] RBAC: Authorizing `identity:get_user(user_id=c589030c2abc4799b2d0418a389f932a)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:21.629368 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3c485-0dfb-4079-af16-afd038ffc1e8 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:21.630926 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 579/1151] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:52:21 2022] GET /identity/v3/users/c589030c2abc4799b2d0418a389f932a => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:21.636808 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e678e06-4fef-4325-aca8-a8097daad2bd None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:21.656438 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:21.736617 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e678e06-4fef-4325-aca8-a8097daad2bd None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:21.772395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697a65d-f38e-44c4-a15e-48e000ceaa10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:21.773023 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697a65d-f38e-44c4-a15e-48e000ceaa10 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:21.773305 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697a65d-f38e-44c4-a15e-48e000ceaa10 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:21.773579 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697a65d-f38e-44c4-a15e-48e000ceaa10 None admin] PATH_INFO: `/v3/projects/65453cc1830642238c6d0786d56d98e4` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:21.774697 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697a65d-f38e-44c4-a15e-48e000ceaa10 None admin] RBAC: Authorizing `identity:get_project(project_id=65453cc1830642238c6d0786d56d98e4)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:21.776153 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697a65d-f38e-44c4-a15e-48e000ceaa10 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:21.777780 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 573/1152] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:52:21 2022] GET /identity/v3/projects/65453cc1830642238c6d0786d56d98e4 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:21.783982 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3c485-0dfb-4079-af16-afd038ffc1e8 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:21.874463 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:21.886606 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3c485-0dfb-4079-af16-afd038ffc1e8 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:21.921482 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4179327-0e94-4108-afbd-89fc376e955d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:21.922129 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4179327-0e94-4108-afbd-89fc376e955d None admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:21.922403 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4179327-0e94-4108-afbd-89fc376e955d None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:21.922670 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4179327-0e94-4108-afbd-89fc376e955d None admin] PATH_INFO: `/v3/projects/65453cc1830642238c6d0786d56d98e4/users/c589030c2abc4799b2d0418a389f932a/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:21.925098 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4179327-0e94-4108-afbd-89fc376e955d None admin] RBAC: Authorizing `identity:create_grant(project_id=65453cc1830642238c6d0786d56d98e4, user_id=c589030c2abc4799b2d0418a389f932a, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:21.926504 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4179327-0e94-4108-afbd-89fc376e955d None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:22.016972 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 580/1153] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Aug 24 16:52:21 2022] PUT /identity/v3/projects/65453cc1830642238c6d0786d56d98e4/users/c589030c2abc4799b2d0418a389f932a/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:52:23.927329 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9318f-2121-444e-a480-75f340cc0a3f None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:23.927857 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9318f-2121-444e-a480-75f340cc0a3f None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:23.927857 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9318f-2121-444e-a480-75f340cc0a3f None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:23.929226 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 574/1154] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:52:23.934717 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c359e-8585-4d68-a685-b0c24e14eb7f None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:23.935185 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c359e-8585-4d68-a685-b0c24e14eb7f None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:23.935279 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c359e-8585-4d68-a685-b0c24e14eb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:23.953596 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-3f3c359e-8585-4d68-a685-b0c24e14eb7f None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:52:23.955656 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-3f3c359e-8585-4d68-a685-b0c24e14eb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:52:24.022495 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 581/1155] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:52:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:52:24.290214 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9318f-2121-444e-a480-75f340cc0a3f None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:24.376613 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:24.391794 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9318f-2121-444e-a480-75f340cc0a3f None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:24.428278 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9dcf5-e09a-42e5-9853-0ce68c7bfafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:24.428900 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9dcf5-e09a-42e5-9853-0ce68c7bfafb None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:24.429174 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9dcf5-e09a-42e5-9853-0ce68c7bfafb None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:24.429443 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc9dcf5-e09a-42e5-9853-0ce68c7bfafb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:24.439843 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc9dcf5-e09a-42e5-9853-0ce68c7bfafb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:52:24.444599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-6cc9dcf5-e09a-42e5-9853-0ce68c7bfafb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:52:24.444599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:52:24.444599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:52:24.444599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:52:24.444599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:52:24.444599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:52:24.444599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:52:24.444599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:52:24.444599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:52:24.444599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:52:24.444599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:52:24.444599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:52:24.444599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:52:24.444599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:52:24.444599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:52:24.444599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:52:24.445700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:52:24.445700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:52:24.445700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:52:24.445700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:52:24.445700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:52:24.445700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:52:24.445700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:52:24.445700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:52:24.445700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:52:24.445700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:52:24.445700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:52:24.445700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:52:24.445700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:52:24.445700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:52:24.445700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:52:24.445700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:52:24.446763 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:52:24.446763 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:52:24.446763 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:52:24.446763 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:52:24.446763 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:52:24.446763 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:52:24.446763 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:52:24.446763 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:52:24.446763 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:52:24.446763 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:52:24.446763 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:52:24.446763 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:52:24.446763 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 575/1156] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:52:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:52:24.452016 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c359e-8585-4d68-a685-b0c24e14eb7f None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:24.528764 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:24.550755 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c359e-8585-4d68-a685-b0c24e14eb7f None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:24.584153 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675881ab-8263-42e5-b65f-48c1b73e0470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:24.584756 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675881ab-8263-42e5-b65f-48c1b73e0470 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:24.585031 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675881ab-8263-42e5-b65f-48c1b73e0470 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:24.585298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675881ab-8263-42e5-b65f-48c1b73e0470 None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:24.586015 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675881ab-8263-42e5-b65f-48c1b73e0470 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:52:24.586312 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675881ab-8263-42e5-b65f-48c1b73e0470 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:24.587722 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675881ab-8263-42e5-b65f-48c1b73e0470 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:24.596944 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 582/1157] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:52:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:24.602971 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9dcf5-e09a-42e5-9853-0ce68c7bfafb None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:24.704127 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc9dcf5-e09a-42e5-9853-0ce68c7bfafb None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:24.739385 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115642a-0f69-494b-ba12-f2651b52b278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:24.740018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115642a-0f69-494b-ba12-f2651b52b278 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:24.740298 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115642a-0f69-494b-ba12-f2651b52b278 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:24.740572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4115642a-0f69-494b-ba12-f2651b52b278 None admin] PATH_INFO: `/v3/users/c589030c2abc4799b2d0418a389f932a` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:24.741691 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115642a-0f69-494b-ba12-f2651b52b278 None admin] RBAC: Authorizing `identity:get_user(user_id=c589030c2abc4799b2d0418a389f932a)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:24.743152 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4115642a-0f69-494b-ba12-f2651b52b278 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:24.744757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 576/1158] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:52:24 2022] GET /identity/v3/users/c589030c2abc4799b2d0418a389f932a => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:24.750952 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675881ab-8263-42e5-b65f-48c1b73e0470 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:24.851220 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675881ab-8263-42e5-b65f-48c1b73e0470 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:24.885459 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23417a-f729-4791-8fe0-af56db59d7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:24.886061 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23417a-f729-4791-8fe0-af56db59d7bc None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:24.886336 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23417a-f729-4791-8fe0-af56db59d7bc None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:24.886617 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23417a-f729-4791-8fe0-af56db59d7bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:24.897558 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:24.955309 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be23417a-f729-4791-8fe0-af56db59d7bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:24.956761 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be23417a-f729-4791-8fe0-af56db59d7bc None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:25.054539 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 583/1159] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:52:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:52:25.060900 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115642a-0f69-494b-ba12-f2651b52b278 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:25.077055 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:25.164248 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4115642a-0f69-494b-ba12-f2651b52b278 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:25.198459 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4363f568-1f7f-4f26-88c4-b6bd89ad138c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:25.199083 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363f568-1f7f-4f26-88c4-b6bd89ad138c None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:25.199389 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363f568-1f7f-4f26-88c4-b6bd89ad138c None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:25.199659 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363f568-1f7f-4f26-88c4-b6bd89ad138c None admin] PATH_INFO: `/v3/projects/65453cc1830642238c6d0786d56d98e4` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:25.200762 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363f568-1f7f-4f26-88c4-b6bd89ad138c None admin] RBAC: Authorizing `identity:get_project(project_id=65453cc1830642238c6d0786d56d98e4)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:25.202189 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4363f568-1f7f-4f26-88c4-b6bd89ad138c None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:25.203838 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 577/1160] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:52:25 2022] GET /identity/v3/projects/65453cc1830642238c6d0786d56d98e4 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:25.210796 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23417a-f729-4791-8fe0-af56db59d7bc None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:25.252841 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:25.311313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23417a-f729-4791-8fe0-af56db59d7bc None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:25.349755 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd325acc-1c41-404a-8957-b9d1aa6faa5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:25.350363 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd325acc-1c41-404a-8957-b9d1aa6faa5a None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:25.350640 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd325acc-1c41-404a-8957-b9d1aa6faa5a None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:25.350909 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd325acc-1c41-404a-8957-b9d1aa6faa5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:25.351670 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd325acc-1c41-404a-8957-b9d1aa6faa5a None admin] RBAC: Adding query filter params (role.id=99f0ace9fc4d4d028ca52fa9730cab4b, scope.project.id=65453cc1830642238c6d0786d56d98e4, user.id=c589030c2abc4799b2d0418a389f932a) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:52:25.351974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd325acc-1c41-404a-8957-b9d1aa6faa5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:25.353394 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd325acc-1c41-404a-8957-b9d1aa6faa5a None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:25.359337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 584/1161] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:52:25 2022] GET /identity/v3/role_assignments?user.id=c589030c2abc4799b2d0418a389f932a&scope.project.id=65453cc1830642238c6d0786d56d98e4&role.id=99f0ace9fc4d4d028ca52fa9730cab4b => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:27.316164 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18b7ad-d166-4a33-9f80-4aeb942ddbaf None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:27.316727 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18b7ad-d166-4a33-9f80-4aeb942ddbaf None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:27.316727 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca18b7ad-d166-4a33-9f80-4aeb942ddbaf None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:27.318027 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 578/1162] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:52:27.323348 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb041e9-2e4d-4a18-8e23-1875103f3fc8 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:27.323729 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb041e9-2e4d-4a18-8e23-1875103f3fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:27.323901 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb041e9-2e4d-4a18-8e23-1875103f3fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:27.342757 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-5bb041e9-2e4d-4a18-8e23-1875103f3fc8 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:52:27.343981 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-5bb041e9-2e4d-4a18-8e23-1875103f3fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:52:27.408925 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 585/1163] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:52:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:52:27.679280 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18b7ad-d166-4a33-9f80-4aeb942ddbaf None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:27.759493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:27.777605 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca18b7ad-d166-4a33-9f80-4aeb942ddbaf None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:27.811163 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf01558-28f1-4547-8bb7-4e48124ecfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:27.812193 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf01558-28f1-4547-8bb7-4e48124ecfc1 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:27.812450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf01558-28f1-4547-8bb7-4e48124ecfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:27.812712 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf01558-28f1-4547-8bb7-4e48124ecfc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:27.878650 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf01558-28f1-4547-8bb7-4e48124ecfc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:27.880132 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf01558-28f1-4547-8bb7-4e48124ecfc1 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:27.957204 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:27.975015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 579/1164] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:52:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:52:27.981149 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb041e9-2e4d-4a18-8e23-1875103f3fc8 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:28.015074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:28.080176 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb041e9-2e4d-4a18-8e23-1875103f3fc8 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:28.113875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254dad69-27e4-4544-a474-80603ae445de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:28.114500 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dad69-27e4-4544-a474-80603ae445de None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:28.114779 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dad69-27e4-4544-a474-80603ae445de None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:28.115050 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dad69-27e4-4544-a474-80603ae445de None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:28.121582 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254dad69-27e4-4544-a474-80603ae445de None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:28.123016 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254dad69-27e4-4544-a474-80603ae445de None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:28.134195 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-254dad69-27e4-4544-a474-80603ae445de None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 16:52:28.134195 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:52:28.134195 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 16:52:28.134195 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 16:52:28.134195 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:52:28.134195 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:52:28.134195 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:52:28.134195 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:52:28.134195 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 16:52:28.134195 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:52:28.134195 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:52:28.134195 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:52:28.134195 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:52:28.134195 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:52:28.134195 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:52:28.134195 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:52:28.134195 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:52:28.135518 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:52:28.135518 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:52:28.135518 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:52:28.135518 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:52:28.135518 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:52:28.135518 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:52:28.135518 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:52:28.135518 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:52:28.135518 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:52:28.135518 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:52:28.135518 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:52:28.135518 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:52:28.135518 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:52:28.135518 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:52:28.135518 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:52:28.135518 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:52:28.136752 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:52:28.136752 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:52:28.136752 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:52:28.136752 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:52:28.136752 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:52:28.136752 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:52:28.136752 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:52:28.136752 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:52:28.136752 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:52:28.136752 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:52:28.136752 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 16:52:28.136752 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:52:28.136752 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 16:52:28.136752 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:52:28.136752 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 586/1165] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Aug 24 16:52:27 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:52:28.141379 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf01558-28f1-4547-8bb7-4e48124ecfc1 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:28.243007 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf01558-28f1-4547-8bb7-4e48124ecfc1 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:28.278645 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce76f2a-f04d-4b32-8016-7ce837cdbe48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:28.279277 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce76f2a-f04d-4b32-8016-7ce837cdbe48 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:28.279592 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce76f2a-f04d-4b32-8016-7ce837cdbe48 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:28.279822 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce76f2a-f04d-4b32-8016-7ce837cdbe48 None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:28.280515 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce76f2a-f04d-4b32-8016-7ce837cdbe48 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:52:28.280813 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce76f2a-f04d-4b32-8016-7ce837cdbe48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:28.282166 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce76f2a-f04d-4b32-8016-7ce837cdbe48 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:28.289969 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 580/1166] 10.222.0.55 () {56 vars in 1115 bytes} [Wed Aug 24 16:52:28 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:30.186105 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23a5b3-bcb3-4271-9e08-d66aa465007d None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:30.186636 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23a5b3-bcb3-4271-9e08-d66aa465007d None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:30.186636 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23a5b3-bcb3-4271-9e08-d66aa465007d None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:30.188092 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 587/1167] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:52:30.193825 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09f0b7-da31-4f9e-8df7-7488e4760e61 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:30.194281 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09f0b7-da31-4f9e-8df7-7488e4760e61 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:30.194379 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b09f0b7-da31-4f9e-8df7-7488e4760e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:30.212228 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-1b09f0b7-da31-4f9e-8df7-7488e4760e61 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:52:30.213421 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-1b09f0b7-da31-4f9e-8df7-7488e4760e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:52:30.255861 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:30.281089 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 581/1168] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:52:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:52:30.552551 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23a5b3-bcb3-4271-9e08-d66aa465007d None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:30.650849 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:30.660273 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23a5b3-bcb3-4271-9e08-d66aa465007d None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:30.694573 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd4b04-11d1-40ac-8c42-6154f037f0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:30.695292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd4b04-11d1-40ac-8c42-6154f037f0d7 None admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:30.695849 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd4b04-11d1-40ac-8c42-6154f037f0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:30.696170 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd4b04-11d1-40ac-8c42-6154f037f0d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:30.697086 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd4b04-11d1-40ac-8c42-6154f037f0d7 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:30.698760 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd4b04-11d1-40ac-8c42-6154f037f0d7 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:30.772642 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 588/1169] 10.222.0.55 () {60 vars in 1138 bytes} [Wed Aug 24 16:52:30 2022] POST /identity/v3/domains => generated 267 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:52:32.758216 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743874f-7302-4515-8fb3-10460b8950a7 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:32.758782 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743874f-7302-4515-8fb3-10460b8950a7 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:32.758782 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743874f-7302-4515-8fb3-10460b8950a7 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:32.760201 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 582/1170] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:52:32.765711 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca339db6-5502-4376-9786-3d93c33f6ed8 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:32.766162 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca339db6-5502-4376-9786-3d93c33f6ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:32.766262 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca339db6-5502-4376-9786-3d93c33f6ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:32.784722 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-ca339db6-5502-4376-9786-3d93c33f6ed8 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:52:32.785895 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-ca339db6-5502-4376-9786-3d93c33f6ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:52:32.851952 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 589/1171] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:52:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:52:33.129742 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743874f-7302-4515-8fb3-10460b8950a7 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:33.233550 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1743874f-7302-4515-8fb3-10460b8950a7 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:33.268888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e5e75-6e1f-4b46-a685-15ca9c2e0079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:33.269526 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e5e75-6e1f-4b46-a685-15ca9c2e0079 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:33.269807 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e5e75-6e1f-4b46-a685-15ca9c2e0079 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:33.270082 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e5e75-6e1f-4b46-a685-15ca9c2e0079 None admin] PATH_INFO: `/v3/domains/c8af106c654f42c09e83eb0beec41c34` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:33.280980 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e5e75-6e1f-4b46-a685-15ca9c2e0079 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c8af106c654f42c09e83eb0beec41c34)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:33.282597 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4e5e75-6e1f-4b46-a685-15ca9c2e0079 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:33.284316 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 583/1172] 10.222.0.55 () {56 vars in 1183 bytes} [Wed Aug 24 16:52:33 2022] GET /identity/v3/domains/c8af106c654f42c09e83eb0beec41c34 => generated 267 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:33.291098 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca339db6-5502-4376-9786-3d93c33f6ed8 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:33.379320 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:33.399770 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca339db6-5502-4376-9786-3d93c33f6ed8 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:33.440717 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684d0170-7fed-4286-950b-4c4a5e959c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:33.441337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d0170-7fed-4286-950b-4c4a5e959c15 None admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:33.441621 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d0170-7fed-4286-950b-4c4a5e959c15 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:33.441895 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684d0170-7fed-4286-950b-4c4a5e959c15 None admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:33.442554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684d0170-7fed-4286-950b-4c4a5e959c15 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:33.444043 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684d0170-7fed-4286-950b-4c4a5e959c15 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:33.533097 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 590/1173] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Aug 24 16:52:33 2022] POST /identity/v3/projects => generated 361 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:52:35.510654 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb214010-80c8-423c-a292-4046b47d7664 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:35.511252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb214010-80c8-423c-a292-4046b47d7664 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:35.511252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb214010-80c8-423c-a292-4046b47d7664 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:35.512559 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 584/1174] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:52:35.518211 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853b641-afc9-4de2-b695-50310839427e None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:35.518689 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853b641-afc9-4de2-b695-50310839427e None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:35.518799 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853b641-afc9-4de2-b695-50310839427e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:35.538918 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-f853b641-afc9-4de2-b695-50310839427e None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:52:35.540214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-f853b641-afc9-4de2-b695-50310839427e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:52:35.609186 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 591/1175] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:52:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:52:35.883698 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb214010-80c8-423c-a292-4046b47d7664 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:35.921054 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:35.985862 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb214010-80c8-423c-a292-4046b47d7664 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:36.018304 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1033ebf6-773c-4524-8f0d-546b0781237c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:36.018908 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033ebf6-773c-4524-8f0d-546b0781237c None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:36.019210 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033ebf6-773c-4524-8f0d-546b0781237c None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:36.019479 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033ebf6-773c-4524-8f0d-546b0781237c None admin] PATH_INFO: `/v3/domains/c8af106c654f42c09e83eb0beec41c34` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:36.020579 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033ebf6-773c-4524-8f0d-546b0781237c None admin] RBAC: Authorizing `identity:get_domain(domain_id=c8af106c654f42c09e83eb0beec41c34)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:36.021992 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1033ebf6-773c-4524-8f0d-546b0781237c None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:36.023573 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 585/1176] 10.222.0.55 () {56 vars in 1183 bytes} [Wed Aug 24 16:52:35 2022] GET /identity/v3/domains/c8af106c654f42c09e83eb0beec41c34 => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:36.029394 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853b641-afc9-4de2-b695-50310839427e None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:36.092893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:36.126975 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853b641-afc9-4de2-b695-50310839427e None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:36.161970 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da690d42-8e91-43da-a968-e651a6ed360f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:36.162565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da690d42-8e91-43da-a968-e651a6ed360f None admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:36.162839 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da690d42-8e91-43da-a968-e651a6ed360f None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:36.163142 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da690d42-8e91-43da-a968-e651a6ed360f None admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:36.163776 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da690d42-8e91-43da-a968-e651a6ed360f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:36.165189 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da690d42-8e91-43da-a968-e651a6ed360f None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:36.291069 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 592/1177] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Aug 24 16:52:36 2022] POST /identity/v3/users => generated 311 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:52:38.281891 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe63a6b-4c94-4b04-b2a7-8587ef6780ef None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:38.283650 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe63a6b-4c94-4b04-b2a7-8587ef6780ef None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:38.283650 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe63a6b-4c94-4b04-b2a7-8587ef6780ef None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:38.284802 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 586/1178] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:52:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:52:38.290412 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0819ed-2c41-4799-ac49-56f513193ad9 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:38.290905 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0819ed-2c41-4799-ac49-56f513193ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:38.291013 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0819ed-2c41-4799-ac49-56f513193ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:38.310228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-9e0819ed-2c41-4799-ac49-56f513193ad9 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:52:38.311506 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-9e0819ed-2c41-4799-ac49-56f513193ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:52:38.382194 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 593/1179] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:52:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:52:38.649455 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe63a6b-4c94-4b04-b2a7-8587ef6780ef None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:38.748826 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe63a6b-4c94-4b04-b2a7-8587ef6780ef None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:38.751906 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:38.784082 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70f912-447e-4a4d-bbe7-f3c9d53db8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:38.784718 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70f912-447e-4a4d-bbe7-f3c9d53db8a7 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:38.784995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70f912-447e-4a4d-bbe7-f3c9d53db8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:38.785272 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c70f912-447e-4a4d-bbe7-f3c9d53db8a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:38.796497 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c70f912-447e-4a4d-bbe7-f3c9d53db8a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:52:38.801585 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-1c70f912-447e-4a4d-bbe7-f3c9d53db8a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:52:38.801585 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:52:38.801585 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:52:38.801585 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:52:38.801585 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:52:38.801585 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:52:38.801585 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:52:38.801585 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:52:38.801585 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:52:38.801585 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:52:38.801585 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:52:38.801585 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:52:38.801585 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:52:38.801585 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:52:38.801585 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:52:38.801585 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:52:38.802819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:52:38.802819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:52:38.802819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:52:38.802819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:52:38.802819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:52:38.802819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:52:38.802819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:52:38.802819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:52:38.802819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:52:38.802819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:52:38.802819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:52:38.802819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:52:38.802819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:52:38.802819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:52:38.802819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:52:38.802819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:52:38.803777 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:52:38.803777 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:52:38.803777 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:52:38.803777 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:52:38.803777 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:52:38.803777 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:52:38.803777 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:52:38.803777 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:52:38.803777 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:52:38.803777 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:52:38.803777 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:52:38.803777 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:52:38.803777 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 587/1180] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:52:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:52:38.809404 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0819ed-2c41-4799-ac49-56f513193ad9 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:38.871426 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:38.924105 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0819ed-2c41-4799-ac49-56f513193ad9 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:38.961053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cf1ae-1a3b-4462-83d6-4499c5ec4861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:38.961671 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cf1ae-1a3b-4462-83d6-4499c5ec4861 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:38.961953 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cf1ae-1a3b-4462-83d6-4499c5ec4861 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:38.962228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cf1ae-1a3b-4462-83d6-4499c5ec4861 None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:38.962903 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cf1ae-1a3b-4462-83d6-4499c5ec4861 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:52:38.963239 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cf1ae-1a3b-4462-83d6-4499c5ec4861 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:38.964609 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cf1ae-1a3b-4462-83d6-4499c5ec4861 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:38.974187 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 594/1181] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:52:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:38.979983 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70f912-447e-4a4d-bbe7-f3c9d53db8a7 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:39.082982 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c70f912-447e-4a4d-bbe7-f3c9d53db8a7 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:39.117727 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85add6fc-a8fc-4067-9bf0-ab7f83d88463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:39.118353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85add6fc-a8fc-4067-9bf0-ab7f83d88463 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:39.118628 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85add6fc-a8fc-4067-9bf0-ab7f83d88463 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:39.118944 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85add6fc-a8fc-4067-9bf0-ab7f83d88463 None admin] PATH_INFO: `/v3/users/71ad2567720e4c368ef4e456823921e9` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:39.133161 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85add6fc-a8fc-4067-9bf0-ab7f83d88463 None admin] RBAC: Authorizing `identity:get_user(user_id=71ad2567720e4c368ef4e456823921e9)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:39.134760 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85add6fc-a8fc-4067-9bf0-ab7f83d88463 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:39.136496 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 588/1182] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:52:38 2022] GET /identity/v3/users/71ad2567720e4c368ef4e456823921e9 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:39.143350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cf1ae-1a3b-4462-83d6-4499c5ec4861 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:39.246703 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cf1ae-1a3b-4462-83d6-4499c5ec4861 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:39.262120 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:39.282555 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbdffa-cc4d-481e-b78c-1d91f0f0ff68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:39.283544 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbdffa-cc4d-481e-b78c-1d91f0f0ff68 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:39.283544 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbdffa-cc4d-481e-b78c-1d91f0f0ff68 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:39.283894 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fbdffa-cc4d-481e-b78c-1d91f0f0ff68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:39.356804 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbdffa-cc4d-481e-b78c-1d91f0f0ff68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:39.358342 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fbdffa-cc4d-481e-b78c-1d91f0f0ff68 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:39.466659 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 595/1183] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:52:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:52:39.472945 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85add6fc-a8fc-4067-9bf0-ab7f83d88463 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:39.497618 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:39.570837 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85add6fc-a8fc-4067-9bf0-ab7f83d88463 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:39.603703 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb76f33-2211-42df-a49d-30c7a00c194b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:39.604328 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb76f33-2211-42df-a49d-30c7a00c194b None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:39.604603 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb76f33-2211-42df-a49d-30c7a00c194b None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:39.604872 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb76f33-2211-42df-a49d-30c7a00c194b None admin] PATH_INFO: `/v3/projects/3415692655af4ec69b85c329ecf10668` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:39.605961 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb76f33-2211-42df-a49d-30c7a00c194b None admin] RBAC: Authorizing `identity:get_project(project_id=3415692655af4ec69b85c329ecf10668)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:39.607414 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb76f33-2211-42df-a49d-30c7a00c194b None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:39.609034 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 589/1184] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:52:39 2022] GET /identity/v3/projects/3415692655af4ec69b85c329ecf10668 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:39.615869 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbdffa-cc4d-481e-b78c-1d91f0f0ff68 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:39.630843 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:39.711744 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fbdffa-cc4d-481e-b78c-1d91f0f0ff68 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:39.744509 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb19ab-0ccf-412f-a76a-967a3d5cc1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:39.745098 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb19ab-0ccf-412f-a76a-967a3d5cc1ab None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:39.745372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb19ab-0ccf-412f-a76a-967a3d5cc1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:39.745638 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb19ab-0ccf-412f-a76a-967a3d5cc1ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:39.746346 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb19ab-0ccf-412f-a76a-967a3d5cc1ab None admin] RBAC: Adding query filter params (role.id=99f0ace9fc4d4d028ca52fa9730cab4b, scope.project.id=3415692655af4ec69b85c329ecf10668, user.id=71ad2567720e4c368ef4e456823921e9) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:52:39.746649 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb19ab-0ccf-412f-a76a-967a3d5cc1ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:39.748127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb19ab-0ccf-412f-a76a-967a3d5cc1ab None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:39.753311 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 596/1185] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:52:39 2022] GET /identity/v3/role_assignments?user.id=71ad2567720e4c368ef4e456823921e9&scope.project.id=3415692655af4ec69b85c329ecf10668&role.id=99f0ace9fc4d4d028ca52fa9730cab4b => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:41.651708 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb4f8f-20d4-4570-a74b-6402484ca543 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:41.652260 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb4f8f-20d4-4570-a74b-6402484ca543 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:41.652260 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eb4f8f-20d4-4570-a74b-6402484ca543 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:41.653575 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 590/1186] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:52:41.660893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26518ec6-c4b0-42bc-ad32-05cb73fa90e9 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:41.661361 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26518ec6-c4b0-42bc-ad32-05cb73fa90e9 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:41.661454 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26518ec6-c4b0-42bc-ad32-05cb73fa90e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:41.678921 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-26518ec6-c4b0-42bc-ad32-05cb73fa90e9 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:52:41.680126 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-26518ec6-c4b0-42bc-ad32-05cb73fa90e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:52:41.751255 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 597/1187] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:52:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:52:42.018574 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb4f8f-20d4-4570-a74b-6402484ca543 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:42.107923 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:42.118861 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eb4f8f-20d4-4570-a74b-6402484ca543 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:42.152103 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ec9fe-db42-4cc2-8c47-1490365362cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:42.152721 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ec9fe-db42-4cc2-8c47-1490365362cb None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:42.152995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ec9fe-db42-4cc2-8c47-1490365362cb None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:42.153263 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ec9fe-db42-4cc2-8c47-1490365362cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:42.162986 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ec9fe-db42-4cc2-8c47-1490365362cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:52:42.167572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-162ec9fe-db42-4cc2-8c47-1490365362cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:52:42.167572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:52:42.167572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:52:42.167572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:52:42.167572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:52:42.167572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:52:42.167572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:52:42.167572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:52:42.167572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:52:42.167572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:52:42.167572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:52:42.167572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:52:42.167572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:52:42.167572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:52:42.167572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:52:42.167572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:52:42.168637 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:52:42.168637 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:52:42.168637 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:52:42.168637 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:52:42.168637 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:52:42.168637 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:52:42.168637 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:52:42.168637 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:52:42.168637 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:52:42.168637 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:52:42.168637 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:52:42.168637 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:52:42.168637 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:52:42.168637 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:52:42.168637 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:52:42.168637 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:52:42.169502 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:52:42.169502 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:52:42.169502 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:52:42.169502 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:52:42.169502 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:52:42.169502 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:52:42.169502 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:52:42.169502 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:52:42.169502 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:52:42.169502 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:52:42.169502 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:52:42.169502 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:52:42.169502 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 591/1188] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:52:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:52:42.175571 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26518ec6-c4b0-42bc-ad32-05cb73fa90e9 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:42.186740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:42.280672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26518ec6-c4b0-42bc-ad32-05cb73fa90e9 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:42.317483 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595272e6-cea3-41ea-b069-9b93acc9667d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:42.318108 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595272e6-cea3-41ea-b069-9b93acc9667d None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:42.318382 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595272e6-cea3-41ea-b069-9b93acc9667d None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:42.318649 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595272e6-cea3-41ea-b069-9b93acc9667d None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:42.319397 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595272e6-cea3-41ea-b069-9b93acc9667d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:52:42.319657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595272e6-cea3-41ea-b069-9b93acc9667d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:42.321057 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595272e6-cea3-41ea-b069-9b93acc9667d None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:42.330776 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 598/1189] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:52:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:42.336859 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ec9fe-db42-4cc2-8c47-1490365362cb None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:42.448632 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ec9fe-db42-4cc2-8c47-1490365362cb None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:42.482207 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdb2f5-812e-4c5a-8e27-492323261bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:42.482834 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdb2f5-812e-4c5a-8e27-492323261bef None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:42.483142 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdb2f5-812e-4c5a-8e27-492323261bef None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:42.483408 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdb2f5-812e-4c5a-8e27-492323261bef None admin] PATH_INFO: `/v3/users/71ad2567720e4c368ef4e456823921e9` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:42.485104 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdb2f5-812e-4c5a-8e27-492323261bef None admin] RBAC: Authorizing `identity:get_user(user_id=71ad2567720e4c368ef4e456823921e9)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:42.486534 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdb2f5-812e-4c5a-8e27-492323261bef None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:42.488156 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 592/1190] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:52:42 2022] GET /identity/v3/users/71ad2567720e4c368ef4e456823921e9 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:42.494009 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595272e6-cea3-41ea-b069-9b93acc9667d None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:42.563214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:42.593115 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595272e6-cea3-41ea-b069-9b93acc9667d None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:42.631025 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dc0b9b-7c69-4d68-84fe-581cc95855ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:42.631680 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc0b9b-7c69-4d68-84fe-581cc95855ab None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:42.631971 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc0b9b-7c69-4d68-84fe-581cc95855ab None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:42.632242 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dc0b9b-7c69-4d68-84fe-581cc95855ab None admin] PATH_INFO: `/v3/projects/3415692655af4ec69b85c329ecf10668` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:42.633355 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc0b9b-7c69-4d68-84fe-581cc95855ab None admin] RBAC: Authorizing `identity:get_project(project_id=3415692655af4ec69b85c329ecf10668)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:42.634778 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dc0b9b-7c69-4d68-84fe-581cc95855ab None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:42.636445 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 599/1191] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:52:42 2022] GET /identity/v3/projects/3415692655af4ec69b85c329ecf10668 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:42.642501 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdb2f5-812e-4c5a-8e27-492323261bef None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:42.662013 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:42.745602 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdb2f5-812e-4c5a-8e27-492323261bef None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:42.779588 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61d4cd0-be4a-416e-b33e-47e14aedf4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:42.780250 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d4cd0-be4a-416e-b33e-47e14aedf4be None admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:42.780528 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d4cd0-be4a-416e-b33e-47e14aedf4be None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:42.780799 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61d4cd0-be4a-416e-b33e-47e14aedf4be None admin] PATH_INFO: `/v3/projects/3415692655af4ec69b85c329ecf10668/users/71ad2567720e4c368ef4e456823921e9/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:42.783335 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d4cd0-be4a-416e-b33e-47e14aedf4be None admin] RBAC: Authorizing `identity:create_grant(project_id=3415692655af4ec69b85c329ecf10668, user_id=71ad2567720e4c368ef4e456823921e9, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:42.784774 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61d4cd0-be4a-416e-b33e-47e14aedf4be None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:42.856833 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 593/1192] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Aug 24 16:52:42 2022] PUT /identity/v3/projects/3415692655af4ec69b85c329ecf10668/users/71ad2567720e4c368ef4e456823921e9/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:52:44.755162 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62814c4d-f532-418a-baca-3152117c19bf None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:44.755756 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62814c4d-f532-418a-baca-3152117c19bf None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:44.755756 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62814c4d-f532-418a-baca-3152117c19bf None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:44.757048 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 600/1193] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:52:44.762669 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363a792-1270-4f65-84d2-3f5cab571392 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:44.763173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363a792-1270-4f65-84d2-3f5cab571392 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:44.763269 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2363a792-1270-4f65-84d2-3f5cab571392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:44.782884 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-2363a792-1270-4f65-84d2-3f5cab571392 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:52:44.784106 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-2363a792-1270-4f65-84d2-3f5cab571392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:52:44.852692 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 594/1194] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:52:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:52:45.125532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62814c4d-f532-418a-baca-3152117c19bf None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:45.228783 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62814c4d-f532-418a-baca-3152117c19bf None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:45.262662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787d09b-bf43-41f1-838c-46aea3928853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:45.263310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787d09b-bf43-41f1-838c-46aea3928853 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:45.263587 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787d09b-bf43-41f1-838c-46aea3928853 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:45.263854 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787d09b-bf43-41f1-838c-46aea3928853 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:45.270869 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:45.274380 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1787d09b-bf43-41f1-838c-46aea3928853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:52:45.278972 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-1787d09b-bf43-41f1-838c-46aea3928853 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:52:45.278972 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:52:45.278972 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:52:45.278972 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:52:45.278972 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:52:45.278972 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:52:45.278972 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:52:45.278972 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:52:45.278972 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:52:45.278972 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:52:45.278972 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:52:45.278972 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:52:45.278972 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:52:45.278972 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:52:45.278972 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:52:45.278972 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:52:45.280292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:52:45.280292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:52:45.280292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:52:45.280292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:52:45.280292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:52:45.280292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:52:45.280292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:52:45.280292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:52:45.280292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:52:45.280292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:52:45.280292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:52:45.280292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:52:45.280292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:52:45.280292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:52:45.280292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:52:45.280292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:52:45.281155 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:52:45.281155 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:52:45.281155 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:52:45.281155 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:52:45.281155 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:52:45.281155 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:52:45.281155 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:52:45.281155 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:52:45.281155 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:52:45.281155 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:52:45.281155 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:52:45.281155 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:52:45.281155 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 601/1195] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:52:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:52:45.286675 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363a792-1270-4f65-84d2-3f5cab571392 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:45.297345 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:45.388607 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2363a792-1270-4f65-84d2-3f5cab571392 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:45.424879 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85223efb-db47-4840-8381-dc772fc566da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:45.425487 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85223efb-db47-4840-8381-dc772fc566da None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:45.425767 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85223efb-db47-4840-8381-dc772fc566da None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:45.426037 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85223efb-db47-4840-8381-dc772fc566da None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:45.426694 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85223efb-db47-4840-8381-dc772fc566da None admin] RBAC: Adding query filter params (name=admin) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:52:45.426995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85223efb-db47-4840-8381-dc772fc566da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:45.428396 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85223efb-db47-4840-8381-dc772fc566da None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:45.436690 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 595/1196] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:52:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:45.442632 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787d09b-bf43-41f1-838c-46aea3928853 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:45.541359 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787d09b-bf43-41f1-838c-46aea3928853 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:45.575037 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a685ed-e995-4ad4-ab20-aa3bb6187751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:45.575680 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a685ed-e995-4ad4-ab20-aa3bb6187751 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:45.575955 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a685ed-e995-4ad4-ab20-aa3bb6187751 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:45.576222 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a685ed-e995-4ad4-ab20-aa3bb6187751 None admin] PATH_INFO: `/v3/users/71ad2567720e4c368ef4e456823921e9` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:45.577330 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a685ed-e995-4ad4-ab20-aa3bb6187751 None admin] RBAC: Authorizing `identity:get_user(user_id=71ad2567720e4c368ef4e456823921e9)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:45.578870 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a685ed-e995-4ad4-ab20-aa3bb6187751 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:45.580488 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 602/1197] 10.222.0.55 () {56 vars in 1177 bytes} [Wed Aug 24 16:52:45 2022] GET /identity/v3/users/71ad2567720e4c368ef4e456823921e9 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:45.586467 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85223efb-db47-4840-8381-dc772fc566da None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:45.655490 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:45.688757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85223efb-db47-4840-8381-dc772fc566da None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:45.723416 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50593ed3-3c50-4d73-9611-c69fd7fd497a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:45.724022 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50593ed3-3c50-4d73-9611-c69fd7fd497a None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:45.724301 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50593ed3-3c50-4d73-9611-c69fd7fd497a None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:45.724574 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50593ed3-3c50-4d73-9611-c69fd7fd497a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:45.793349 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50593ed3-3c50-4d73-9611-c69fd7fd497a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:45.794790 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50593ed3-3c50-4d73-9611-c69fd7fd497a None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:45.862031 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:45.894412 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 596/1198] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:52:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:52:45.900405 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a685ed-e995-4ad4-ab20-aa3bb6187751 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:45.964735 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:45.999528 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a685ed-e995-4ad4-ab20-aa3bb6187751 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:46.032844 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e495d51-acdb-4e09-9e1f-aef56a97dac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:46.033470 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e495d51-acdb-4e09-9e1f-aef56a97dac7 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:46.033743 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e495d51-acdb-4e09-9e1f-aef56a97dac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:46.034009 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e495d51-acdb-4e09-9e1f-aef56a97dac7 None admin] PATH_INFO: `/v3/projects/3415692655af4ec69b85c329ecf10668` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:46.035134 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e495d51-acdb-4e09-9e1f-aef56a97dac7 None admin] RBAC: Authorizing `identity:get_project(project_id=3415692655af4ec69b85c329ecf10668)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:46.036549 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e495d51-acdb-4e09-9e1f-aef56a97dac7 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:46.038173 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 603/1199] 10.222.0.55 () {56 vars in 1186 bytes} [Wed Aug 24 16:52:45 2022] GET /identity/v3/projects/3415692655af4ec69b85c329ecf10668 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:46.044384 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50593ed3-3c50-4d73-9611-c69fd7fd497a None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:52:46.142958 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50593ed3-3c50-4d73-9611-c69fd7fd497a None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:52:46.176175 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecaf4ed-424d-45ef-9133-759b7cc19d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:52:46.176772 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecaf4ed-424d-45ef-9133-759b7cc19d02 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:52:46.177045 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecaf4ed-424d-45ef-9133-759b7cc19d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:52:46.177310 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecaf4ed-424d-45ef-9133-759b7cc19d02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:52:46.178019 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecaf4ed-424d-45ef-9133-759b7cc19d02 None admin] RBAC: Adding query filter params (role.id=99f0ace9fc4d4d028ca52fa9730cab4b, scope.project.id=3415692655af4ec69b85c329ecf10668, user.id=71ad2567720e4c368ef4e456823921e9) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:52:46.178318 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecaf4ed-424d-45ef-9133-759b7cc19d02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:52:46.179773 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecaf4ed-424d-45ef-9133-759b7cc19d02 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:52:46.185853 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 597/1200] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:52:46 2022] GET /identity/v3/role_assignments?user.id=71ad2567720e4c368ef4e456823921e9&scope.project.id=3415692655af4ec69b85c329ecf10668&role.id=99f0ace9fc4d4d028ca52fa9730cab4b => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:52:56.028034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=33 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:52:56.183387 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=83 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:02.189291 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2682984-e013-48fd-8a12-cc765bf9742f None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:02.189850 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2682984-e013-48fd-8a12-cc765bf9742f None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:02.189850 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2682984-e013-48fd-8a12-cc765bf9742f None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:02.191309 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 604/1201] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:54:02.196842 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c47ec-8ef3-45f5-925e-ba0b585bacd2 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:02.200450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c47ec-8ef3-45f5-925e-ba0b585bacd2 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:02.200450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c47ec-8ef3-45f5-925e-ba0b585bacd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:02.216199 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-763c47ec-8ef3-45f5-925e-ba0b585bacd2 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:54:02.217388 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-763c47ec-8ef3-45f5-925e-ba0b585bacd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:54:02.291850 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 598/1202] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:54:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:54:02.560386 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2682984-e013-48fd-8a12-cc765bf9742f None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:02.663672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2682984-e013-48fd-8a12-cc765bf9742f None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:02.698467 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3065d9-1010-47cd-bd77-9a8f45176b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:02.699226 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3065d9-1010-47cd-bd77-9a8f45176b0b None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:02.699502 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3065d9-1010-47cd-bd77-9a8f45176b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:02.699770 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3065d9-1010-47cd-bd77-9a8f45176b0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:02.709665 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3065d9-1010-47cd-bd77-9a8f45176b0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:02.711083 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3065d9-1010-47cd-bd77-9a8f45176b0b None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:02.725685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-ad3065d9-1010-47cd-bd77-9a8f45176b0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:54:02.725685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:02.725685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:54:02.725685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:54:02.725685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:54:02.725685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:54:02.725685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:54:02.725685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:54:02.725685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:54:02.725685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:54:02.725685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:54:02.725685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:54:02.725685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:54:02.725685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:54:02.725685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:54:02.725685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:54:02.729377 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:54:02.729377 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:54:02.729377 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:54:02.729377 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:54:02.729377 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:54:02.729377 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:54:02.729377 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:54:02.729377 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:54:02.729377 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:54:02.729377 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:54:02.729377 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:54:02.729377 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:54:02.729377 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:54:02.729377 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:54:02.729377 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:54:02.729377 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:54:02.729377 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:54:02.731907 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:54:02.731907 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:54:02.731907 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:54:02.731907 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 605/1203] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:54:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:54:02.733582 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c47ec-8ef3-45f5-925e-ba0b585bacd2 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:02.832274 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c47ec-8ef3-45f5-925e-ba0b585bacd2 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:02.865112 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:02.871130 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfabf72-1e05-47d5-a862-161afb671ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:02.871750 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfabf72-1e05-47d5-a862-161afb671ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:02.872124 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfabf72-1e05-47d5-a862-161afb671ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:02.872290 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfabf72-1e05-47d5-a862-161afb671ff3 None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:02.872931 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfabf72-1e05-47d5-a862-161afb671ff3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:02.873230 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfabf72-1e05-47d5-a862-161afb671ff3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:02.874584 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfabf72-1e05-47d5-a862-161afb671ff3 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:02.886354 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 599/1204] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:02.892580 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3065d9-1010-47cd-bd77-9a8f45176b0b None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:02.947669 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:02.996077 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3065d9-1010-47cd-bd77-9a8f45176b0b None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:03.031070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48920d0e-a062-4a89-a14a-b4dc8e9eebfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:03.031703 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48920d0e-a062-4a89-a14a-b4dc8e9eebfc None admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:03.032087 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48920d0e-a062-4a89-a14a-b4dc8e9eebfc None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:03.032356 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48920d0e-a062-4a89-a14a-b4dc8e9eebfc None admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:03.033002 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48920d0e-a062-4a89-a14a-b4dc8e9eebfc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:03.034414 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48920d0e-a062-4a89-a14a-b4dc8e9eebfc None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:03.134740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 606/1205] 10.222.0.55 () {60 vars in 1132 bytes} [Wed Aug 24 16:54:02 2022] POST /identity/v3/users => generated 251 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:54:05.164520 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24345adb-a140-4429-84ac-1d476c12af51 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:05.165097 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24345adb-a140-4429-84ac-1d476c12af51 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:05.165097 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24345adb-a140-4429-84ac-1d476c12af51 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:05.166334 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 600/1206] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:54:05.172753 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8fc3f-e71b-449f-ac37-9f3cb654a76b None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:05.173290 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8fc3f-e71b-449f-ac37-9f3cb654a76b None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:05.173420 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce8fc3f-e71b-449f-ac37-9f3cb654a76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:05.192484 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-5ce8fc3f-e71b-449f-ac37-9f3cb654a76b None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:54:05.193682 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-5ce8fc3f-e71b-449f-ac37-9f3cb654a76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:54:05.268690 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 607/1207] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:54:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:54:05.544227 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24345adb-a140-4429-84ac-1d476c12af51 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:05.653684 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24345adb-a140-4429-84ac-1d476c12af51 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:05.690947 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19617b4d-ae10-4504-8b3b-9651dd5a9ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:05.691614 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19617b4d-ae10-4504-8b3b-9651dd5a9ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:05.691895 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19617b4d-ae10-4504-8b3b-9651dd5a9ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:05.692168 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19617b4d-ae10-4504-8b3b-9651dd5a9ab3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:05.703964 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19617b4d-ae10-4504-8b3b-9651dd5a9ab3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:54:05.708692 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-19617b4d-ae10-4504-8b3b-9651dd5a9ab3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:54:05.708692 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:05.708692 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:54:05.708692 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:54:05.708692 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:54:05.708692 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:54:05.708692 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:54:05.708692 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:54:05.708692 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:54:05.708692 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:54:05.708692 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:54:05.708692 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:54:05.708692 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:54:05.708692 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:54:05.708692 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:54:05.708692 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:54:05.711638 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:54:05.711638 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:54:05.711638 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:54:05.711638 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:54:05.711638 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:54:05.711638 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:54:05.711638 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:54:05.711638 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:54:05.711638 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:54:05.711638 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:54:05.711638 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:54:05.711638 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:54:05.711638 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:54:05.711638 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:54:05.711638 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:54:05.711638 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:54:05.712660 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:54:05.712660 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:54:05.712660 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:54:05.712660 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:54:05.712660 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:54:05.712660 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:54:05.712660 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:54:05.712660 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:54:05.712660 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:54:05.712660 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:54:05.712660 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:54:05.712660 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:54:05.712660 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 601/1208] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Aug 24 16:54:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:54:05.717679 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8fc3f-e71b-449f-ac37-9f3cb654a76b None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:05.758774 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:05.818952 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce8fc3f-e71b-449f-ac37-9f3cb654a76b None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:05.856427 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3ff41-6b2d-4e0e-9a13-478ee19f604b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:05.857136 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3ff41-6b2d-4e0e-9a13-478ee19f604b None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:05.857528 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3ff41-6b2d-4e0e-9a13-478ee19f604b None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:05.857900 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3ff41-6b2d-4e0e-9a13-478ee19f604b None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:05.858660 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3ff41-6b2d-4e0e-9a13-478ee19f604b None admin] RBAC: Adding query filter params (name=service) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:05.859044 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3ff41-6b2d-4e0e-9a13-478ee19f604b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:05.860720 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3ff41-6b2d-4e0e-9a13-478ee19f604b None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:05.871029 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 608/1209] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Aug 24 16:54:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:05.877822 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19617b4d-ae10-4504-8b3b-9651dd5a9ab3 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:05.935255 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:05.987246 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19617b4d-ae10-4504-8b3b-9651dd5a9ab3 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:06.032756 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823c51f-a655-4573-84f1-eddf9b7b9fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:06.033781 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823c51f-a655-4573-84f1-eddf9b7b9fac None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:06.034151 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823c51f-a655-4573-84f1-eddf9b7b9fac None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:06.034697 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823c51f-a655-4573-84f1-eddf9b7b9fac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:06.049061 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823c51f-a655-4573-84f1-eddf9b7b9fac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:06.055323 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823c51f-a655-4573-84f1-eddf9b7b9fac None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:06.065555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-3823c51f-a655-4573-84f1-eddf9b7b9fac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:54:06.065555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:06.065555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:54:06.065555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:54:06.065555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:54:06.065555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:54:06.065555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:54:06.065555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:54:06.065555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:54:06.065555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:54:06.065555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:54:06.065555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:54:06.065555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:54:06.065555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:54:06.065555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:54:06.065555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:54:06.066938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:54:06.066938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:54:06.066938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:54:06.066938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:54:06.066938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:54:06.066938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:54:06.066938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:54:06.066938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:54:06.066938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:54:06.066938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:54:06.066938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:54:06.066938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:54:06.066938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:54:06.066938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:54:06.066938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:54:06.066938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:54:06.066938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:54:06.068062 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:54:06.068062 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:54:06.068062 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:54:06.068062 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 602/1210] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:54:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:54:06.074320 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3ff41-6b2d-4e0e-9a13-478ee19f604b None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:06.177895 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:06.180840 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3ff41-6b2d-4e0e-9a13-478ee19f604b None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:06.215217 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45803b-b12c-4d18-859e-3cc5740b6a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:06.219540 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45803b-b12c-4d18-859e-3cc5740b6a8c None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:06.219540 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45803b-b12c-4d18-859e-3cc5740b6a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:06.219540 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45803b-b12c-4d18-859e-3cc5740b6a8c None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:06.219540 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af45803b-b12c-4d18-859e-3cc5740b6a8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:06.219540 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af45803b-b12c-4d18-859e-3cc5740b6a8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:06.219540 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af45803b-b12c-4d18-859e-3cc5740b6a8c None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:06.231881 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 609/1211] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:06.238290 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823c51f-a655-4573-84f1-eddf9b7b9fac None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:06.342705 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823c51f-a655-4573-84f1-eddf9b7b9fac None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:06.344234 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:06.377397 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b10fb8-b52c-443a-aa71-e046a71f7f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:06.378020 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b10fb8-b52c-443a-aa71-e046a71f7f56 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:06.378292 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b10fb8-b52c-443a-aa71-e046a71f7f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:06.378565 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b10fb8-b52c-443a-aa71-e046a71f7f56 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:06.385950 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b10fb8-b52c-443a-aa71-e046a71f7f56 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:06.387450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b10fb8-b52c-443a-aa71-e046a71f7f56 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:06.398331 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-29b10fb8-b52c-443a-aa71-e046a71f7f56 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 16:54:06.398331 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:06.398331 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:54:06.398331 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:54:06.398331 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:54:06.398331 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:54:06.398331 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:54:06.398331 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:54:06.398331 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:54:06.398331 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:54:06.398331 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:54:06.398331 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:54:06.398331 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:54:06.398331 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:54:06.398331 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:54:06.398331 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:54:06.399364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:54:06.399364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:54:06.399364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:54:06.399364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:54:06.399364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:54:06.399364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:54:06.399364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:54:06.399364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:54:06.399364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:54:06.399364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:54:06.399364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:54:06.399364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:54:06.399364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:54:06.399364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:54:06.399364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:54:06.399364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:54:06.399364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:54:06.399364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:54:06.400897 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:54:06.400897 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:54:06.400897 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:54:06.400897 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:54:06.400897 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:54:06.400897 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:54:06.400897 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:54:06.400897 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:54:06.400897 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 16:54:06.400897 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:54:06.400897 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 603/1212] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:54:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:54:06.406825 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45803b-b12c-4d18-859e-3cc5740b6a8c None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:06.512141 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45803b-b12c-4d18-859e-3cc5740b6a8c None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:06.549531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c59d6-f707-4fa7-b225-a39737330d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:06.550115 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c59d6-f707-4fa7-b225-a39737330d99 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:06.550393 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c59d6-f707-4fa7-b225-a39737330d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:06.550663 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c59d6-f707-4fa7-b225-a39737330d99 None admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:06.551423 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c59d6-f707-4fa7-b225-a39737330d99 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:06.551733 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c59d6-f707-4fa7-b225-a39737330d99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:06.553153 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2c59d6-f707-4fa7-b225-a39737330d99 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:06.572520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 610/1213] 10.222.0.55 () {56 vars in 1143 bytes} [Wed Aug 24 16:54:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:06.578894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b10fb8-b52c-443a-aa71-e046a71f7f56 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:06.685709 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b10fb8-b52c-443a-aa71-e046a71f7f56 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:06.719634 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34e340-89ee-4a4d-8ed5-c579b2ceb8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:06.720242 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34e340-89ee-4a4d-8ed5-c579b2ceb8cf None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:06.720525 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34e340-89ee-4a4d-8ed5-c579b2ceb8cf None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:06.720801 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34e340-89ee-4a4d-8ed5-c579b2ceb8cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:06.752050 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:06.791129 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34e340-89ee-4a4d-8ed5-c579b2ceb8cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:06.792756 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34e340-89ee-4a4d-8ed5-c579b2ceb8cf None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:06.894575 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 604/1214] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:54:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:54:06.900548 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c59d6-f707-4fa7-b225-a39737330d99 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:06.920466 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:07.004353 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2c59d6-f707-4fa7-b225-a39737330d99 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:07.041139 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da487289-4765-4c34-a768-5bbadfecda6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:07.053401 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da487289-4765-4c34-a768-5bbadfecda6d None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:07.053401 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da487289-4765-4c34-a768-5bbadfecda6d None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:07.053401 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da487289-4765-4c34-a768-5bbadfecda6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:07.055207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da487289-4765-4c34-a768-5bbadfecda6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:07.056775 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da487289-4765-4c34-a768-5bbadfecda6d None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:07.074531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-da487289-4765-4c34-a768-5bbadfecda6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:54:07.074531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:07.074531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:54:07.074531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:54:07.074531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:54:07.074531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:54:07.074531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:54:07.074531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:54:07.074531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:54:07.074531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:54:07.074531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:54:07.074531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:54:07.074531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:54:07.074531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:54:07.074531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:54:07.074531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:54:07.081520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:54:07.081520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:54:07.081520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:54:07.081520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:54:07.081520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:54:07.081520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:54:07.081520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:54:07.081520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:54:07.081520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:54:07.081520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:54:07.081520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:54:07.081520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:54:07.081520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:54:07.081520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:54:07.081520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:54:07.081520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:54:07.081520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:54:07.082477 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:54:07.082477 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:54:07.082477 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:54:07.082477 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 611/1215] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:54:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:54:07.082724 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34e340-89ee-4a4d-8ed5-c579b2ceb8cf None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:07.155774 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:07.199048 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34e340-89ee-4a4d-8ed5-c579b2ceb8cf None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:07.242129 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15b3e2-014d-4661-8495-53d4b66a202d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:07.242822 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15b3e2-014d-4661-8495-53d4b66a202d None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:07.243003 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15b3e2-014d-4661-8495-53d4b66a202d None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:07.243305 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b15b3e2-014d-4661-8495-53d4b66a202d None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:07.243948 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15b3e2-014d-4661-8495-53d4b66a202d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:07.244246 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15b3e2-014d-4661-8495-53d4b66a202d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:07.246241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b15b3e2-014d-4661-8495-53d4b66a202d None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:07.263812 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 605/1216] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:07.264732 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da487289-4765-4c34-a768-5bbadfecda6d None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:07.337011 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:07.369545 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da487289-4765-4c34-a768-5bbadfecda6d None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:07.404484 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977dc21-2e71-453e-8dfe-ca4247d094f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:07.405112 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977dc21-2e71-453e-8dfe-ca4247d094f4 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:07.405394 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977dc21-2e71-453e-8dfe-ca4247d094f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:07.405660 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977dc21-2e71-453e-8dfe-ca4247d094f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:07.412423 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977dc21-2e71-453e-8dfe-ca4247d094f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:07.413887 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977dc21-2e71-453e-8dfe-ca4247d094f4 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:07.425800 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-f977dc21-2e71-453e-8dfe-ca4247d094f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:54:07.425800 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:07.425800 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:54:07.425800 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:54:07.425800 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:54:07.425800 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:54:07.425800 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:54:07.425800 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:54:07.425800 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:54:07.425800 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:54:07.425800 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:54:07.425800 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:54:07.425800 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:54:07.425800 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:54:07.425800 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:54:07.426991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:54:07.426991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:54:07.426991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:54:07.426991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:54:07.426991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:54:07.426991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:54:07.426991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:54:07.426991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:54:07.426991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:54:07.426991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:54:07.426991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:54:07.426991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:54:07.426991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:54:07.426991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:54:07.426991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:54:07.426991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:54:07.426991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:54:07.428264 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:54:07.428264 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:54:07.428264 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:54:07.428264 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:54:07.428264 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:54:07.428264 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:54:07.428264 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:54:07.428264 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:54:07.428264 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 612/1217] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:54:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:54:07.433546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15b3e2-014d-4661-8495-53d4b66a202d None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:07.542460 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b15b3e2-014d-4661-8495-53d4b66a202d None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:07.569242 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:07.578200 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b80388-f9a2-4797-8e3a-1faa37b85180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:07.578860 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b80388-f9a2-4797-8e3a-1faa37b85180 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:07.579163 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b80388-f9a2-4797-8e3a-1faa37b85180 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:07.579436 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b80388-f9a2-4797-8e3a-1faa37b85180 None admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:07.580143 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b80388-f9a2-4797-8e3a-1faa37b85180 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:07.580444 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b80388-f9a2-4797-8e3a-1faa37b85180 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:07.581902 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b80388-f9a2-4797-8e3a-1faa37b85180 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:07.595052 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 606/1218] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:54:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:07.601812 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977dc21-2e71-453e-8dfe-ca4247d094f4 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:07.711133 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977dc21-2e71-453e-8dfe-ca4247d094f4 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:07.741218 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:07.747893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a965a-0488-4e66-b3ef-993b77e4b969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:07.748520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a965a-0488-4e66-b3ef-993b77e4b969 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:07.748801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a965a-0488-4e66-b3ef-993b77e4b969 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:07.749079 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a965a-0488-4e66-b3ef-993b77e4b969 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:07.749833 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a965a-0488-4e66-b3ef-993b77e4b969 None admin] RBAC: Adding query filter params (role.id=494c75ed8f864e3b955fdb043e96c675, scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642, user.id=32ef97356edf406aad9ab5f502bdb0af) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:07.750146 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a965a-0488-4e66-b3ef-993b77e4b969 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:07.751653 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a965a-0488-4e66-b3ef-993b77e4b969 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:07.757721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 613/1219] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:54:07 2022] GET /identity/v3/role_assignments?user.id=32ef97356edf406aad9ab5f502bdb0af&scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642&role.id=494c75ed8f864e3b955fdb043e96c675 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:09.696989 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf11daa-9853-4600-9417-4ea6c79f29b4 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:09.697587 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf11daa-9853-4600-9417-4ea6c79f29b4 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:09.697587 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf11daa-9853-4600-9417-4ea6c79f29b4 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:09.699215 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 607/1220] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:54:09.704504 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e2470-1277-4875-b448-c74648cc7f2b None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:09.704947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e2470-1277-4875-b448-c74648cc7f2b None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:09.705084 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92e2470-1277-4875-b448-c74648cc7f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:09.723819 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-c92e2470-1277-4875-b448-c74648cc7f2b None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:54:09.725009 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-c92e2470-1277-4875-b448-c74648cc7f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:54:09.803509 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 614/1221] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:54:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:54:10.077561 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf11daa-9853-4600-9417-4ea6c79f29b4 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:10.180567 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf11daa-9853-4600-9417-4ea6c79f29b4 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:10.216073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf85699-2b68-4f3f-bde4-c9545095ca6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:10.216703 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf85699-2b68-4f3f-bde4-c9545095ca6d None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:10.217010 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf85699-2b68-4f3f-bde4-c9545095ca6d None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:10.217276 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf85699-2b68-4f3f-bde4-c9545095ca6d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:10.227358 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf85699-2b68-4f3f-bde4-c9545095ca6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:54:10.232391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-fdf85699-2b68-4f3f-bde4-c9545095ca6d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:54:10.232391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:10.232391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:54:10.232391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:54:10.232391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:54:10.232391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:54:10.232391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:54:10.232391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:54:10.232391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:54:10.232391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:54:10.232391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:54:10.232391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:54:10.232391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:54:10.232391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:54:10.232391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:54:10.232391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:54:10.233549 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:54:10.233549 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:54:10.233549 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:54:10.233549 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:54:10.233549 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:54:10.233549 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:54:10.233549 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:54:10.233549 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:54:10.233549 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:54:10.233549 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:54:10.233549 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:54:10.233549 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:54:10.233549 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:54:10.233549 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:54:10.233549 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:54:10.233549 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:54:10.234796 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:54:10.234796 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:54:10.234796 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:54:10.234796 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:54:10.234796 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:54:10.234796 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:54:10.234796 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:54:10.234796 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:54:10.234796 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:54:10.234796 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:54:10.234796 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:54:10.234796 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:54:10.234796 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 608/1222] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Aug 24 16:54:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:54:10.239556 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e2470-1277-4875-b448-c74648cc7f2b None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:10.341230 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92e2470-1277-4875-b448-c74648cc7f2b None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:10.365331 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:10.376819 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8d71e-b8f1-48ab-b494-62ddc496367e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:10.377427 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8d71e-b8f1-48ab-b494-62ddc496367e None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:10.377707 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8d71e-b8f1-48ab-b494-62ddc496367e None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:10.377985 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8d71e-b8f1-48ab-b494-62ddc496367e None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:10.378644 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8d71e-b8f1-48ab-b494-62ddc496367e None admin] RBAC: Adding query filter params (name=service) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:10.378946 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8d71e-b8f1-48ab-b494-62ddc496367e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:10.380366 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8d71e-b8f1-48ab-b494-62ddc496367e None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:10.389140 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 615/1223] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Aug 24 16:54:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:10.394966 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf85699-2b68-4f3f-bde4-c9545095ca6d None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:10.443434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:10.501880 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf85699-2b68-4f3f-bde4-c9545095ca6d None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:10.535079 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44fa3d6-bf87-4f9f-96b1-33406a68db0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:10.535735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44fa3d6-bf87-4f9f-96b1-33406a68db0e None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:10.536013 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44fa3d6-bf87-4f9f-96b1-33406a68db0e None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:10.536280 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44fa3d6-bf87-4f9f-96b1-33406a68db0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:10.546884 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44fa3d6-bf87-4f9f-96b1-33406a68db0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:10.548368 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44fa3d6-bf87-4f9f-96b1-33406a68db0e None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:10.564700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-d44fa3d6-bf87-4f9f-96b1-33406a68db0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:54:10.564700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:10.564700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:54:10.564700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:54:10.564700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:54:10.564700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:54:10.564700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:54:10.564700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:54:10.564700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:54:10.564700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:54:10.564700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:54:10.564700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:54:10.564700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:54:10.564700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:54:10.564700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:54:10.564700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:54:10.565886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:54:10.565886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:54:10.565886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:54:10.565886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:54:10.565886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:54:10.565886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:54:10.565886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:54:10.565886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:54:10.565886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:54:10.565886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:54:10.565886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:54:10.565886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:54:10.565886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:54:10.565886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:54:10.565886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:54:10.565886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:54:10.565886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:54:10.567245 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:54:10.567245 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:54:10.567245 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:54:10.567245 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 609/1224] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:54:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:54:10.572384 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8d71e-b8f1-48ab-b494-62ddc496367e None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:10.678263 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8d71e-b8f1-48ab-b494-62ddc496367e None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:10.712904 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357aceb6-0ac6-4482-9e82-e12d6cc31f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:10.713567 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357aceb6-0ac6-4482-9e82-e12d6cc31f88 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:10.713801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357aceb6-0ac6-4482-9e82-e12d6cc31f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:10.714074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357aceb6-0ac6-4482-9e82-e12d6cc31f88 None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:10.714725 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357aceb6-0ac6-4482-9e82-e12d6cc31f88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:10.715023 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357aceb6-0ac6-4482-9e82-e12d6cc31f88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:10.716419 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357aceb6-0ac6-4482-9e82-e12d6cc31f88 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:10.729550 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 616/1225] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:54:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:54:10.735715 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44fa3d6-bf87-4f9f-96b1-33406a68db0e None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:10.841420 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:10.848755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44fa3d6-bf87-4f9f-96b1-33406a68db0e None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:10.888424 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d13df-0bc6-4c1a-81fb-45be3265c532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:10.889094 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d13df-0bc6-4c1a-81fb-45be3265c532 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:10.898797 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d13df-0bc6-4c1a-81fb-45be3265c532 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:10.898797 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d13df-0bc6-4c1a-81fb-45be3265c532 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:10.898797 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d13df-0bc6-4c1a-81fb-45be3265c532 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:10.899703 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d13df-0bc6-4c1a-81fb-45be3265c532 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:10.911687 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-4c3d13df-0bc6-4c1a-81fb-45be3265c532 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 16:54:10.911687 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:10.911687 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:54:10.911687 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:54:10.911687 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:54:10.911687 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:54:10.911687 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:54:10.911687 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:54:10.911687 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:54:10.911687 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:54:10.911687 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:54:10.911687 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:54:10.911687 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:54:10.911687 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:54:10.911687 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:54:10.911687 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:54:10.912886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:54:10.912886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:54:10.912886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:54:10.912886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:54:10.912886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:54:10.912886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:54:10.912886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:54:10.912886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:54:10.912886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:54:10.912886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:54:10.912886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:54:10.912886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:54:10.912886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:54:10.912886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:54:10.912886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:54:10.912886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:54:10.912886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:54:10.912886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:54:10.913865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:54:10.913865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:54:10.913865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:54:10.913865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:54:10.913865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:54:10.913865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:54:10.913865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:54:10.913865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:54:10.913865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 16:54:10.913865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:54:10.913865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 610/1226] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:54:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:54:10.919470 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357aceb6-0ac6-4482-9e82-e12d6cc31f88 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:10.972123 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:11.030384 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357aceb6-0ac6-4482-9e82-e12d6cc31f88 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:11.067245 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c9549-a8ca-446e-9820-3ac7be6bcf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:11.067853 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c9549-a8ca-446e-9820-3ac7be6bcf84 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:11.068129 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c9549-a8ca-446e-9820-3ac7be6bcf84 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:11.068399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c9549-a8ca-446e-9820-3ac7be6bcf84 None admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:11.069130 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c9549-a8ca-446e-9820-3ac7be6bcf84 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:11.069428 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c9549-a8ca-446e-9820-3ac7be6bcf84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:11.070847 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c9549-a8ca-446e-9820-3ac7be6bcf84 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:11.089688 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 617/1227] 10.222.0.55 () {56 vars in 1143 bytes} [Wed Aug 24 16:54:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:11.094913 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d13df-0bc6-4c1a-81fb-45be3265c532 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:11.201204 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d13df-0bc6-4c1a-81fb-45be3265c532 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:11.234649 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac102267-abe7-4035-afbc-0882f6baa123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:11.235228 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac102267-abe7-4035-afbc-0882f6baa123 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:11.235510 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac102267-abe7-4035-afbc-0882f6baa123 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:11.235777 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac102267-abe7-4035-afbc-0882f6baa123 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:11.247184 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac102267-abe7-4035-afbc-0882f6baa123 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:11.248644 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac102267-abe7-4035-afbc-0882f6baa123 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:11.265689 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-ac102267-abe7-4035-afbc-0882f6baa123 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:54:11.265689 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:11.265689 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:54:11.265689 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:54:11.265689 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:54:11.265689 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:54:11.265689 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:54:11.265689 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:54:11.265689 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:54:11.265689 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:54:11.265689 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:54:11.265689 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:54:11.265689 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:54:11.265689 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:54:11.265689 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:54:11.265689 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:54:11.268804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:54:11.268804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:54:11.268804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:54:11.268804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:54:11.268804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:54:11.268804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:54:11.268804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:54:11.268804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:54:11.268804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:54:11.268804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:54:11.268804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:54:11.268804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:54:11.268804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:54:11.268804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:54:11.268804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:54:11.268804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:54:11.268804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:54:11.270526 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:54:11.270526 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:54:11.270526 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:54:11.270526 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 611/1228] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:54:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:54:11.274637 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c9549-a8ca-446e-9820-3ac7be6bcf84 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:11.391752 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c9549-a8ca-446e-9820-3ac7be6bcf84 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:11.394608 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:11.432150 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc88327-87f4-4880-bd54-8a84eedbe2ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:11.433312 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc88327-87f4-4880-bd54-8a84eedbe2ba None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:11.433592 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc88327-87f4-4880-bd54-8a84eedbe2ba None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:11.433858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc88327-87f4-4880-bd54-8a84eedbe2ba None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:11.434633 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc88327-87f4-4880-bd54-8a84eedbe2ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:11.434870 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc88327-87f4-4880-bd54-8a84eedbe2ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:11.436413 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc88327-87f4-4880-bd54-8a84eedbe2ba None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:11.449496 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 618/1229] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:54:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:11.455571 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac102267-abe7-4035-afbc-0882f6baa123 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:11.465366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:11.564035 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac102267-abe7-4035-afbc-0882f6baa123 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:11.602316 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc31ec-8b46-4d19-bb58-640a21a116ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:11.602959 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc31ec-8b46-4d19-bb58-640a21a116ec None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:11.603347 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc31ec-8b46-4d19-bb58-640a21a116ec None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:11.603580 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cc31ec-8b46-4d19-bb58-640a21a116ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:11.612163 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc31ec-8b46-4d19-bb58-640a21a116ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:11.613630 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cc31ec-8b46-4d19-bb58-640a21a116ec None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:11.626351 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-b8cc31ec-8b46-4d19-bb58-640a21a116ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:54:11.626351 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:11.626351 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:54:11.626351 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:54:11.626351 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:54:11.626351 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:54:11.626351 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:54:11.626351 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:54:11.626351 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:54:11.626351 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:54:11.626351 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:54:11.626351 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:54:11.626351 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:54:11.626351 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:54:11.626351 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:54:11.627577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:54:11.627577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:54:11.627577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:54:11.627577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:54:11.627577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:54:11.627577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:54:11.627577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:54:11.627577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:54:11.627577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:54:11.627577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:54:11.627577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:54:11.627577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:54:11.627577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:54:11.627577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:54:11.627577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:54:11.627577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:54:11.627577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:54:11.628779 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:54:11.628779 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:54:11.628779 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:54:11.628779 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:54:11.628779 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:54:11.628779 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:54:11.628779 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:54:11.628779 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:54:11.628779 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 612/1230] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:54:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:54:11.634024 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc88327-87f4-4880-bd54-8a84eedbe2ba None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:11.750162 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc88327-87f4-4880-bd54-8a84eedbe2ba None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:11.792281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c32a70-5f67-4321-bb0c-10f6dcdb5fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:11.792903 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c32a70-5f67-4321-bb0c-10f6dcdb5fdf None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:11.793184 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c32a70-5f67-4321-bb0c-10f6dcdb5fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:11.793482 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c32a70-5f67-4321-bb0c-10f6dcdb5fdf None admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:11.794185 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c32a70-5f67-4321-bb0c-10f6dcdb5fdf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:11.794494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c32a70-5f67-4321-bb0c-10f6dcdb5fdf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:11.795976 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c32a70-5f67-4321-bb0c-10f6dcdb5fdf None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:11.808759 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 619/1231] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:54:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:11.817934 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc31ec-8b46-4d19-bb58-640a21a116ec None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:11.897925 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:11.936810 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cc31ec-8b46-4d19-bb58-640a21a116ec None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:11.974376 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8a32d-8175-4d47-b989-9995f5af8d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:11.975056 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8a32d-8175-4d47-b989-9995f5af8d6b None admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:11.982620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8a32d-8175-4d47-b989-9995f5af8d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:11.982620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8a32d-8175-4d47-b989-9995f5af8d6b None admin] PATH_INFO: `/v3/projects/ebae6aa9c60343e6ba0ff1cd62619642/users/32ef97356edf406aad9ab5f502bdb0af/roles/494c75ed8f864e3b955fdb043e96c675` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:11.991793 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8a32d-8175-4d47-b989-9995f5af8d6b None admin] RBAC: Authorizing `identity:create_grant(project_id=ebae6aa9c60343e6ba0ff1cd62619642, user_id=32ef97356edf406aad9ab5f502bdb0af, role_id=494c75ed8f864e3b955fdb043e96c675)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:11.993255 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8a32d-8175-4d47-b989-9995f5af8d6b None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:12.126634 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 613/1232] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Aug 24 16:54:11 2022] PUT /identity/v3/projects/ebae6aa9c60343e6ba0ff1cd62619642/users/32ef97356edf406aad9ab5f502bdb0af/roles/494c75ed8f864e3b955fdb043e96c675 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:54:14.129854 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e84f2b-ad10-4912-868f-3539024df456 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:14.130399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e84f2b-ad10-4912-868f-3539024df456 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:14.130399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e84f2b-ad10-4912-868f-3539024df456 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:14.131709 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 620/1233] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:54:14.137964 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6aebf6-a1b0-421b-ba87-c5ff8cf4d7f4 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:14.138407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6aebf6-a1b0-421b-ba87-c5ff8cf4d7f4 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:14.138601 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6aebf6-a1b0-421b-ba87-c5ff8cf4d7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:14.157382 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-3d6aebf6-a1b0-421b-ba87-c5ff8cf4d7f4 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:54:14.159894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-3d6aebf6-a1b0-421b-ba87-c5ff8cf4d7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:54:14.228144 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 614/1234] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:54:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 16:54:14.508808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e84f2b-ad10-4912-868f-3539024df456 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:14.543907 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:14.641932 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e84f2b-ad10-4912-868f-3539024df456 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:14.681847 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d7e37-d3be-4d4a-b67f-89ec41f6ccf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:14.683142 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d7e37-d3be-4d4a-b67f-89ec41f6ccf2 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:14.683488 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d7e37-d3be-4d4a-b67f-89ec41f6ccf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:14.683794 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d7e37-d3be-4d4a-b67f-89ec41f6ccf2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:14.696609 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d7e37-d3be-4d4a-b67f-89ec41f6ccf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:54:14.702285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-a86d7e37-d3be-4d4a-b67f-89ec41f6ccf2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:54:14.702285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:14.702285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:54:14.702285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:54:14.702285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:54:14.702285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:54:14.702285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:54:14.702285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:54:14.702285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:54:14.702285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:54:14.702285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:54:14.702285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:54:14.702285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:54:14.702285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:54:14.702285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:54:14.702285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:54:14.704211 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:54:14.704211 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:54:14.704211 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:54:14.704211 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:54:14.704211 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:54:14.704211 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:54:14.704211 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:54:14.704211 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:54:14.704211 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:54:14.704211 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:54:14.704211 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:54:14.704211 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:54:14.704211 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:54:14.704211 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:54:14.704211 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:54:14.704211 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:54:14.706017 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:54:14.706017 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:54:14.706017 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:54:14.706017 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:54:14.706017 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:54:14.706017 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:54:14.706017 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:54:14.706017 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:54:14.706017 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:54:14.706017 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:54:14.706017 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 16:54:14.706017 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:54:14.706017 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 621/1235] 10.222.0.55 () {56 vars in 1102 bytes} [Wed Aug 24 16:54:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:54:14.710312 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6aebf6-a1b0-421b-ba87-c5ff8cf4d7f4 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:14.763775 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:14.848880 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6aebf6-a1b0-421b-ba87-c5ff8cf4d7f4 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:14.905884 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9ee3d-f0ab-4ec8-bf7f-d355b02b0aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:14.906867 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9ee3d-f0ab-4ec8-bf7f-d355b02b0aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:14.907364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9ee3d-f0ab-4ec8-bf7f-d355b02b0aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:14.907820 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9ee3d-f0ab-4ec8-bf7f-d355b02b0aa3 None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:14.908940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d9ee3d-f0ab-4ec8-bf7f-d355b02b0aa3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:14.909463 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d9ee3d-f0ab-4ec8-bf7f-d355b02b0aa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:14.911843 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d9ee3d-f0ab-4ec8-bf7f-d355b02b0aa3 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:14.926484 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 615/1236] 10.222.0.55 () {56 vars in 1103 bytes} [Wed Aug 24 16:54:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:14.935084 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d7e37-d3be-4d4a-b67f-89ec41f6ccf2 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:15.030757 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:15.047692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d7e37-d3be-4d4a-b67f-89ec41f6ccf2 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:15.084743 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037ab80-5dd5-4f30-a403-1f99d6e64a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:15.085383 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037ab80-5dd5-4f30-a403-1f99d6e64a87 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:15.085661 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037ab80-5dd5-4f30-a403-1f99d6e64a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:15.085931 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037ab80-5dd5-4f30-a403-1f99d6e64a87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:15.098518 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037ab80-5dd5-4f30-a403-1f99d6e64a87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:15.100148 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037ab80-5dd5-4f30-a403-1f99d6e64a87 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:15.118533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-f037ab80-5dd5-4f30-a403-1f99d6e64a87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:54:15.118533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:15.118533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:54:15.118533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:54:15.118533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:54:15.118533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:54:15.118533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:54:15.118533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:54:15.118533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:54:15.118533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:54:15.118533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:54:15.118533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:54:15.118533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:54:15.118533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:54:15.118533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:54:15.118533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:54:15.120372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:54:15.120372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:54:15.120372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:54:15.120372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:54:15.120372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:54:15.120372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:54:15.120372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:54:15.120372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:54:15.120372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:54:15.120372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:54:15.120372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:54:15.120372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:54:15.120372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:54:15.120372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:54:15.120372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:54:15.120372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:54:15.120372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:54:15.122190 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:54:15.122190 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:54:15.122190 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:54:15.122190 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 622/1237] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:54:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:54:15.127125 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9ee3d-f0ab-4ec8-bf7f-d355b02b0aa3 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:15.244548 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9ee3d-f0ab-4ec8-bf7f-d355b02b0aa3 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:15.254166 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:15.281868 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6ec4d-73bd-4eea-8398-c176cbf11489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:15.282403 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6ec4d-73bd-4eea-8398-c176cbf11489 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:15.282678 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6ec4d-73bd-4eea-8398-c176cbf11489 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:15.282947 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6ec4d-73bd-4eea-8398-c176cbf11489 None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:15.283653 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6ec4d-73bd-4eea-8398-c176cbf11489 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:15.283953 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6ec4d-73bd-4eea-8398-c176cbf11489 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:15.285346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6ec4d-73bd-4eea-8398-c176cbf11489 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:15.299626 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 616/1238] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:15.306015 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037ab80-5dd5-4f30-a403-1f99d6e64a87 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:15.424041 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037ab80-5dd5-4f30-a403-1f99d6e64a87 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:15.464353 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77dc1d1-2ccd-422c-8851-77ce58d42faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:15.465001 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77dc1d1-2ccd-422c-8851-77ce58d42faf None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:15.465277 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77dc1d1-2ccd-422c-8851-77ce58d42faf None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:15.465544 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77dc1d1-2ccd-422c-8851-77ce58d42faf None admin] PATH_INFO: `/v3/users/placement` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:15.468902 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:15.474887 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77dc1d1-2ccd-422c-8851-77ce58d42faf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:15.476552 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77dc1d1-2ccd-422c-8851-77ce58d42faf None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:15.489392 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-b77dc1d1-2ccd-422c-8851-77ce58d42faf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 16:54:15.489392 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:15.489392 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:54:15.489392 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:54:15.489392 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:54:15.489392 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:54:15.489392 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:54:15.489392 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:54:15.489392 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:54:15.489392 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:54:15.489392 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:54:15.489392 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:54:15.489392 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:54:15.489392 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:54:15.489392 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:54:15.489392 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:54:15.490611 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:54:15.490611 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:54:15.490611 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:54:15.490611 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:54:15.490611 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:54:15.490611 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:54:15.490611 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:54:15.490611 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:54:15.490611 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:54:15.490611 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:54:15.490611 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:54:15.490611 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:54:15.490611 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:54:15.490611 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:54:15.490611 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:54:15.490611 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:54:15.490611 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:54:15.490611 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:54:15.491808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:54:15.491808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:54:15.491808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:54:15.491808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:54:15.491808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:54:15.491808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:54:15.491808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:54:15.491808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:54:15.491808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 16:54:15.491808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:54:15.491808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 623/1239] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:54:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:54:15.498172 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6ec4d-73bd-4eea-8398-c176cbf11489 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:15.616329 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6ec4d-73bd-4eea-8398-c176cbf11489 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:15.653083 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be66046-6897-4009-9d8a-dc5a6ef95fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:15.653704 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be66046-6897-4009-9d8a-dc5a6ef95fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:15.653985 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be66046-6897-4009-9d8a-dc5a6ef95fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:15.654257 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be66046-6897-4009-9d8a-dc5a6ef95fc5 None admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:15.654994 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be66046-6897-4009-9d8a-dc5a6ef95fc5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:15.655331 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be66046-6897-4009-9d8a-dc5a6ef95fc5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:15.656772 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be66046-6897-4009-9d8a-dc5a6ef95fc5 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:15.675215 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 617/1240] 10.222.0.55 () {56 vars in 1143 bytes} [Wed Aug 24 16:54:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:15.681233 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77dc1d1-2ccd-422c-8851-77ce58d42faf None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:15.789555 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77dc1d1-2ccd-422c-8851-77ce58d42faf None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:15.826153 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586abce-5d0a-4175-8228-7f7d0911208e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:15.826765 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586abce-5d0a-4175-8228-7f7d0911208e None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:15.827042 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586abce-5d0a-4175-8228-7f7d0911208e None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:15.827343 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586abce-5d0a-4175-8228-7f7d0911208e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:15.892900 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:15.899621 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6586abce-5d0a-4175-8228-7f7d0911208e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:15.901186 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6586abce-5d0a-4175-8228-7f7d0911208e None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:16.008101 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 624/1241] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:54:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:54:16.014854 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be66046-6897-4009-9d8a-dc5a6ef95fc5 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:16.044129 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:16.121816 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be66046-6897-4009-9d8a-dc5a6ef95fc5 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:16.158129 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a4db6-45ff-4594-a0c5-c8bb34016f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:16.158758 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a4db6-45ff-4594-a0c5-c8bb34016f24 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:16.159033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a4db6-45ff-4594-a0c5-c8bb34016f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:16.159330 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a4db6-45ff-4594-a0c5-c8bb34016f24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:16.170592 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a4db6-45ff-4594-a0c5-c8bb34016f24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:16.172066 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a4db6-45ff-4594-a0c5-c8bb34016f24 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:16.190860 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-4a0a4db6-45ff-4594-a0c5-c8bb34016f24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:54:16.190860 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:16.190860 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:54:16.190860 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:54:16.190860 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:54:16.190860 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:54:16.190860 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:54:16.190860 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:54:16.190860 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:54:16.190860 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:54:16.190860 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:54:16.190860 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:54:16.190860 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:54:16.190860 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:54:16.190860 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:54:16.190860 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:54:16.192674 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:54:16.192674 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:54:16.192674 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:54:16.192674 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:54:16.192674 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:54:16.192674 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:54:16.192674 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:54:16.192674 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:54:16.192674 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:54:16.192674 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:54:16.192674 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:54:16.192674 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:54:16.192674 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:54:16.192674 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:54:16.192674 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:54:16.192674 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:54:16.192674 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:54:16.194297 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:54:16.194297 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:54:16.194297 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:54:16.194297 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 618/1242] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:54:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:54:16.198618 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586abce-5d0a-4175-8228-7f7d0911208e None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:16.301370 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:16.307764 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586abce-5d0a-4175-8228-7f7d0911208e None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:16.342869 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d367a-3694-4a04-a397-c1bd06482e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:16.343648 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d367a-3694-4a04-a397-c1bd06482e91 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:16.343986 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d367a-3694-4a04-a397-c1bd06482e91 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:16.344200 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d367a-3694-4a04-a397-c1bd06482e91 None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:16.344857 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d367a-3694-4a04-a397-c1bd06482e91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:16.345161 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d367a-3694-4a04-a397-c1bd06482e91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:16.346530 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d367a-3694-4a04-a397-c1bd06482e91 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:16.359591 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 625/1243] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:54:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:16.365472 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a4db6-45ff-4594-a0c5-c8bb34016f24 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:16.458311 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:16.480014 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a4db6-45ff-4594-a0c5-c8bb34016f24 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:16.514895 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026aad60-fffb-4358-bba8-66bc634e8132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:16.515560 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026aad60-fffb-4358-bba8-66bc634e8132 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:16.515841 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026aad60-fffb-4358-bba8-66bc634e8132 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:16.516114 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026aad60-fffb-4358-bba8-66bc634e8132 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:16.522888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026aad60-fffb-4358-bba8-66bc634e8132 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:16.524376 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026aad60-fffb-4358-bba8-66bc634e8132 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:16.535622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-026aad60-fffb-4358-bba8-66bc634e8132 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:54:16.535622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:16.535622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:54:16.535622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:54:16.535622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:54:16.535622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:54:16.535622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:54:16.535622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:54:16.535622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:54:16.535622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:54:16.535622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:54:16.535622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:54:16.535622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:54:16.535622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:54:16.535622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:54:16.540800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:54:16.540800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:54:16.540800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:54:16.540800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:54:16.540800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:54:16.540800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:54:16.540800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:54:16.540800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:54:16.540800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:54:16.540800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:54:16.540800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:54:16.540800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:54:16.540800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:54:16.540800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:54:16.540800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:54:16.540800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:54:16.540800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:54:16.542387 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:54:16.542387 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:54:16.542387 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:54:16.542387 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:54:16.542387 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:54:16.542387 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:54:16.542387 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:54:16.542387 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:54:16.542387 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 619/1244] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:54:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:54:16.543874 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d367a-3694-4a04-a397-c1bd06482e91 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:16.654421 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d367a-3694-4a04-a397-c1bd06482e91 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:16.690598 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9116b6-8e75-482e-a6e9-d47f790f4630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:16.691300 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9116b6-8e75-482e-a6e9-d47f790f4630 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:16.691577 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9116b6-8e75-482e-a6e9-d47f790f4630 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:16.691840 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9116b6-8e75-482e-a6e9-d47f790f4630 None admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:16.692517 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9116b6-8e75-482e-a6e9-d47f790f4630 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:16.692818 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9116b6-8e75-482e-a6e9-d47f790f4630 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:16.694226 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9116b6-8e75-482e-a6e9-d47f790f4630 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:16.706465 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 626/1245] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:54:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:16.712834 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026aad60-fffb-4358-bba8-66bc634e8132 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:16.817156 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026aad60-fffb-4358-bba8-66bc634e8132 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:16.852423 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ad606-2a44-4a84-8c44-fb2ea74c2135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:16.853032 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ad606-2a44-4a84-8c44-fb2ea74c2135 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:16.853312 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ad606-2a44-4a84-8c44-fb2ea74c2135 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:16.853577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ad606-2a44-4a84-8c44-fb2ea74c2135 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:16.854459 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ad606-2a44-4a84-8c44-fb2ea74c2135 None admin] RBAC: Adding query filter params (role.id=494c75ed8f864e3b955fdb043e96c675, scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642, user.id=32ef97356edf406aad9ab5f502bdb0af) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:16.854731 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ad606-2a44-4a84-8c44-fb2ea74c2135 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:16.856223 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ad606-2a44-4a84-8c44-fb2ea74c2135 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:16.863139 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 620/1246] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:54:16 2022] GET /identity/v3/role_assignments?user.id=32ef97356edf406aad9ab5f502bdb0af&scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642&role.id=494c75ed8f864e3b955fdb043e96c675 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:18.913413 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877159e5-22c3-4659-8763-96cf19f2b2ea None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:18.913980 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877159e5-22c3-4659-8763-96cf19f2b2ea None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:18.913980 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877159e5-22c3-4659-8763-96cf19f2b2ea None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:18.915320 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 627/1247] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:54:18.921668 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91130c3-993b-4163-8ae8-0efc9b7c227e None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:18.922231 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91130c3-993b-4163-8ae8-0efc9b7c227e None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:18.922231 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91130c3-993b-4163-8ae8-0efc9b7c227e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:18.929277 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:18.950601 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-a91130c3-993b-4163-8ae8-0efc9b7c227e None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:54:18.951971 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-a91130c3-993b-4163-8ae8-0efc9b7c227e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:54:19.026857 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 621/1248] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:54:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:54:19.304931 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877159e5-22c3-4659-8763-96cf19f2b2ea None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:19.324687 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:19.417691 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877159e5-22c3-4659-8763-96cf19f2b2ea None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:19.455424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6ec79-562f-4e1d-a9ad-e1983b658be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:19.456064 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6ec79-562f-4e1d-a9ad-e1983b658be4 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:19.456342 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6ec79-562f-4e1d-a9ad-e1983b658be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:19.456613 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6ec79-562f-4e1d-a9ad-e1983b658be4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:19.468688 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f6ec79-562f-4e1d-a9ad-e1983b658be4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:54:19.473395 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-69f6ec79-562f-4e1d-a9ad-e1983b658be4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:54:19.473395 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:19.473395 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:54:19.473395 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:54:19.473395 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:54:19.473395 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:54:19.473395 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:54:19.473395 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:54:19.473395 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:54:19.473395 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:54:19.473395 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:54:19.473395 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:54:19.473395 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:54:19.473395 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:54:19.473395 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:54:19.473395 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:54:19.475713 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:54:19.475713 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:54:19.475713 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:54:19.475713 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:54:19.475713 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:54:19.475713 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:54:19.475713 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:54:19.475713 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:54:19.475713 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:54:19.475713 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:54:19.475713 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:54:19.475713 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:54:19.475713 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:54:19.475713 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:54:19.475713 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:54:19.475713 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:54:19.476829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:54:19.476829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:54:19.476829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:54:19.476829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:54:19.476829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:54:19.476829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:54:19.476829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:54:19.476829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:54:19.476829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:54:19.476829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:54:19.476829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:54:19.476829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:54:19.476829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 628/1249] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:54:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:54:19.481576 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91130c3-993b-4163-8ae8-0efc9b7c227e None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:19.585353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91130c3-993b-4163-8ae8-0efc9b7c227e None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:19.617620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:19.623103 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaed3da-83b5-48b4-ae55-87ecbf89bb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:19.623763 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaed3da-83b5-48b4-ae55-87ecbf89bb19 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:19.624039 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaed3da-83b5-48b4-ae55-87ecbf89bb19 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:19.624311 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaed3da-83b5-48b4-ae55-87ecbf89bb19 None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:19.624987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaed3da-83b5-48b4-ae55-87ecbf89bb19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:19.625290 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaed3da-83b5-48b4-ae55-87ecbf89bb19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:19.626688 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaed3da-83b5-48b4-ae55-87ecbf89bb19 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:19.637505 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 622/1250] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:54:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:54:19.643653 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6ec79-562f-4e1d-a9ad-e1983b658be4 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:19.726404 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:19.748927 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f6ec79-562f-4e1d-a9ad-e1983b658be4 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:19.782885 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db829d69-e122-4c39-8ec8-eaa9d2207992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:19.783532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db829d69-e122-4c39-8ec8-eaa9d2207992 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:19.783808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db829d69-e122-4c39-8ec8-eaa9d2207992 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:19.784073 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db829d69-e122-4c39-8ec8-eaa9d2207992 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:19.794708 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db829d69-e122-4c39-8ec8-eaa9d2207992 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:19.796200 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db829d69-e122-4c39-8ec8-eaa9d2207992 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:19.810601 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-db829d69-e122-4c39-8ec8-eaa9d2207992 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:54:19.810601 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:19.810601 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:54:19.810601 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:54:19.810601 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:54:19.810601 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:54:19.810601 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:54:19.810601 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:54:19.810601 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:54:19.810601 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:54:19.810601 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:54:19.810601 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:54:19.810601 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:54:19.810601 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:54:19.810601 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:54:19.810601 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:54:19.811808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:54:19.811808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:54:19.811808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:54:19.811808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:54:19.811808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:54:19.811808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:54:19.811808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:54:19.811808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:54:19.811808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:54:19.811808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:54:19.811808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:54:19.811808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:54:19.811808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:54:19.811808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:54:19.811808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:54:19.811808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:54:19.811808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:54:19.812964 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:54:19.812964 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:54:19.812964 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:54:19.812964 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 629/1251] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:54:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:54:19.818464 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaed3da-83b5-48b4-ae55-87ecbf89bb19 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:19.933590 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaed3da-83b5-48b4-ae55-87ecbf89bb19 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:19.968948 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0a707-084b-4ad5-aff0-6acb5b4eb937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:19.969597 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0a707-084b-4ad5-aff0-6acb5b4eb937 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:19.969871 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0a707-084b-4ad5-aff0-6acb5b4eb937 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:19.970136 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0a707-084b-4ad5-aff0-6acb5b4eb937 None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:19.970897 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0a707-084b-4ad5-aff0-6acb5b4eb937 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:19.971265 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0a707-084b-4ad5-aff0-6acb5b4eb937 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:19.972691 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0a707-084b-4ad5-aff0-6acb5b4eb937 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:19.985969 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 623/1252] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:19.992890 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db829d69-e122-4c39-8ec8-eaa9d2207992 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:20.105016 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db829d69-e122-4c39-8ec8-eaa9d2207992 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:20.132479 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:20.141987 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc7aa3-968e-4c13-931a-d0b96968692b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:20.142672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc7aa3-968e-4c13-931a-d0b96968692b None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:20.142979 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc7aa3-968e-4c13-931a-d0b96968692b None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:20.143353 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fc7aa3-968e-4c13-931a-d0b96968692b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:20.151367 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc7aa3-968e-4c13-931a-d0b96968692b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:20.152816 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fc7aa3-968e-4c13-931a-d0b96968692b None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:20.163894 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-74fc7aa3-968e-4c13-931a-d0b96968692b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 16:54:20.163894 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:20.163894 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:54:20.163894 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:54:20.163894 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:54:20.163894 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:54:20.163894 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:54:20.163894 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:54:20.163894 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:54:20.163894 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:54:20.163894 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:54:20.163894 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:54:20.163894 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:54:20.163894 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:54:20.163894 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:54:20.163894 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:54:20.165050 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:54:20.165050 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:54:20.165050 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:54:20.165050 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:54:20.165050 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:54:20.165050 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:54:20.165050 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:54:20.165050 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:54:20.165050 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:54:20.165050 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:54:20.165050 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:54:20.165050 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:54:20.165050 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:54:20.165050 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:54:20.165050 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:54:20.165050 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:54:20.165050 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:54:20.165050 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:54:20.166126 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:54:20.166126 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:54:20.166126 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:54:20.166126 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:54:20.166126 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:54:20.166126 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:54:20.166126 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:54:20.166126 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:54:20.166126 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 16:54:20.166126 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:54:20.166126 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 630/1253] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:54:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:54:20.172201 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0a707-084b-4ad5-aff0-6acb5b4eb937 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:20.236450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:20.282662 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0a707-084b-4ad5-aff0-6acb5b4eb937 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:20.317233 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5e355-7475-4c1f-8102-ea87ea2e506f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:20.317836 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5e355-7475-4c1f-8102-ea87ea2e506f None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:20.318111 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5e355-7475-4c1f-8102-ea87ea2e506f None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:20.318377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a5e355-7475-4c1f-8102-ea87ea2e506f None admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:20.319180 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5e355-7475-4c1f-8102-ea87ea2e506f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:20.319484 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5e355-7475-4c1f-8102-ea87ea2e506f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:20.320962 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a5e355-7475-4c1f-8102-ea87ea2e506f None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:20.338243 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 624/1254] 10.222.0.55 () {56 vars in 1143 bytes} [Wed Aug 24 16:54:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:20.344519 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc7aa3-968e-4c13-931a-d0b96968692b None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:20.459438 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fc7aa3-968e-4c13-931a-d0b96968692b None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:20.497093 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9398a90-ccef-49db-9378-afa55f2ec292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:20.500340 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9398a90-ccef-49db-9378-afa55f2ec292 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:20.500340 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9398a90-ccef-49db-9378-afa55f2ec292 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:20.500340 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9398a90-ccef-49db-9378-afa55f2ec292 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:20.560146 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:20.577146 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9398a90-ccef-49db-9378-afa55f2ec292 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:20.578646 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9398a90-ccef-49db-9378-afa55f2ec292 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:20.682195 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 631/1255] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:54:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:54:20.688319 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5e355-7475-4c1f-8102-ea87ea2e506f None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:20.790874 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a5e355-7475-4c1f-8102-ea87ea2e506f None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:20.805271 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:20.827199 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53fc77-bbb5-4921-ab0f-a5de6efdd3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:20.827833 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53fc77-bbb5-4921-ab0f-a5de6efdd3cc None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:20.828255 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53fc77-bbb5-4921-ab0f-a5de6efdd3cc None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:20.828526 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd53fc77-bbb5-4921-ab0f-a5de6efdd3cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:20.839536 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd53fc77-bbb5-4921-ab0f-a5de6efdd3cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:20.845243 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd53fc77-bbb5-4921-ab0f-a5de6efdd3cc None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:20.857649 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-cd53fc77-bbb5-4921-ab0f-a5de6efdd3cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:54:20.857649 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:20.857649 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:54:20.857649 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:54:20.857649 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:54:20.857649 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:54:20.857649 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:54:20.857649 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:54:20.857649 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:54:20.857649 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:54:20.857649 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:54:20.857649 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:54:20.857649 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:54:20.857649 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:54:20.857649 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:54:20.857649 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:54:20.859546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:54:20.859546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:54:20.859546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:54:20.859546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:54:20.859546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:54:20.859546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:54:20.859546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:54:20.859546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:54:20.859546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:54:20.859546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:54:20.859546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:54:20.859546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:54:20.859546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:54:20.859546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:54:20.859546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:54:20.859546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:54:20.859546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:54:20.861398 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:54:20.861398 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:54:20.861398 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:54:20.861398 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 625/1256] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:54:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:54:20.866358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9398a90-ccef-49db-9378-afa55f2ec292 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:20.954772 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:20.969995 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9398a90-ccef-49db-9378-afa55f2ec292 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:21.003237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b530e-386a-4066-8321-41ce91d0ef50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:21.003879 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b530e-386a-4066-8321-41ce91d0ef50 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:21.004180 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b530e-386a-4066-8321-41ce91d0ef50 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:21.004450 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b530e-386a-4066-8321-41ce91d0ef50 None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:21.005079 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b530e-386a-4066-8321-41ce91d0ef50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:21.005372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b530e-386a-4066-8321-41ce91d0ef50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:21.006722 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b530e-386a-4066-8321-41ce91d0ef50 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:21.019167 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 632/1257] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:54:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:21.025403 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53fc77-bbb5-4921-ab0f-a5de6efdd3cc None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:21.140552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd53fc77-bbb5-4921-ab0f-a5de6efdd3cc None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:21.179990 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2b753-aca2-4b13-aa3e-49cdeafb4e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:21.180614 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2b753-aca2-4b13-aa3e-49cdeafb4e08 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:21.180890 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2b753-aca2-4b13-aa3e-49cdeafb4e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:21.181157 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2b753-aca2-4b13-aa3e-49cdeafb4e08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:21.188845 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2b753-aca2-4b13-aa3e-49cdeafb4e08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:21.190433 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb2b753-aca2-4b13-aa3e-49cdeafb4e08 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:21.202838 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-fbb2b753-aca2-4b13-aa3e-49cdeafb4e08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:54:21.202838 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:21.202838 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:54:21.202838 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:54:21.202838 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:54:21.202838 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:54:21.202838 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:54:21.202838 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:54:21.202838 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:54:21.202838 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:54:21.202838 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:54:21.202838 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:54:21.202838 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:54:21.202838 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:54:21.202838 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:54:21.206573 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:54:21.206573 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:54:21.206573 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:54:21.206573 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:54:21.206573 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:54:21.206573 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:54:21.206573 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:54:21.206573 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:54:21.206573 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:54:21.206573 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:54:21.206573 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:54:21.206573 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:54:21.206573 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:54:21.206573 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:54:21.206573 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:54:21.206573 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:54:21.206573 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:54:21.208306 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:54:21.208306 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:54:21.208306 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:54:21.208306 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:54:21.208306 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:54:21.208306 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:54:21.208306 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:54:21.208306 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:54:21.208306 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 626/1258] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:54:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:54:21.210251 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b530e-386a-4066-8321-41ce91d0ef50 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:21.312681 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b530e-386a-4066-8321-41ce91d0ef50 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:21.347264 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc52d6d7-d5a9-4117-b680-f9e04a42fa3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:21.347877 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52d6d7-d5a9-4117-b680-f9e04a42fa3c None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:21.348155 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52d6d7-d5a9-4117-b680-f9e04a42fa3c None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:21.348428 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc52d6d7-d5a9-4117-b680-f9e04a42fa3c None admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:21.349141 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52d6d7-d5a9-4117-b680-f9e04a42fa3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:21.349470 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52d6d7-d5a9-4117-b680-f9e04a42fa3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:21.350899 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc52d6d7-d5a9-4117-b680-f9e04a42fa3c None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:21.363854 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 633/1259] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:54:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:21.370101 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2b753-aca2-4b13-aa3e-49cdeafb4e08 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:21.404256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:21.471257 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb2b753-aca2-4b13-aa3e-49cdeafb4e08 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:21.504669 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb71619-a137-49f3-b2c3-0d142549faf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:21.505273 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb71619-a137-49f3-b2c3-0d142549faf8 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:21.505575 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb71619-a137-49f3-b2c3-0d142549faf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:21.505848 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb71619-a137-49f3-b2c3-0d142549faf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:21.506572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb71619-a137-49f3-b2c3-0d142549faf8 None admin] RBAC: Adding query filter params (role.id=99f0ace9fc4d4d028ca52fa9730cab4b, scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642, user.id=32ef97356edf406aad9ab5f502bdb0af) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:21.506878 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb71619-a137-49f3-b2c3-0d142549faf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:21.508369 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb71619-a137-49f3-b2c3-0d142549faf8 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:21.514434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 627/1260] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:54:21 2022] GET /identity/v3/role_assignments?user.id=32ef97356edf406aad9ab5f502bdb0af&scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642&role.id=99f0ace9fc4d4d028ca52fa9730cab4b => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:23.511403 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e1517-b977-46fb-8a8f-1737136e465f None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:23.512164 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e1517-b977-46fb-8a8f-1737136e465f None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:23.512164 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0e1517-b977-46fb-8a8f-1737136e465f None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:23.513339 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 634/1261] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:54:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 16:54:23.522226 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8140e05-832c-4278-9708-53e6538f4af4 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:23.523144 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8140e05-832c-4278-9708-53e6538f4af4 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:23.523144 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8140e05-832c-4278-9708-53e6538f4af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:23.553028 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-c8140e05-832c-4278-9708-53e6538f4af4 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:54:23.555089 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-c8140e05-832c-4278-9708-53e6538f4af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:54:23.642433 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 628/1262] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:54:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:54:23.916488 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e1517-b977-46fb-8a8f-1737136e465f None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:23.929480 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:24.050459 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0e1517-b977-46fb-8a8f-1737136e465f None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:24.088324 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c2d99-54a0-4f90-bbc3-d6920a08b0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:24.089395 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c2d99-54a0-4f90-bbc3-d6920a08b0c7 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:24.089720 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c2d99-54a0-4f90-bbc3-d6920a08b0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:24.090030 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9c2d99-54a0-4f90-bbc3-d6920a08b0c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:24.101946 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9c2d99-54a0-4f90-bbc3-d6920a08b0c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:54:24.108054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-0e9c2d99-54a0-4f90-bbc3-d6920a08b0c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:54:24.108054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:24.108054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:54:24.108054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:54:24.108054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:54:24.108054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:54:24.108054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:54:24.108054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:54:24.108054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:54:24.108054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:54:24.108054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:54:24.108054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:54:24.108054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:54:24.108054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:54:24.108054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:54:24.108054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:54:24.112532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:54:24.112532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:54:24.112532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:54:24.112532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:54:24.112532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:54:24.112532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:54:24.112532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:54:24.112532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:54:24.112532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:54:24.112532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:54:24.112532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:54:24.112532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:54:24.112532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:54:24.112532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:54:24.112532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:54:24.112532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:54:24.114127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:54:24.114127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:54:24.114127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:54:24.114127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:54:24.114127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:54:24.114127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:54:24.114127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:54:24.114127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:54:24.114127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:54:24.114127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:54:24.114127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:54:24.114127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:54:24.114127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 635/1263] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:54:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:54:24.116956 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8140e05-832c-4278-9708-53e6538f4af4 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:24.139295 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:24.236317 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8140e05-832c-4278-9708-53e6538f4af4 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:24.286911 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ff89c-a94d-49a5-8a55-ca4d32b070ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:24.287787 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ff89c-a94d-49a5-8a55-ca4d32b070ea None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:24.288063 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ff89c-a94d-49a5-8a55-ca4d32b070ea None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:24.288328 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ff89c-a94d-49a5-8a55-ca4d32b070ea None admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:24.289003 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ff89c-a94d-49a5-8a55-ca4d32b070ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:24.289303 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ff89c-a94d-49a5-8a55-ca4d32b070ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:24.291282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ff89c-a94d-49a5-8a55-ca4d32b070ea None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:24.302516 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 629/1264] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:54:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:54:24.310711 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c2d99-54a0-4f90-bbc3-d6920a08b0c7 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:24.384130 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:24.421364 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9c2d99-54a0-4f90-bbc3-d6920a08b0c7 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:24.458609 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b23b8-e9a8-49c9-ad5e-77eb6d123227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:24.459268 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b23b8-e9a8-49c9-ad5e-77eb6d123227 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:24.459545 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b23b8-e9a8-49c9-ad5e-77eb6d123227 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:24.459812 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b23b8-e9a8-49c9-ad5e-77eb6d123227 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:24.471040 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b23b8-e9a8-49c9-ad5e-77eb6d123227 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:24.472530 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b23b8-e9a8-49c9-ad5e-77eb6d123227 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:24.488827 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-486b23b8-e9a8-49c9-ad5e-77eb6d123227 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:54:24.488827 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:24.488827 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:54:24.488827 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:54:24.488827 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:54:24.488827 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:54:24.488827 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:54:24.488827 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:54:24.488827 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:54:24.488827 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:54:24.488827 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:54:24.488827 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:54:24.488827 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:54:24.488827 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:54:24.488827 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:54:24.488827 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:54:24.490753 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:54:24.490753 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:54:24.490753 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:54:24.490753 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:54:24.490753 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:54:24.490753 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:54:24.490753 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:54:24.490753 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:54:24.490753 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:54:24.490753 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:54:24.490753 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:54:24.490753 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:54:24.490753 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:54:24.490753 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:54:24.490753 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:54:24.490753 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:54:24.490753 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:54:24.492630 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:54:24.492630 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:54:24.492630 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:54:24.492630 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 636/1265] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:54:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:54:24.497869 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ff89c-a94d-49a5-8a55-ca4d32b070ea None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:24.592350 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:24.615377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ff89c-a94d-49a5-8a55-ca4d32b070ea None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:24.653108 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06066adc-5a6f-4169-8f6c-ec3b598582c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:24.653730 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06066adc-5a6f-4169-8f6c-ec3b598582c4 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:24.654009 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06066adc-5a6f-4169-8f6c-ec3b598582c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:24.654285 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06066adc-5a6f-4169-8f6c-ec3b598582c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:24.654948 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06066adc-5a6f-4169-8f6c-ec3b598582c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:24.655285 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06066adc-5a6f-4169-8f6c-ec3b598582c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:24.656688 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06066adc-5a6f-4169-8f6c-ec3b598582c4 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:24.679944 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 630/1266] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:24.686067 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b23b8-e9a8-49c9-ad5e-77eb6d123227 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:24.796227 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b23b8-e9a8-49c9-ad5e-77eb6d123227 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:24.817441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:24.831901 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8d20d-2411-49ee-be54-1155d32578f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:24.832525 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8d20d-2411-49ee-be54-1155d32578f1 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:24.832962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8d20d-2411-49ee-be54-1155d32578f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:24.833306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e8d20d-2411-49ee-be54-1155d32578f1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:24.842217 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8d20d-2411-49ee-be54-1155d32578f1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:24.843715 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e8d20d-2411-49ee-be54-1155d32578f1 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:24.855889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-69e8d20d-2411-49ee-be54-1155d32578f1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 16:54:24.855889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:24.855889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:54:24.855889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:54:24.855889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:54:24.855889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:54:24.855889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:54:24.855889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:54:24.855889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:54:24.855889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:54:24.855889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:54:24.855889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:54:24.855889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:54:24.855889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:54:24.855889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:54:24.855889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:54:24.857663 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:54:24.857663 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:54:24.857663 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:54:24.857663 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:54:24.857663 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:54:24.857663 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:54:24.857663 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:54:24.857663 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:54:24.857663 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:54:24.857663 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:54:24.857663 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:54:24.857663 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:54:24.857663 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:54:24.857663 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:54:24.857663 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:54:24.857663 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:54:24.857663 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:54:24.857663 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:54:24.867131 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:54:24.867131 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:54:24.867131 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:54:24.867131 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:54:24.867131 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:54:24.867131 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:54:24.867131 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:54:24.867131 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:54:24.867131 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 16:54:24.867131 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:54:24.867131 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 637/1267] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:54:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:54:24.867953 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06066adc-5a6f-4169-8f6c-ec3b598582c4 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:24.970340 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06066adc-5a6f-4169-8f6c-ec3b598582c4 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:25.005923 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56104c19-f239-424e-88a0-eedbe3a86957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:25.006554 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56104c19-f239-424e-88a0-eedbe3a86957 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:25.006838 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56104c19-f239-424e-88a0-eedbe3a86957 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:25.007140 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56104c19-f239-424e-88a0-eedbe3a86957 None admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:25.007891 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56104c19-f239-424e-88a0-eedbe3a86957 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:25.008197 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56104c19-f239-424e-88a0-eedbe3a86957 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:25.009662 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56104c19-f239-424e-88a0-eedbe3a86957 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:25.021007 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:25.031450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 631/1268] 10.222.0.55 () {56 vars in 1143 bytes} [Wed Aug 24 16:54:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:25.040347 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8d20d-2411-49ee-be54-1155d32578f1 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:25.146016 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e8d20d-2411-49ee-be54-1155d32578f1 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:25.179663 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9032e-671e-4620-97b0-ffc66b5b3398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:25.180290 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9032e-671e-4620-97b0-ffc66b5b3398 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:25.180570 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9032e-671e-4620-97b0-ffc66b5b3398 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:25.180842 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f9032e-671e-4620-97b0-ffc66b5b3398 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:25.192083 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f9032e-671e-4620-97b0-ffc66b5b3398 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:25.193517 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f9032e-671e-4620-97b0-ffc66b5b3398 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:25.212279 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-41f9032e-671e-4620-97b0-ffc66b5b3398 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:54:25.212279 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:25.212279 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:54:25.212279 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:54:25.212279 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:54:25.212279 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:54:25.212279 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:54:25.212279 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:54:25.212279 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:54:25.212279 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:54:25.212279 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:54:25.212279 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:54:25.212279 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:54:25.212279 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:54:25.212279 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:54:25.212279 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:54:25.213397 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:54:25.213397 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:54:25.213397 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:54:25.213397 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:54:25.213397 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:54:25.213397 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:54:25.213397 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:54:25.213397 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:54:25.213397 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:54:25.213397 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:54:25.213397 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:54:25.213397 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:54:25.213397 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:54:25.213397 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:54:25.213397 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:54:25.213397 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:54:25.213397 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:54:25.214888 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:54:25.214888 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:54:25.214888 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:54:25.214888 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 638/1269] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:54:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:54:25.222916 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56104c19-f239-424e-88a0-eedbe3a86957 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:25.333277 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56104c19-f239-424e-88a0-eedbe3a86957 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:25.370202 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2e7e0-984f-4326-960a-3705045c2c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:25.371823 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2e7e0-984f-4326-960a-3705045c2c11 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:25.376374 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2e7e0-984f-4326-960a-3705045c2c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:25.376374 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2e7e0-984f-4326-960a-3705045c2c11 None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:25.376374 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2e7e0-984f-4326-960a-3705045c2c11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:25.376374 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2e7e0-984f-4326-960a-3705045c2c11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:25.376374 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e2e7e0-984f-4326-960a-3705045c2c11 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:25.388409 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 632/1270] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:54:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:25.399693 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9032e-671e-4620-97b0-ffc66b5b3398 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:25.437389 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:25.509707 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f9032e-671e-4620-97b0-ffc66b5b3398 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:25.548751 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97714a9c-5dbc-42e0-abc8-160600c9215c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:25.549625 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97714a9c-5dbc-42e0-abc8-160600c9215c None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:25.549909 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97714a9c-5dbc-42e0-abc8-160600c9215c None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:25.550179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97714a9c-5dbc-42e0-abc8-160600c9215c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:25.557105 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97714a9c-5dbc-42e0-abc8-160600c9215c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:25.559858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97714a9c-5dbc-42e0-abc8-160600c9215c None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:25.572289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-97714a9c-5dbc-42e0-abc8-160600c9215c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:54:25.572289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:25.572289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:54:25.572289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:54:25.572289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:54:25.572289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:54:25.572289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:54:25.572289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:54:25.572289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:54:25.572289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:54:25.572289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:54:25.572289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:54:25.572289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:54:25.572289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:54:25.572289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:54:25.573622 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:54:25.573622 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:54:25.573622 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:54:25.573622 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:54:25.573622 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:54:25.573622 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:54:25.573622 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:54:25.573622 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:54:25.573622 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:54:25.573622 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:54:25.573622 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:54:25.573622 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:54:25.573622 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:54:25.573622 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:54:25.573622 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:54:25.573622 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:54:25.573622 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:54:25.575166 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:54:25.575166 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:54:25.575166 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:54:25.575166 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:54:25.575166 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:54:25.575166 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:54:25.575166 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:54:25.575166 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:54:25.575166 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 639/1271] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:54:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:54:25.579528 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2e7e0-984f-4326-960a-3705045c2c11 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:25.647563 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:25.712614 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e2e7e0-984f-4326-960a-3705045c2c11 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:25.751647 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d60d15-9056-44b1-8cc6-6b56f46319eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:25.752275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d60d15-9056-44b1-8cc6-6b56f46319eb None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:25.752552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d60d15-9056-44b1-8cc6-6b56f46319eb None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:25.752822 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d60d15-9056-44b1-8cc6-6b56f46319eb None admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:25.753537 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d60d15-9056-44b1-8cc6-6b56f46319eb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:25.753843 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d60d15-9056-44b1-8cc6-6b56f46319eb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:25.755345 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d60d15-9056-44b1-8cc6-6b56f46319eb None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:25.768569 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 633/1272] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:54:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 16:54:25.774678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97714a9c-5dbc-42e0-abc8-160600c9215c None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:25.871983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:25.881321 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97714a9c-5dbc-42e0-abc8-160600c9215c None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:25.916540 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96626458-3db0-485a-b300-e744a49a2512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:25.918131 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96626458-3db0-485a-b300-e744a49a2512 None admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:25.918417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96626458-3db0-485a-b300-e744a49a2512 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:25.918695 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96626458-3db0-485a-b300-e744a49a2512 None admin] PATH_INFO: `/v3/projects/ebae6aa9c60343e6ba0ff1cd62619642/users/32ef97356edf406aad9ab5f502bdb0af/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:25.920846 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96626458-3db0-485a-b300-e744a49a2512 None admin] RBAC: Authorizing `identity:create_grant(project_id=ebae6aa9c60343e6ba0ff1cd62619642, user_id=32ef97356edf406aad9ab5f502bdb0af, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:25.922299 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96626458-3db0-485a-b300-e744a49a2512 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:26.040067 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 640/1273] 10.222.0.55 () {58 vars in 1439 bytes} [Wed Aug 24 16:54:25 2022] PUT /identity/v3/projects/ebae6aa9c60343e6ba0ff1cd62619642/users/32ef97356edf406aad9ab5f502bdb0af/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 16:54:28.009628 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf4533-b65d-46c3-a3ab-21256c4e826a None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:28.010200 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf4533-b65d-46c3-a3ab-21256c4e826a None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:28.010200 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf4533-b65d-46c3-a3ab-21256c4e826a None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:28.012087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 634/1274] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:54:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:54:28.017729 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2055d3-8ab7-47eb-8d9d-7eea774ceed9 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:28.018217 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2055d3-8ab7-47eb-8d9d-7eea774ceed9 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:28.018339 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2055d3-8ab7-47eb-8d9d-7eea774ceed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:28.037218 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-6d2055d3-8ab7-47eb-8d9d-7eea774ceed9 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:54:28.038425 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-6d2055d3-8ab7-47eb-8d9d-7eea774ceed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:54:28.108380 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 641/1275] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:54:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:54:28.379788 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf4533-b65d-46c3-a3ab-21256c4e826a None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:28.486401 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf4533-b65d-46c3-a3ab-21256c4e826a None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:28.505129 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:28.521739 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6fd0c-3d28-40a9-8a56-a6887e4e120d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:28.522358 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6fd0c-3d28-40a9-8a56-a6887e4e120d None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:28.522630 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6fd0c-3d28-40a9-8a56-a6887e4e120d None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:28.522892 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c6fd0c-3d28-40a9-8a56-a6887e4e120d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:28.533265 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c6fd0c-3d28-40a9-8a56-a6887e4e120d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 16:54:28.537948 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-d2c6fd0c-3d28-40a9-8a56-a6887e4e120d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:54:28.537948 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:28.537948 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:54:28.537948 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:54:28.537948 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:54:28.537948 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:54:28.537948 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:54:28.537948 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:54:28.537948 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:54:28.537948 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:54:28.537948 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:54:28.537948 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:54:28.537948 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 16:54:28.537948 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 16:54:28.537948 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 16:54:28.537948 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 16:54:28.543129 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 16:54:28.543129 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 16:54:28.543129 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 16:54:28.543129 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 16:54:28.543129 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:54:28.543129 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:54:28.543129 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:54:28.543129 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:54:28.543129 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:54:28.543129 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:54:28.543129 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:54:28.543129 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:54:28.543129 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:54:28.543129 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:54:28.543129 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:54:28.543129 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:54:28.544186 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:54:28.544186 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:54:28.544186 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:54:28.544186 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:54:28.544186 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 16:54:28.544186 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 16:54:28.544186 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 16:54:28.544186 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 16:54:28.544186 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 16:54:28.544186 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 16:54:28.544186 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 16:54:28.544186 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:54:28.544186 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 635/1276] 10.222.0.55 () {56 vars in 1096 bytes} [Wed Aug 24 16:54:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:54:28.546241 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2055d3-8ab7-47eb-8d9d-7eea774ceed9 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:28.630326 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:28.648566 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2055d3-8ab7-47eb-8d9d-7eea774ceed9 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:28.684727 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96efeee-dfff-4324-8e0e-d16c42034369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:28.685340 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96efeee-dfff-4324-8e0e-d16c42034369 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:28.685614 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96efeee-dfff-4324-8e0e-d16c42034369 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:28.685883 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96efeee-dfff-4324-8e0e-d16c42034369 None admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:28.686544 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96efeee-dfff-4324-8e0e-d16c42034369 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:28.686841 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96efeee-dfff-4324-8e0e-d16c42034369 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:28.688230 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96efeee-dfff-4324-8e0e-d16c42034369 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:28.698265 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 642/1277] 10.222.0.55 () {56 vars in 1099 bytes} [Wed Aug 24 16:54:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:28.703312 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6fd0c-3d28-40a9-8a56-a6887e4e120d None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:28.803507 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c6fd0c-3d28-40a9-8a56-a6887e4e120d None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:28.838609 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22338126-f565-4768-8781-937c55d63c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:28.839633 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22338126-f565-4768-8781-937c55d63c46 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:28.839920 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22338126-f565-4768-8781-937c55d63c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:28.840255 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22338126-f565-4768-8781-937c55d63c46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:28.850802 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22338126-f565-4768-8781-937c55d63c46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:28.852287 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22338126-f565-4768-8781-937c55d63c46 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:28.867088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-22338126-f565-4768-8781-937c55d63c46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:54:28.867088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:28.867088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:54:28.867088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:54:28.867088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:54:28.867088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:54:28.867088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:54:28.867088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:54:28.867088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:54:28.867088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:54:28.867088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:54:28.867088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:54:28.867088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:54:28.867088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:54:28.867088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:54:28.867088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:54:28.871623 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:54:28.871623 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:54:28.871623 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:54:28.871623 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:54:28.871623 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:54:28.871623 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:54:28.871623 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:54:28.871623 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:54:28.871623 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:54:28.871623 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:54:28.871623 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:54:28.871623 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:54:28.871623 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:54:28.871623 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:54:28.871623 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:54:28.871623 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:54:28.871623 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:54:28.873058 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:54:28.873058 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:54:28.873058 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:54:28.873058 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 636/1278] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:54:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 16:54:28.875058 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96efeee-dfff-4324-8e0e-d16c42034369 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:28.976738 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96efeee-dfff-4324-8e0e-d16c42034369 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:29.010379 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61387d07-2f4c-4c9e-8edd-be679780812c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:29.010985 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61387d07-2f4c-4c9e-8edd-be679780812c None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:29.011280 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61387d07-2f4c-4c9e-8edd-be679780812c None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:29.011544 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61387d07-2f4c-4c9e-8edd-be679780812c None admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:29.012177 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61387d07-2f4c-4c9e-8edd-be679780812c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:29.012475 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61387d07-2f4c-4c9e-8edd-be679780812c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:29.013820 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61387d07-2f4c-4c9e-8edd-be679780812c None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:29.025859 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 643/1279] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:54:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:29.032597 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22338126-f565-4768-8781-937c55d63c46 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:29.063992 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:29.131931 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22338126-f565-4768-8781-937c55d63c46 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:29.164238 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb86917-1130-4e4e-8056-644ac12a3d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:29.164855 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb86917-1130-4e4e-8056-644ac12a3d9f None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:29.165130 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb86917-1130-4e4e-8056-644ac12a3d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:29.165399 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb86917-1130-4e4e-8056-644ac12a3d9f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:29.173225 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb86917-1130-4e4e-8056-644ac12a3d9f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:29.174915 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb86917-1130-4e4e-8056-644ac12a3d9f None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:29.187256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-cdb86917-1130-4e4e-8056-644ac12a3d9f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 16:54:29.187256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:29.187256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:54:29.187256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:54:29.187256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:54:29.187256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:54:29.187256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:54:29.187256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:54:29.187256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:54:29.187256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:54:29.187256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:54:29.187256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:54:29.187256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 16:54:29.187256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 16:54:29.187256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 16:54:29.187256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 16:54:29.190864 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:54:29.190864 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:54:29.190864 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 16:54:29.190864 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:54:29.190864 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 16:54:29.190864 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 16:54:29.190864 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:54:29.190864 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:54:29.190864 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:54:29.190864 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:54:29.190864 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:54:29.190864 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:54:29.190864 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:54:29.190864 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:54:29.190864 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:54:29.190864 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:54:29.190864 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:54:29.190864 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:54:29.192160 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:54:29.192160 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:54:29.192160 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 16:54:29.192160 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 16:54:29.192160 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 16:54:29.192160 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 16:54:29.192160 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 16:54:29.192160 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 16:54:29.192160 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 16:54:29.192160 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:54:29.192160 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 637/1280] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:54:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:54:29.194298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61387d07-2f4c-4c9e-8edd-be679780812c None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:29.198267 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:29.300841 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61387d07-2f4c-4c9e-8edd-be679780812c None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:29.338261 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141ded3-4441-4bf4-8bad-820b5757f352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:29.339496 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141ded3-4441-4bf4-8bad-820b5757f352 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:29.339765 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141ded3-4441-4bf4-8bad-820b5757f352 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:29.340216 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141ded3-4441-4bf4-8bad-820b5757f352 None admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:29.340974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141ded3-4441-4bf4-8bad-820b5757f352 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:29.341277 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141ded3-4441-4bf4-8bad-820b5757f352 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:29.342740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141ded3-4441-4bf4-8bad-820b5757f352 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:29.363858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 644/1281] 10.222.0.55 () {56 vars in 1143 bytes} [Wed Aug 24 16:54:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:29.370762 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb86917-1130-4e4e-8056-644ac12a3d9f None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:29.464898 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:29.474262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb86917-1130-4e4e-8056-644ac12a3d9f None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:29.507491 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a52b49-0612-4a57-bfcf-46bcdc209371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:29.508094 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a52b49-0612-4a57-bfcf-46bcdc209371 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:29.508372 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a52b49-0612-4a57-bfcf-46bcdc209371 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:29.508643 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a52b49-0612-4a57-bfcf-46bcdc209371 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:29.576481 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a52b49-0612-4a57-bfcf-46bcdc209371 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:29.577849 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a52b49-0612-4a57-bfcf-46bcdc209371 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:29.671717 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:29.681885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 638/1282] 10.222.0.55 () {58 vars in 1282 bytes} [Wed Aug 24 16:54:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 16:54:29.688893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141ded3-4441-4bf4-8bad-820b5757f352 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:29.753038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:29.792356 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141ded3-4441-4bf4-8bad-820b5757f352 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:29.827468 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b387f-adbd-4c7b-8939-5b59ee0c8aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:29.828014 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b387f-adbd-4c7b-8939-5b59ee0c8aa7 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:29.828291 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b387f-adbd-4c7b-8939-5b59ee0c8aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:29.828559 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b387f-adbd-4c7b-8939-5b59ee0c8aa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:29.839353 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b387f-adbd-4c7b-8939-5b59ee0c8aa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:29.841151 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165b387f-adbd-4c7b-8939-5b59ee0c8aa7 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:29.857116 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-165b387f-adbd-4c7b-8939-5b59ee0c8aa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:54:29.857116 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:29.857116 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:54:29.857116 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:54:29.857116 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:54:29.857116 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:54:29.857116 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:54:29.857116 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:54:29.857116 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:54:29.857116 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:54:29.857116 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:54:29.857116 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:54:29.857116 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 16:54:29.857116 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 16:54:29.857116 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 16:54:29.857116 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 16:54:29.858310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:54:29.858310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:54:29.858310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:54:29.858310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:54:29.858310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:54:29.858310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:54:29.858310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:54:29.858310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:54:29.858310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:54:29.858310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:54:29.858310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:54:29.858310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:54:29.858310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:54:29.858310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:54:29.858310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:54:29.858310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:54:29.858310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 16:54:29.859262 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 16:54:29.859262 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 16:54:29.859262 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:54:29.859262 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 645/1283] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 16:54:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:54:29.864180 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a52b49-0612-4a57-bfcf-46bcdc209371 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:29.969923 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a52b49-0612-4a57-bfcf-46bcdc209371 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:30.006002 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedba22-e373-491f-9c93-5933d3783261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:30.006717 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedba22-e373-491f-9c93-5933d3783261 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:30.006991 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedba22-e373-491f-9c93-5933d3783261 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:30.007310 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedba22-e373-491f-9c93-5933d3783261 None admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:30.007992 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedba22-e373-491f-9c93-5933d3783261 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:30.008296 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedba22-e373-491f-9c93-5933d3783261 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:30.009687 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedba22-e373-491f-9c93-5933d3783261 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:30.022763 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 639/1284] 10.222.0.55 () {56 vars in 1109 bytes} [Wed Aug 24 16:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:30.029419 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b387f-adbd-4c7b-8939-5b59ee0c8aa7 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:30.133210 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b387f-adbd-4c7b-8939-5b59ee0c8aa7 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:30.150151 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:30.174388 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54febb-14ea-413c-9ab4-568b10941f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:30.175320 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54febb-14ea-413c-9ab4-568b10941f4d None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:30.175597 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54febb-14ea-413c-9ab4-568b10941f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:30.175865 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e54febb-14ea-413c-9ab4-568b10941f4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:30.184080 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54febb-14ea-413c-9ab4-568b10941f4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:30.185535 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e54febb-14ea-413c-9ab4-568b10941f4d None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:30.197651 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application [None req-6e54febb-14ea-413c-9ab4-568b10941f4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:54:30.197651 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:30.197651 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:54:30.197651 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:54:30.197651 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:54:30.197651 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:54:30.197651 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:54:30.197651 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:54:30.197651 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:54:30.197651 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:54:30.197651 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:54:30.197651 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:54:30.197651 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 16:54:30.197651 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 16:54:30.197651 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 16:54:30.199181 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 16:54:30.199181 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:54:30.199181 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:54:30.199181 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:54:30.199181 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:54:30.199181 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:54:30.199181 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:54:30.199181 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:54:30.199181 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application with Lock( Aug 24 16:54:30.199181 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:54:30.199181 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:54:30.199181 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:54:30.199181 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:54:30.199181 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:54:30.199181 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:54:30.199181 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:54:30.199181 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:54:30.200122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 16:54:30.200122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 16:54:30.200122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 16:54:30.200122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 16:54:30.200122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 16:54:30.200122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 16:54:30.200122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 16:54:30.200122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: ERROR keystone.server.flask.application Aug 24 16:54:30.202192 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 646/1285] 10.222.0.55 () {56 vars in 1111 bytes} [Wed Aug 24 16:54:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:54:30.208209 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedba22-e373-491f-9c93-5933d3783261 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:30.260004 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:30.311385 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedba22-e373-491f-9c93-5933d3783261 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:30.347679 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7314acb-bf8f-425d-9cd3-71457c3a44fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:30.348292 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7314acb-bf8f-425d-9cd3-71457c3a44fc None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:30.348570 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7314acb-bf8f-425d-9cd3-71457c3a44fc None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:30.348837 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7314acb-bf8f-425d-9cd3-71457c3a44fc None admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:30.349534 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7314acb-bf8f-425d-9cd3-71457c3a44fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:30.349840 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7314acb-bf8f-425d-9cd3-71457c3a44fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:30.351298 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7314acb-bf8f-425d-9cd3-71457c3a44fc None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:30.364460 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 640/1286] 10.222.0.55 () {56 vars in 1148 bytes} [Wed Aug 24 16:54:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:30.372051 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54febb-14ea-413c-9ab4-568b10941f4d None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:30.485440 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e54febb-14ea-413c-9ab4-568b10941f4d None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:30.520855 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700ec50-34ce-4e73-9749-772e6b6e6a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:30.521441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700ec50-34ce-4e73-9749-772e6b6e6a6b None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:30.521715 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700ec50-34ce-4e73-9749-772e6b6e6a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:30.521983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700ec50-34ce-4e73-9749-772e6b6e6a6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:30.522702 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700ec50-34ce-4e73-9749-772e6b6e6a6b None admin] RBAC: Adding query filter params (role.id=99f0ace9fc4d4d028ca52fa9730cab4b, scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642, user.id=32ef97356edf406aad9ab5f502bdb0af) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:30.523008 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700ec50-34ce-4e73-9749-772e6b6e6a6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:30.524455 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700ec50-34ce-4e73-9749-772e6b6e6a6b None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:30.530605 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 647/1287] 10.222.0.55 () {56 vars in 1374 bytes} [Wed Aug 24 16:54:30 2022] GET /identity/v3/role_assignments?user.id=32ef97356edf406aad9ab5f502bdb0af&scope.project.id=ebae6aa9c60343e6ba0ff1cd62619642&role.id=99f0ace9fc4d4d028ca52fa9730cab4b => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:32.501031 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee847e7-aa26-4e68-9051-849dfd2b66ae None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:32.501628 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee847e7-aa26-4e68-9051-849dfd2b66ae None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:32.501628 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee847e7-aa26-4e68-9051-849dfd2b66ae None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:32.502925 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 641/1288] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:54:32.508685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d0e4c-d2f6-450f-abf3-6dae33db8ac2 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:32.509208 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d0e4c-d2f6-450f-abf3-6dae33db8ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:32.509333 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74d0e4c-d2f6-450f-abf3-6dae33db8ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:32.528425 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-d74d0e4c-d2f6-450f-abf3-6dae33db8ac2 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:54:32.529622 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-d74d0e4c-d2f6-450f-abf3-6dae33db8ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:54:32.559990 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:32.598047 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 648/1289] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:54:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:54:32.872702 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee847e7-aa26-4e68-9051-849dfd2b66ae None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:32.997835 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee847e7-aa26-4e68-9051-849dfd2b66ae None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:33.012006 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:33.037802 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df83fb2-374f-4878-97f1-6a3dfe893ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:33.038449 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df83fb2-374f-4878-97f1-6a3dfe893ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:33.038727 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df83fb2-374f-4878-97f1-6a3dfe893ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:33.038995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df83fb2-374f-4878-97f1-6a3dfe893ba3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:33.039617 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df83fb2-374f-4878-97f1-6a3dfe893ba3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:33.041002 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df83fb2-374f-4878-97f1-6a3dfe893ba3 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:33.051024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-9df83fb2-374f-4878-97f1-6a3dfe893ba3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 16:54:33.051024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:33.051024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:54:33.051024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:54:33.051024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:54:33.051024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:54:33.051024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:54:33.051024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:54:33.051024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 16:54:33.051024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:54:33.051024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:54:33.051024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:54:33.051024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:33.051024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:54:33.051024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:54:33.051024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:54:33.051024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:54:33.052222 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:54:33.052222 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:54:33.052222 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:54:33.052222 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:54:33.052222 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:54:33.052222 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:54:33.052222 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:54:33.052222 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:54:33.052222 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:54:33.052222 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:54:33.052222 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:54:33.052222 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:54:33.052222 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:54:33.052222 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:54:33.052222 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:54:33.052222 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:54:33.053165 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:54:33.053165 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:54:33.053165 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:54:33.053165 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:54:33.053165 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:54:33.053165 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:54:33.053165 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:54:33.053165 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:54:33.053165 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:54:33.053165 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:54:33.053165 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:54:33.053165 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:54:33.053165 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 16:54:33.053165 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:54:33.053165 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 642/1290] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Aug 24 16:54:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:54:33.059216 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d0e4c-d2f6-450f-abf3-6dae33db8ac2 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:33.168511 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74d0e4c-d2f6-450f-abf3-6dae33db8ac2 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:33.206832 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0564c-2eed-41ca-8b69-d3506a4503de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:33.207377 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0564c-2eed-41ca-8b69-d3506a4503de None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:33.207710 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0564c-2eed-41ca-8b69-d3506a4503de None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:33.207982 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0564c-2eed-41ca-8b69-d3506a4503de None admin] PATH_INFO: `/v3/services` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:33.208611 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0564c-2eed-41ca-8b69-d3506a4503de None admin] RBAC: Adding query filter params (name=placement) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:33.208908 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0564c-2eed-41ca-8b69-d3506a4503de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:33.210264 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc0564c-2eed-41ca-8b69-d3506a4503de None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:33.215644 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 649/1291] 10.222.0.55 () {56 vars in 1116 bytes} [Wed Aug 24 16:54:33 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:33.221606 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df83fb2-374f-4878-97f1-6a3dfe893ba3 None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:33.337322 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df83fb2-374f-4878-97f1-6a3dfe893ba3 None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:33.373357 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6838ee-d233-43b5-b6c9-c65cd2b581b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:33.373975 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6838ee-d233-43b5-b6c9-c65cd2b581b0 None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:33.374252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6838ee-d233-43b5-b6c9-c65cd2b581b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:33.374522 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6838ee-d233-43b5-b6c9-c65cd2b581b0 None admin] PATH_INFO: `/v3/services` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:33.375174 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6838ee-d233-43b5-b6c9-c65cd2b581b0 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:33.375559 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6838ee-d233-43b5-b6c9-c65cd2b581b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:33.376936 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6838ee-d233-43b5-b6c9-c65cd2b581b0 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:33.381957 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 643/1292] 10.222.0.55 () {56 vars in 1116 bytes} [Wed Aug 24 16:54:33 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:35.462639 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec3e85-8b28-4f25-bc8f-52d0ac5f9ee6 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:35.463205 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec3e85-8b28-4f25-bc8f-52d0ac5f9ee6 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:35.463333 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec3e85-8b28-4f25-bc8f-52d0ac5f9ee6 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:35.464850 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 650/1293] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:54:35.470504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0158847-a63a-4a0d-b7e1-9566cffc85cd None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:35.470946 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0158847-a63a-4a0d-b7e1-9566cffc85cd None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:35.471047 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0158847-a63a-4a0d-b7e1-9566cffc85cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:35.489427 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-b0158847-a63a-4a0d-b7e1-9566cffc85cd None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:54:35.490695 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-b0158847-a63a-4a0d-b7e1-9566cffc85cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:54:35.523073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:35.561894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 644/1294] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:54:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:54:35.839047 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec3e85-8b28-4f25-bc8f-52d0ac5f9ee6 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:35.873512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:35.943004 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec3e85-8b28-4f25-bc8f-52d0ac5f9ee6 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:35.976249 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e963ee-5371-4c37-9435-81f5f4b0ca1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:35.977047 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e963ee-5371-4c37-9435-81f5f4b0ca1d None admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:35.977505 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e963ee-5371-4c37-9435-81f5f4b0ca1d None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:35.978371 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e963ee-5371-4c37-9435-81f5f4b0ca1d None admin] PATH_INFO: `/v3/services` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:35.979012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e963ee-5371-4c37-9435-81f5f4b0ca1d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:35.981554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e963ee-5371-4c37-9435-81f5f4b0ca1d None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:36.093060 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 651/1295] 10.222.0.55 () {60 vars in 1141 bytes} [Wed Aug 24 16:54:35 2022] POST /identity/v3/services => generated 246 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 16:54:38.025600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77230191-f6c0-4280-8a9a-a41561a48cd6 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:38.026171 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77230191-f6c0-4280-8a9a-a41561a48cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:38.026171 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77230191-f6c0-4280-8a9a-a41561a48cd6 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:38.027515 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 645/1296] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:54:38.033229 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ad727-4f41-4597-8b83-f3be2ed27792 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:38.033668 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ad727-4f41-4597-8b83-f3be2ed27792 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:38.033754 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ad727-4f41-4597-8b83-f3be2ed27792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:38.052374 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-128ad727-4f41-4597-8b83-f3be2ed27792 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:54:38.053570 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-128ad727-4f41-4597-8b83-f3be2ed27792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:54:38.127867 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 652/1297] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:54:38 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:54:38.393643 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77230191-f6c0-4280-8a9a-a41561a48cd6 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:38.502954 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77230191-f6c0-4280-8a9a-a41561a48cd6 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:38.538263 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa178ce-e7ee-4115-b8ce-1ab1826ed1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:38.540615 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa178ce-e7ee-4115-b8ce-1ab1826ed1cd None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:38.540615 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa178ce-e7ee-4115-b8ce-1ab1826ed1cd None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:38.540615 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa178ce-e7ee-4115-b8ce-1ab1826ed1cd None admin] PATH_INFO: `/v3/services/placement` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:38.540615 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa178ce-e7ee-4115-b8ce-1ab1826ed1cd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:38.541460 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa178ce-e7ee-4115-b8ce-1ab1826ed1cd None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:38.550589 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-8aa178ce-e7ee-4115-b8ce-1ab1826ed1cd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 16:54:38.550589 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:38.550589 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:54:38.550589 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:54:38.550589 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:54:38.550589 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:54:38.550589 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:54:38.550589 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:54:38.550589 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 16:54:38.550589 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:54:38.550589 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:54:38.550589 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:54:38.550589 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:38.550589 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:54:38.550589 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:54:38.550589 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:54:38.550589 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:54:38.551723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:54:38.551723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:54:38.551723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:54:38.551723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:54:38.551723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:54:38.551723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:54:38.551723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:54:38.551723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:54:38.551723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:54:38.551723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:54:38.551723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:54:38.551723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:54:38.551723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:54:38.551723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:54:38.551723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:54:38.551723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:54:38.553033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:54:38.553033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:54:38.553033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:54:38.553033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:54:38.553033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:54:38.553033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:54:38.553033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:54:38.553033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:54:38.553033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:54:38.553033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:54:38.553033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:54:38.553033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:54:38.553033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 16:54:38.553033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:54:38.553033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 646/1298] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Aug 24 16:54:38 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:54:38.559000 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ad727-4f41-4597-8b83-f3be2ed27792 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:38.578091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:38.658954 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ad727-4f41-4597-8b83-f3be2ed27792 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:38.693869 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c4775-8b00-4176-918e-b6d335498573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:38.694475 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c4775-8b00-4176-918e-b6d335498573 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:38.694750 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c4775-8b00-4176-918e-b6d335498573 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:38.695016 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c4775-8b00-4176-918e-b6d335498573 None admin] PATH_INFO: `/v3/services` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:38.695665 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c4775-8b00-4176-918e-b6d335498573 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:38.696025 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c4775-8b00-4176-918e-b6d335498573 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:38.697396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c4775-8b00-4176-918e-b6d335498573 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:38.702930 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 653/1299] 10.222.0.55 () {56 vars in 1116 bytes} [Wed Aug 24 16:54:38 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:38.709412 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa178ce-e7ee-4115-b8ce-1ab1826ed1cd None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:38.742582 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:38.812028 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa178ce-e7ee-4115-b8ce-1ab1826ed1cd None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:38.845941 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c355942-50d9-4c59-b946-771ddb07e42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:38.846545 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c355942-50d9-4c59-b946-771ddb07e42f None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:38.846850 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c355942-50d9-4c59-b946-771ddb07e42f None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:38.847158 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c355942-50d9-4c59-b946-771ddb07e42f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:38.847853 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c355942-50d9-4c59-b946-771ddb07e42f None admin] RBAC: Adding query filter params (interface=public, service_id=5df705c1905a4a0886537f435b85bd8b, region_id=RegionOne) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:38.850591 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c355942-50d9-4c59-b946-771ddb07e42f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:38.850591 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c355942-50d9-4c59-b946-771ddb07e42f None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:38.855382 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 647/1300] 10.222.0.55 () {56 vars in 1251 bytes} [Wed Aug 24 16:54:38 2022] GET /identity/v3/endpoints?service_id=5df705c1905a4a0886537f435b85bd8b&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:38.861038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c4775-8b00-4176-918e-b6d335498573 None admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:38.943954 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:38.961558 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c4775-8b00-4176-918e-b6d335498573 None admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:38.996821 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8f77c-1e62-424a-aa8b-02fd7c248dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:38.997501 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8f77c-1e62-424a-aa8b-02fd7c248dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:38.997828 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8f77c-1e62-424a-aa8b-02fd7c248dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:38.998098 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8f77c-1e62-424a-aa8b-02fd7c248dc1 None admin] PATH_INFO: `/v3/services` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:38.998706 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8f77c-1e62-424a-aa8b-02fd7c248dc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:39.000136 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8f77c-1e62-424a-aa8b-02fd7c248dc1 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:39.007518 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 654/1301] 10.222.0.55 () {56 vars in 1087 bytes} [Wed Aug 24 16:54:38 2022] GET /identity/v3/services => generated 2191 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 16:54:40.970182 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc10955-03f4-4269-8f6f-b160492ec9fe None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:40.970737 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc10955-03f4-4269-8f6f-b160492ec9fe None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:40.970737 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc10955-03f4-4269-8f6f-b160492ec9fe None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:40.972086 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 648/1302] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 16:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 16:54:40.977715 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d035df-1007-4d81-91ff-cf98a9fbd2a1 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:40.978094 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d035df-1007-4d81-91ff-cf98a9fbd2a1 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:40.978327 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d035df-1007-4d81-91ff-cf98a9fbd2a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:40.997510 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-84d035df-1007-4d81-91ff-cf98a9fbd2a1 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 16:54:40.998741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-84d035df-1007-4d81-91ff-cf98a9fbd2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 16:54:41.066159 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 655/1303] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 16:54:40 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 16:54:41.334421 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc10955-03f4-4269-8f6f-b160492ec9fe None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:41.439295 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:41.446215 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc10955-03f4-4269-8f6f-b160492ec9fe None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:41.480604 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2919e64-d530-4d7b-bc16-afe9d2e64ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:41.481223 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2919e64-d530-4d7b-bc16-afe9d2e64ffd None admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:41.481498 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2919e64-d530-4d7b-bc16-afe9d2e64ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:41.481765 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2919e64-d530-4d7b-bc16-afe9d2e64ffd None admin] PATH_INFO: `/v3/services/placement` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:41.482342 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2919e64-d530-4d7b-bc16-afe9d2e64ffd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:41.483760 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2919e64-d530-4d7b-bc16-afe9d2e64ffd None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:41.492100 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application [None req-e2919e64-d530-4d7b-bc16-afe9d2e64ffd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 16:54:41.492100 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:41.492100 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 16:54:41.492100 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 16:54:41.492100 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 16:54:41.492100 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 16:54:41.492100 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 16:54:41.492100 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:54:41.492100 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 16:54:41.492100 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:54:41.492100 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 16:54:41.492100 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:54:41.492100 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 16:54:41.492100 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 16:54:41.492100 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 16:54:41.492100 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 16:54:41.492100 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 16:54:41.493426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 16:54:41.493426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 16:54:41.493426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 16:54:41.493426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 16:54:41.493426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 16:54:41.493426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 16:54:41.493426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 16:54:41.493426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 16:54:41.493426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 16:54:41.493426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 16:54:41.493426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 16:54:41.493426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 16:54:41.493426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 16:54:41.493426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 16:54:41.493426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 16:54:41.493426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 16:54:41.494476 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 16:54:41.494476 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application with Lock( Aug 24 16:54:41.494476 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 16:54:41.494476 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self._enter() Aug 24 16:54:41.494476 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 16:54:41.494476 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 16:54:41.494476 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 16:54:41.494476 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application return self.creator() Aug 24 16:54:41.494476 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 16:54:41.494476 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application created_value = creator( Aug 24 16:54:41.494476 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 16:54:41.494476 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 16:54:41.494476 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 16:54:41.494476 dv-cinder-779578-5-smb devstack@keystone.service[81760]: ERROR keystone.server.flask.application Aug 24 16:54:41.494476 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 649/1304] 10.222.0.55 () {56 vars in 1117 bytes} [Wed Aug 24 16:54:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 16:54:41.499475 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d035df-1007-4d81-91ff-cf98a9fbd2a1 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:41.573243 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:41.595647 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d035df-1007-4d81-91ff-cf98a9fbd2a1 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:41.628865 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dad4ef-bb68-4dc8-9b2e-d8aeb6a9ff51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:41.629459 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dad4ef-bb68-4dc8-9b2e-d8aeb6a9ff51 None admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:41.629733 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dad4ef-bb68-4dc8-9b2e-d8aeb6a9ff51 None admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:41.630003 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dad4ef-bb68-4dc8-9b2e-d8aeb6a9ff51 None admin] PATH_INFO: `/v3/services` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:41.630618 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dad4ef-bb68-4dc8-9b2e-d8aeb6a9ff51 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 16:54:41.630918 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dad4ef-bb68-4dc8-9b2e-d8aeb6a9ff51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:41.632298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dad4ef-bb68-4dc8-9b2e-d8aeb6a9ff51 None admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:41.637333 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 656/1305] 10.222.0.55 () {56 vars in 1116 bytes} [Wed Aug 24 16:54:41 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 16:54:41.643197 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2919e64-d530-4d7b-bc16-afe9d2e64ffd None admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 16:54:41.749053 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2919e64-d530-4d7b-bc16-afe9d2e64ffd None admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 16:54:41.782478 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9c5915-5b0c-4b4c-8e76-b5cc5d3c1e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 16:54:41.783070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c5915-5b0c-4b4c-8e76-b5cc5d3c1e92 None admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 16:54:41.783372 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c5915-5b0c-4b4c-8e76-b5cc5d3c1e92 None admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 16:54:41.783673 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c5915-5b0c-4b4c-8e76-b5cc5d3c1e92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 16:54:41.784372 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c5915-5b0c-4b4c-8e76-b5cc5d3c1e92 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 16:54:41.785718 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9c5915-5b0c-4b4c-8e76-b5cc5d3c1e92 None admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 16:54:41.946146 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 650/1306] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 16:54:41 2022] POST /identity/v3/endpoints => generated 331 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 16:54:51.697242 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=30 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 16:54:51.941239 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:01:51.389655 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988264d-aaa7-47b1-99ca-b698ebe914af None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:01:51.390101 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988264d-aaa7-47b1-99ca-b698ebe914af None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:01:51.390324 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988264d-aaa7-47b1-99ca-b698ebe914af None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:01:51.392092 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 657/1307] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 17:01:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:01:51.398675 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c20a4-399f-4cd0-89e2-6eae4bc2c717 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:01:51.399200 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c20a4-399f-4cd0-89e2-6eae4bc2c717 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:01:51.399285 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c20a4-399f-4cd0-89e2-6eae4bc2c717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:01:51.512453 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-da3c20a4-399f-4cd0-89e2-6eae4bc2c717 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:01:51.515962 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-da3c20a4-399f-4cd0-89e2-6eae4bc2c717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:01:51.691152 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 651/1308] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 17:01:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:01:51.994073 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57524f88-1881-47ec-a7be-7cda8d1ab02a None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:01:51.994354 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57524f88-1881-47ec-a7be-7cda8d1ab02a None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:01:51.994887 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57524f88-1881-47ec-a7be-7cda8d1ab02a None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:01:51.996331 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 658/1309] 10.222.0.55 () {54 vars in 965 bytes} [Wed Aug 24 17:01:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:01:52.002433 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d2e5e-e83d-433d-8d2b-a9dac104c275 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:01:52.002839 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d2e5e-e83d-433d-8d2b-a9dac104c275 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:01:52.003217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3d2e5e-e83d-433d-8d2b-a9dac104c275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:01:52.085290 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-ac3d2e5e-e83d-433d-8d2b-a9dac104c275 None None] MFA Rules not processed for user `88ce8df89a96460ca046f2972321bceb`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:01:52.086544 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-ac3d2e5e-e83d-433d-8d2b-a9dac104c275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:01:52.110963 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:01:52.170147 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 652/1310] 10.222.0.55 () {58 vars in 1062 bytes} [Wed Aug 24 17:01:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:01:52.178944 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57524f88-1881-47ec-a7be-7cda8d1ab02a None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:01:52.180698 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-57524f88-1881-47ec-a7be-7cda8d1ab02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:01:52.316192 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57524f88-1881-47ec-a7be-7cda8d1ab02a None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:01:52.405469 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06568d19-9dfb-4a85-942d-3682aa0c7326 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:01:52.406139 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06568d19-9dfb-4a85-942d-3682aa0c7326 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:01:52.406389 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06568d19-9dfb-4a85-942d-3682aa0c7326 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:01:52.406605 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06568d19-9dfb-4a85-942d-3682aa0c7326 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:01:52.408267 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-06568d19-9dfb-4a85-942d-3682aa0c7326 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:01:52.467516 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:01:52.525072 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06568d19-9dfb-4a85-942d-3682aa0c7326 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:01:52.526573 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06568d19-9dfb-4a85-942d-3682aa0c7326 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:01:52.547369 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 659/1311] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:01:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:01:54.824623 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d09af5-8550-44b8-8df4-097e08d6b506 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:01:54.825182 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d09af5-8550-44b8-8df4-097e08d6b506 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:01:54.825182 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d09af5-8550-44b8-8df4-097e08d6b506 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:01:54.826590 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 653/1312] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 17:01:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:01:54.832577 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f27e40-2994-4c48-9571-b17d7cf0f389 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:01:54.833040 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f27e40-2994-4c48-9571-b17d7cf0f389 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:01:54.833215 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f27e40-2994-4c48-9571-b17d7cf0f389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:01:54.932623 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-53f27e40-2994-4c48-9571-b17d7cf0f389 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:01:54.933812 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-53f27e40-2994-4c48-9571-b17d7cf0f389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:01:55.046350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 660/1313] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 17:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:01:55.328437 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d09af5-8550-44b8-8df4-097e08d6b506 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:01:55.329956 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-60d09af5-8550-44b8-8df4-097e08d6b506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:01:55.432938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d09af5-8550-44b8-8df4-097e08d6b506 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:01:55.503762 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:01:55.506783 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbc610-d32b-4bbf-9425-e20417a0bb82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:01:55.507420 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbc610-d32b-4bbf-9425-e20417a0bb82 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:01:55.507701 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbc610-d32b-4bbf-9425-e20417a0bb82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:01:55.507974 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbc610-d32b-4bbf-9425-e20417a0bb82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:01:55.509577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-33cbc610-d32b-4bbf-9425-e20417a0bb82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:01:55.618710 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbc610-d32b-4bbf-9425-e20417a0bb82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:01:55.620183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbc610-d32b-4bbf-9425-e20417a0bb82 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:01:55.639080 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 654/1314] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:01:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:01:58.065215 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7e36f-b59d-4906-8295-74bd8c60ca57 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:01:58.065746 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7e36f-b59d-4906-8295-74bd8c60ca57 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:01:58.065746 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f7e36f-b59d-4906-8295-74bd8c60ca57 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:01:58.067080 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 661/1315] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 17:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:01:58.072549 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb6b25-3113-4332-9195-59b23aa2c54e None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:01:58.072959 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb6b25-3113-4332-9195-59b23aa2c54e None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:01:58.073095 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb6b25-3113-4332-9195-59b23aa2c54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:01:58.139529 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-93fb6b25-3113-4332-9195-59b23aa2c54e None None] MFA Rules not processed for user `62ccc5c8c0c14b0588bb574681eadcf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:01:58.140680 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-93fb6b25-3113-4332-9195-59b23aa2c54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:01:58.195880 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:01:58.244202 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 655/1316] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 17:01:58 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:01:58.535801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7e36f-b59d-4906-8295-74bd8c60ca57 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:01:58.538515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-91f7e36f-b59d-4906-8295-74bd8c60ca57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:01:58.548532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:01:58.648435 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f7e36f-b59d-4906-8295-74bd8c60ca57 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:01:58.728755 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40460191-f6ec-425c-9185-97c06b349030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:01:58.729358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40460191-f6ec-425c-9185-97c06b349030 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:01:58.729656 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40460191-f6ec-425c-9185-97c06b349030 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:01:58.729895 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40460191-f6ec-425c-9185-97c06b349030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:01:58.731507 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-40460191-f6ec-425c-9185-97c06b349030 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:01:58.795245 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:01:58.843412 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40460191-f6ec-425c-9185-97c06b349030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:01:58.844838 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40460191-f6ec-425c-9185-97c06b349030 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:01:58.863473 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 662/1317] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:01:58 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:02:01.658614 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19ba87-3ae2-43b5-95d6-32abb4a935f2 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:01.659292 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19ba87-3ae2-43b5-95d6-32abb4a935f2 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:01.659292 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19ba87-3ae2-43b5-95d6-32abb4a935f2 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:01.660577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 656/1318] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 17:02:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:02:01.667014 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f796970-ba26-4878-9f61-3b76ed34d4ae None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:01.667510 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f796970-ba26-4878-9f61-3b76ed34d4ae None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:01.667625 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f796970-ba26-4878-9f61-3b76ed34d4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:01.733492 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-5f796970-ba26-4878-9f61-3b76ed34d4ae None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:02:01.734728 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-5f796970-ba26-4878-9f61-3b76ed34d4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:01.831501 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 663/1319] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 17:02:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:02:02.119073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19ba87-3ae2-43b5-95d6-32abb4a935f2 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:02:02.120611 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-2b19ba87-3ae2-43b5-95d6-32abb4a935f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:02.222282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19ba87-3ae2-43b5-95d6-32abb4a935f2 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:02:02.297124 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e819fdd-1448-47e7-ae18-d9bc494b0b44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:02:02.297735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e819fdd-1448-47e7-ae18-d9bc494b0b44 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:02.298031 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e819fdd-1448-47e7-ae18-d9bc494b0b44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:02.298289 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e819fdd-1448-47e7-ae18-d9bc494b0b44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:02.299916 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-0e819fdd-1448-47e7-ae18-d9bc494b0b44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:02.308960 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:02.410024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e819fdd-1448-47e7-ae18-d9bc494b0b44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:02:02.412166 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e819fdd-1448-47e7-ae18-d9bc494b0b44 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:02:02.430298 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 657/1320] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:02:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:02:05.391141 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c7d1d-dafe-41d9-a694-05f95686fdf4 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:05.391673 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c7d1d-dafe-41d9-a694-05f95686fdf4 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:05.391792 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c7d1d-dafe-41d9-a694-05f95686fdf4 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:05.393218 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 664/1321] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 17:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:02:05.398961 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79341934-f699-4763-b801-056e9449b59d None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:05.399466 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79341934-f699-4763-b801-056e9449b59d None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:05.399606 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79341934-f699-4763-b801-056e9449b59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:05.466934 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-79341934-f699-4763-b801-056e9449b59d None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:02:05.468195 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-79341934-f699-4763-b801-056e9449b59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:05.528965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:05.570620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 658/1322] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 17:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:02:05.864943 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c7d1d-dafe-41d9-a694-05f95686fdf4 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:02:05.869475 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-976c7d1d-dafe-41d9-a694-05f95686fdf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:05.889165 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:05.985463 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c7d1d-dafe-41d9-a694-05f95686fdf4 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:02:06.068210 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40623ed8-ecf2-47a3-9de4-db89d833c36e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:02:06.068811 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40623ed8-ecf2-47a3-9de4-db89d833c36e service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:06.069085 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40623ed8-ecf2-47a3-9de4-db89d833c36e service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:06.069351 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40623ed8-ecf2-47a3-9de4-db89d833c36e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:06.070935 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-40623ed8-ecf2-47a3-9de4-db89d833c36e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:06.144214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:06.182717 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40623ed8-ecf2-47a3-9de4-db89d833c36e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:02:06.184194 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40623ed8-ecf2-47a3-9de4-db89d833c36e service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:02:06.202940 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 665/1323] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:02:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:02:08.167820 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed80939-7f7e-4e1d-802c-cd12034db367 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:08.168321 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed80939-7f7e-4e1d-802c-cd12034db367 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:08.168321 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed80939-7f7e-4e1d-802c-cd12034db367 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:08.169681 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 659/1324] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 17:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:02:08.175044 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36cf83-e0a9-4f6d-908d-7549ecee4eca None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:08.175471 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36cf83-e0a9-4f6d-908d-7549ecee4eca None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:08.175732 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d36cf83-e0a9-4f6d-908d-7549ecee4eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:08.243764 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-5d36cf83-e0a9-4f6d-908d-7549ecee4eca None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:02:08.244982 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-5d36cf83-e0a9-4f6d-908d-7549ecee4eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:08.344374 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 666/1325] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 17:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:02:08.645569 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914006c7-c32a-440f-bf79-d5ecdf5c118c None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:08.645874 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914006c7-c32a-440f-bf79-d5ecdf5c118c None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:08.646144 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914006c7-c32a-440f-bf79-d5ecdf5c118c None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:08.647688 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 660/1326] 10.222.0.55 () {54 vars in 965 bytes} [Wed Aug 24 17:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:02:08.654030 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c6661-7e45-4c6e-842a-b195995dbba8 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:08.654320 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c6661-7e45-4c6e-842a-b195995dbba8 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:08.654595 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6c6661-7e45-4c6e-842a-b195995dbba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:08.687337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:08.742125 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-db6c6661-7e45-4c6e-842a-b195995dbba8 None None] MFA Rules not processed for user `88ce8df89a96460ca046f2972321bceb`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:02:08.743373 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-db6c6661-7e45-4c6e-842a-b195995dbba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:08.827870 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 667/1327] 10.222.0.55 () {58 vars in 1062 bytes} [Wed Aug 24 17:02:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:02:08.837322 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914006c7-c32a-440f-bf79-d5ecdf5c118c None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:02:08.838840 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-914006c7-c32a-440f-bf79-d5ecdf5c118c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:08.945284 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914006c7-c32a-440f-bf79-d5ecdf5c118c None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:02:09.030730 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b88b7-0873-4cbf-8dd8-63bb9e21233e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:02:09.031365 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b88b7-0873-4cbf-8dd8-63bb9e21233e service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:09.031640 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b88b7-0873-4cbf-8dd8-63bb9e21233e service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:09.031905 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b88b7-0873-4cbf-8dd8-63bb9e21233e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:09.033495 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-e63b88b7-0873-4cbf-8dd8-63bb9e21233e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:09.051938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:09.149399 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b88b7-0873-4cbf-8dd8-63bb9e21233e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:02:09.150852 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63b88b7-0873-4cbf-8dd8-63bb9e21233e service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:02:09.170535 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 661/1328] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:02:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:02:11.376931 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70751c-93ae-4ece-9d58-dced78f99a9b None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:11.377459 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70751c-93ae-4ece-9d58-dced78f99a9b None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:11.377539 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d70751c-93ae-4ece-9d58-dced78f99a9b None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:11.379085 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 668/1329] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 17:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:02:11.385189 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad72d9b-a14b-4e1c-b6f3-11826917a69b None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:11.385693 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad72d9b-a14b-4e1c-b6f3-11826917a69b None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:11.385868 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad72d9b-a14b-4e1c-b6f3-11826917a69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:11.458122 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-bad72d9b-a14b-4e1c-b6f3-11826917a69b None None] MFA Rules not processed for user `62ccc5c8c0c14b0588bb574681eadcf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:02:11.459401 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-bad72d9b-a14b-4e1c-b6f3-11826917a69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:11.525293 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:11.560734 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 662/1330] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 17:02:11 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:02:11.848202 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70751c-93ae-4ece-9d58-dced78f99a9b None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:02:11.849690 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-7d70751c-93ae-4ece-9d58-dced78f99a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:11.955480 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d70751c-93ae-4ece-9d58-dced78f99a9b None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:02:11.977570 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:12.034366 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24274d4d-a380-499c-b634-166ce4bfd578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:02:12.034954 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24274d4d-a380-499c-b634-166ce4bfd578 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:12.035269 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24274d4d-a380-499c-b634-166ce4bfd578 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:12.035539 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24274d4d-a380-499c-b634-166ce4bfd578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:12.037232 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-24274d4d-a380-499c-b634-166ce4bfd578 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:12.149578 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24274d4d-a380-499c-b634-166ce4bfd578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:02:12.151000 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24274d4d-a380-499c-b634-166ce4bfd578 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:02:12.169355 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 669/1331] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:02:11 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:02:14.786780 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37f0e0-5514-47a4-92d0-2cd34b0e9423 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:14.787412 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37f0e0-5514-47a4-92d0-2cd34b0e9423 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:14.787412 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37f0e0-5514-47a4-92d0-2cd34b0e9423 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:14.788997 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 663/1332] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 17:02:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:02:14.794503 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba6162-be94-41fd-92c2-1e3361844b6f None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:14.794946 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba6162-be94-41fd-92c2-1e3361844b6f None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:14.795053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ba6162-be94-41fd-92c2-1e3361844b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:14.858831 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:14.861855 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-e9ba6162-be94-41fd-92c2-1e3361844b6f None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:02:14.863083 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-e9ba6162-be94-41fd-92c2-1e3361844b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:14.962350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 670/1333] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 17:02:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:02:15.244521 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37f0e0-5514-47a4-92d0-2cd34b0e9423 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:02:15.246028 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-5b37f0e0-5514-47a4-92d0-2cd34b0e9423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:15.356071 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37f0e0-5514-47a4-92d0-2cd34b0e9423 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:02:15.433681 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef65be9-ebb0-41c2-9c44-d0b553390138 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:02:15.434294 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef65be9-ebb0-41c2-9c44-d0b553390138 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:15.434574 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef65be9-ebb0-41c2-9c44-d0b553390138 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:15.434849 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef65be9-ebb0-41c2-9c44-d0b553390138 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:15.436488 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-4ef65be9-ebb0-41c2-9c44-d0b553390138 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:15.465104 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:15.546563 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef65be9-ebb0-41c2-9c44-d0b553390138 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:02:15.548035 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef65be9-ebb0-41c2-9c44-d0b553390138 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:02:15.566415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 664/1334] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:02:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:02:17.582150 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a26701-1c0d-4109-a73d-9fcd004c9100 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:17.582696 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a26701-1c0d-4109-a73d-9fcd004c9100 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:17.582823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a26701-1c0d-4109-a73d-9fcd004c9100 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:17.584125 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 671/1335] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 17:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:02:17.589737 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4745e13-13a0-4d03-b4b7-a231d617e0e0 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:17.590150 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4745e13-13a0-4d03-b4b7-a231d617e0e0 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:17.590280 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4745e13-13a0-4d03-b4b7-a231d617e0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:17.658287 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-a4745e13-13a0-4d03-b4b7-a231d617e0e0 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:02:17.659647 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-a4745e13-13a0-4d03-b4b7-a231d617e0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:17.733722 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:17.756466 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 665/1336] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 17:02:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:02:18.046673 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a26701-1c0d-4109-a73d-9fcd004c9100 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:02:18.048250 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-73a26701-1c0d-4109-a73d-9fcd004c9100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:18.151665 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a26701-1c0d-4109-a73d-9fcd004c9100 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:02:18.180914 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:18.228673 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5865ccbf-ab2f-4002-b537-35d72140a784 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:02:18.229678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865ccbf-ab2f-4002-b537-35d72140a784 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:18.230166 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865ccbf-ab2f-4002-b537-35d72140a784 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:18.230654 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5865ccbf-ab2f-4002-b537-35d72140a784 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:18.233461 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-5865ccbf-ab2f-4002-b537-35d72140a784 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:18.344394 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865ccbf-ab2f-4002-b537-35d72140a784 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:02:18.345824 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5865ccbf-ab2f-4002-b537-35d72140a784 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:02:18.368304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 672/1337] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:02:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:02:21.066719 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61115599-2e54-4774-8c16-d7deb45e39fc None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:21.067914 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61115599-2e54-4774-8c16-d7deb45e39fc None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:21.068014 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61115599-2e54-4774-8c16-d7deb45e39fc None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:21.069491 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 666/1338] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 17:02:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:02:21.074799 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63e183-b84b-48b5-bfb0-efb5c5e95312 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:21.075241 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63e183-b84b-48b5-bfb0-efb5c5e95312 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:21.075391 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63e183-b84b-48b5-bfb0-efb5c5e95312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:21.140986 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-2c63e183-b84b-48b5-bfb0-efb5c5e95312 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:02:21.142261 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-2c63e183-b84b-48b5-bfb0-efb5c5e95312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:21.151669 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:21.239963 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 673/1339] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 17:02:21 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:02:21.525468 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61115599-2e54-4774-8c16-d7deb45e39fc None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:02:21.527018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-61115599-2e54-4774-8c16-d7deb45e39fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:21.637854 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61115599-2e54-4774-8c16-d7deb45e39fc None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:02:21.714006 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f39eb-86d5-4a52-a27a-7a77ef6c178d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:02:21.714615 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f39eb-86d5-4a52-a27a-7a77ef6c178d service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:21.714898 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f39eb-86d5-4a52-a27a-7a77ef6c178d service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:21.715226 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f39eb-86d5-4a52-a27a-7a77ef6c178d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:21.716851 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-001f39eb-86d5-4a52-a27a-7a77ef6c178d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:21.751851 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:21.827797 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f39eb-86d5-4a52-a27a-7a77ef6c178d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:02:21.829239 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f39eb-86d5-4a52-a27a-7a77ef6c178d service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:02:21.849782 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 667/1340] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:02:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:02:26.259495 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f20da5-0007-4eb1-80ab-142bb8ecaecd None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:26.260066 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f20da5-0007-4eb1-80ab-142bb8ecaecd None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:26.260285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f20da5-0007-4eb1-80ab-142bb8ecaecd None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:26.261721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 674/1341] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 17:02:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:02:26.267229 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f280ac-e8ed-479d-8f31-8c09cb761b78 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:26.267707 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f280ac-e8ed-479d-8f31-8c09cb761b78 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:26.267803 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f280ac-e8ed-479d-8f31-8c09cb761b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:26.336484 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-15f280ac-e8ed-479d-8f31-8c09cb761b78 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:02:26.337759 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-15f280ac-e8ed-479d-8f31-8c09cb761b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:26.428911 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:26.440554 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 668/1342] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 17:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:02:26.725456 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f20da5-0007-4eb1-80ab-142bb8ecaecd None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:02:26.726992 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-f0f20da5-0007-4eb1-80ab-142bb8ecaecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:26.837372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f20da5-0007-4eb1-80ab-142bb8ecaecd None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:02:26.890304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:26.927895 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4237967-591f-4f73-a165-0df48b0b1a93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:02:26.928494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4237967-591f-4f73-a165-0df48b0b1a93 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:26.928771 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4237967-591f-4f73-a165-0df48b0b1a93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:26.929041 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4237967-591f-4f73-a165-0df48b0b1a93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:26.930664 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-c4237967-591f-4f73-a165-0df48b0b1a93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:27.043658 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4237967-591f-4f73-a165-0df48b0b1a93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:02:27.045084 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4237967-591f-4f73-a165-0df48b0b1a93 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:02:27.063941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 675/1343] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:02:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:02:30.087991 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85139d-af5c-4911-916a-7a4b16c0abed None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:30.088553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85139d-af5c-4911-916a-7a4b16c0abed None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:30.088553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85139d-af5c-4911-916a-7a4b16c0abed None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:30.089763 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 669/1344] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 17:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:02:30.094968 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613c2d6-4946-4a3a-be14-085f711dd8b5 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:30.095425 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613c2d6-4946-4a3a-be14-085f711dd8b5 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:30.095676 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613c2d6-4946-4a3a-be14-085f711dd8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:30.164613 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-e613c2d6-4946-4a3a-be14-085f711dd8b5 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:02:30.165858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-e613c2d6-4946-4a3a-be14-085f711dd8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:30.183560 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:30.263729 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 676/1345] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 17:02:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:02:30.550158 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85139d-af5c-4911-916a-7a4b16c0abed None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:02:30.551868 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-db85139d-af5c-4911-916a-7a4b16c0abed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:30.666884 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db85139d-af5c-4911-916a-7a4b16c0abed None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:02:30.747434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0716e51-1b8f-497b-a16b-ff67cad5d727 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:02:30.748027 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0716e51-1b8f-497b-a16b-ff67cad5d727 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:30.748301 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0716e51-1b8f-497b-a16b-ff67cad5d727 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:30.748565 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0716e51-1b8f-497b-a16b-ff67cad5d727 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:30.750155 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-f0716e51-1b8f-497b-a16b-ff67cad5d727 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:30.796305 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:30.872924 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0716e51-1b8f-497b-a16b-ff67cad5d727 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:02:30.874548 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0716e51-1b8f-497b-a16b-ff67cad5d727 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:02:30.894305 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 670/1346] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:02:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:02:35.382540 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373630fd-5a25-402f-992c-30e58573cb82 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:35.383068 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373630fd-5a25-402f-992c-30e58573cb82 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:35.383068 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373630fd-5a25-402f-992c-30e58573cb82 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:35.384480 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 677/1347] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 17:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:02:35.390221 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e088a0a-abaa-4f80-a5c8-3d20ea6fcc31 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:35.390704 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e088a0a-abaa-4f80-a5c8-3d20ea6fcc31 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:35.390806 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e088a0a-abaa-4f80-a5c8-3d20ea6fcc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:35.471780 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-3e088a0a-abaa-4f80-a5c8-3d20ea6fcc31 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:02:35.473348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-3e088a0a-abaa-4f80-a5c8-3d20ea6fcc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:35.596329 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:35.599599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 671/1348] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 17:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:02:35.883412 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373630fd-5a25-402f-992c-30e58573cb82 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:02:35.884995 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-373630fd-5a25-402f-992c-30e58573cb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:35.995962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373630fd-5a25-402f-992c-30e58573cb82 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:02:36.042759 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:36.068993 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309e4ae-584d-4cfd-a613-e6d98e50bff9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:02:36.069591 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309e4ae-584d-4cfd-a613-e6d98e50bff9 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:36.069869 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309e4ae-584d-4cfd-a613-e6d98e50bff9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:36.070136 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309e4ae-584d-4cfd-a613-e6d98e50bff9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:36.071738 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-9309e4ae-584d-4cfd-a613-e6d98e50bff9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:36.181835 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309e4ae-584d-4cfd-a613-e6d98e50bff9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:02:36.183221 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309e4ae-584d-4cfd-a613-e6d98e50bff9 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:02:36.201477 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 678/1349] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:02:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:02:41.154943 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b8707-a769-4352-922f-779c0c420a8d None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:41.155442 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b8707-a769-4352-922f-779c0c420a8d None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:41.155540 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02b8707-a769-4352-922f-779c0c420a8d None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:41.157204 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 672/1350] 10.222.0.55 () {54 vars in 921 bytes} [Wed Aug 24 17:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:02:41.163800 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb621a8-bad1-4aaf-b0c2-fabe2dd9470f None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:41.164295 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb621a8-bad1-4aaf-b0c2-fabe2dd9470f None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:41.164854 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb621a8-bad1-4aaf-b0c2-fabe2dd9470f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:41.273756 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-bfb621a8-bad1-4aaf-b0c2-fabe2dd9470f None None] MFA Rules not processed for user `32ef97356edf406aad9ab5f502bdb0af`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:02:41.275567 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-bfb621a8-bad1-4aaf-b0c2-fabe2dd9470f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:41.320370 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:41.487911 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 679/1351] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Aug 24 17:02:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:02:45.931158 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ea5aa-903c-4224-b5f3-2c8b99fe421b None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:45.932070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ea5aa-903c-4224-b5f3-2c8b99fe421b None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:45.932355 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ea5aa-903c-4224-b5f3-2c8b99fe421b None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:45.933991 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 673/1352] 10.222.0.55 () {54 vars in 921 bytes} [Wed Aug 24 17:02:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:02:45.938634 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05b284-917f-4782-b8d3-b872f93da5fd None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:45.939086 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05b284-917f-4782-b8d3-b872f93da5fd None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:45.939557 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed05b284-917f-4782-b8d3-b872f93da5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:46.020370 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-ed05b284-917f-4782-b8d3-b872f93da5fd None None] MFA Rules not processed for user `32ef97356edf406aad9ab5f502bdb0af`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:02:46.021748 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-ed05b284-917f-4782-b8d3-b872f93da5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:46.098418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:46.133347 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 680/1353] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Aug 24 17:02:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:02:47.614497 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165c8ae-c497-4dad-865c-eb04b82d4f55 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:47.615029 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165c8ae-c497-4dad-865c-eb04b82d4f55 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:47.615029 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165c8ae-c497-4dad-865c-eb04b82d4f55 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:47.616453 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 674/1354] 10.222.0.55 () {54 vars in 921 bytes} [Wed Aug 24 17:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:02:47.621819 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f86a6-070e-4ee4-903d-df041f382b95 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:47.622239 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f86a6-070e-4ee4-903d-df041f382b95 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:47.622375 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487f86a6-070e-4ee4-903d-df041f382b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:47.701103 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-487f86a6-070e-4ee4-903d-df041f382b95 None None] MFA Rules not processed for user `32ef97356edf406aad9ab5f502bdb0af`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:02:47.702420 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-487f86a6-070e-4ee4-903d-df041f382b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:47.817300 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 681/1355] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Aug 24 17:02:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:02:51.112404 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bf53f-211f-4137-8759-5c303f78344c None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:51.112958 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bf53f-211f-4137-8759-5c303f78344c None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:51.112958 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bf53f-211f-4137-8759-5c303f78344c None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:51.114281 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 675/1356] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 17:02:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:02:51.119984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dcf30d-464f-466e-91e5-0912bfcf8505 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:51.120433 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dcf30d-464f-466e-91e5-0912bfcf8505 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:51.120664 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dcf30d-464f-466e-91e5-0912bfcf8505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:51.161992 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:51.204227 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-a2dcf30d-464f-466e-91e5-0912bfcf8505 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:02:51.205415 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-a2dcf30d-464f-466e-91e5-0912bfcf8505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:51.340894 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 682/1357] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 17:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:02:51.658596 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e950f-cd12-4fce-90b3-53e9545ddb34 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:51.658896 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e950f-cd12-4fce-90b3-53e9545ddb34 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:51.659212 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e950f-cd12-4fce-90b3-53e9545ddb34 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:51.662418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 676/1358] 10.222.0.55 () {54 vars in 962 bytes} [Wed Aug 24 17:02:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:02:51.672596 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465381a-87f8-4fa9-aea9-8ca2ede27e0e None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:51.673210 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465381a-87f8-4fa9-aea9-8ca2ede27e0e None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:51.673840 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465381a-87f8-4fa9-aea9-8ca2ede27e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:51.779446 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-7465381a-87f8-4fa9-aea9-8ca2ede27e0e None None] MFA Rules not processed for user `28a1c617fc264b118e61f2a97ecb3f39`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:02:51.780753 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-7465381a-87f8-4fa9-aea9-8ca2ede27e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:51.844399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:51.923592 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 683/1359] 10.222.0.55 () {58 vars in 1059 bytes} [Wed Aug 24 17:02:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:02:51.932062 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e950f-cd12-4fce-90b3-53e9545ddb34 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:02:51.933746 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-774e950f-cd12-4fce-90b3-53e9545ddb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:52.103590 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e950f-cd12-4fce-90b3-53e9545ddb34 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:02:52.184383 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:52.226287 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c67c98a-b53b-498f-80be-5a52928d5dfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:02:52.226961 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67c98a-b53b-498f-80be-5a52928d5dfe service nova] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:52.227246 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67c98a-b53b-498f-80be-5a52928d5dfe service nova] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:52.227520 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c67c98a-b53b-498f-80be-5a52928d5dfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:52.229286 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-6c67c98a-b53b-498f-80be-5a52928d5dfe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:52.324890 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67c98a-b53b-498f-80be-5a52928d5dfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:02:52.326477 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c67c98a-b53b-498f-80be-5a52928d5dfe service nova] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:02:52.346228 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 677/1360] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:02:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:02:54.503020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef03342-9ed0-4ef8-a57e-022ddd60f35f None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:54.504247 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef03342-9ed0-4ef8-a57e-022ddd60f35f None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:54.504247 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef03342-9ed0-4ef8-a57e-022ddd60f35f None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:54.507160 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 684/1361] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 17:02:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:02:54.511014 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c91b86-fa30-49ec-9d3b-9a0772000424 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:54.511476 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c91b86-fa30-49ec-9d3b-9a0772000424 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:54.511674 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c91b86-fa30-49ec-9d3b-9a0772000424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:54.589251 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-72c91b86-fa30-49ec-9d3b-9a0772000424 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:02:54.590637 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-72c91b86-fa30-49ec-9d3b-9a0772000424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:54.634295 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:54.704290 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 678/1362] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 17:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:02:55.002259 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef03342-9ed0-4ef8-a57e-022ddd60f35f None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:02:55.004691 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-5ef03342-9ed0-4ef8-a57e-022ddd60f35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:55.180471 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef03342-9ed0-4ef8-a57e-022ddd60f35f None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:02:55.191606 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:55.312534 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfaa410-039d-4bfe-b435-fabc8009b86c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:02:55.313226 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfaa410-039d-4bfe-b435-fabc8009b86c service nova] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:55.314160 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfaa410-039d-4bfe-b435-fabc8009b86c service nova] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:55.314160 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfaa410-039d-4bfe-b435-fabc8009b86c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:55.315474 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-1cfaa410-039d-4bfe-b435-fabc8009b86c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:55.418858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfaa410-039d-4bfe-b435-fabc8009b86c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:02:55.420531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfaa410-039d-4bfe-b435-fabc8009b86c service nova] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:02:55.440263 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 685/1363] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:02:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:02:57.826185 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e45053-a413-45b6-9620-7cbff77cdac6 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:57.826723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e45053-a413-45b6-9620-7cbff77cdac6 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:57.826723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e45053-a413-45b6-9620-7cbff77cdac6 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:57.828250 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 679/1364] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 17:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:02:57.834086 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a27f45-1541-42ba-92c3-2f3d5804ea04 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:57.834550 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a27f45-1541-42ba-92c3-2f3d5804ea04 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:57.834642 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a27f45-1541-42ba-92c3-2f3d5804ea04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:57.851579 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:57.909165 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-a8a27f45-1541-42ba-92c3-2f3d5804ea04 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:02:57.911407 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-a8a27f45-1541-42ba-92c3-2f3d5804ea04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:58.027027 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 686/1365] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 17:02:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:02:58.319721 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9968a3-26ec-4adc-8d68-b4cf84e41792 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:58.320019 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9968a3-26ec-4adc-8d68-b4cf84e41792 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:58.320315 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9968a3-26ec-4adc-8d68-b4cf84e41792 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:58.328190 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 680/1366] 10.222.0.55 () {54 vars in 962 bytes} [Wed Aug 24 17:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:02:58.328342 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc159f80-491c-459f-bc95-c6e5b865d19f None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:58.328342 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc159f80-491c-459f-bc95-c6e5b865d19f None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:58.328342 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc159f80-491c-459f-bc95-c6e5b865d19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:58.413851 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-cc159f80-491c-459f-bc95-c6e5b865d19f None None] MFA Rules not processed for user `28a1c617fc264b118e61f2a97ecb3f39`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:02:58.415565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-cc159f80-491c-459f-bc95-c6e5b865d19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:58.453840 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:58.545949 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 687/1367] 10.222.0.55 () {58 vars in 1059 bytes} [Wed Aug 24 17:02:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:02:58.554643 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9968a3-26ec-4adc-8d68-b4cf84e41792 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:02:58.556196 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-1c9968a3-26ec-4adc-8d68-b4cf84e41792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:58.726528 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9968a3-26ec-4adc-8d68-b4cf84e41792 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:02:58.748843 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:58.857857 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1feee06-d1e4-413f-bd3a-13155c22dc76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:02:58.858507 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1feee06-d1e4-413f-bd3a-13155c22dc76 service nova] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:58.858921 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1feee06-d1e4-413f-bd3a-13155c22dc76 service nova] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:58.859229 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1feee06-d1e4-413f-bd3a-13155c22dc76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:58.860902 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-c1feee06-d1e4-413f-bd3a-13155c22dc76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:58.959608 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1feee06-d1e4-413f-bd3a-13155c22dc76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:02:58.961369 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1feee06-d1e4-413f-bd3a-13155c22dc76 service nova] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:02:58.981665 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 681/1368] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:02:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:02:59.465114 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412d800-6876-4a9a-9814-15accd6f98d0 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:59.465706 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412d800-6876-4a9a-9814-15accd6f98d0 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:59.465861 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412d800-6876-4a9a-9814-15accd6f98d0 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:59.467430 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 688/1369] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 17:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:02:59.473094 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db80d27-0ae9-40a4-be08-39575e45c5b2 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:02:59.473384 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db80d27-0ae9-40a4-be08-39575e45c5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:02:59.473674 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db80d27-0ae9-40a4-be08-39575e45c5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:02:59.508585 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:02:59.545734 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-9db80d27-0ae9-40a4-be08-39575e45c5b2 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:02:59.547164 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-9db80d27-0ae9-40a4-be08-39575e45c5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:02:59.654249 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 682/1370] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 17:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:03:00.248108 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7b075-cbfb-4588-9e63-3e00d4fbc221 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:00.248396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7b075-cbfb-4588-9e63-3e00d4fbc221 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:00.248671 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7b075-cbfb-4588-9e63-3e00d4fbc221 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:00.250170 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 689/1371] 10.222.0.55 () {54 vars in 964 bytes} [Wed Aug 24 17:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:03:00.255316 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1a252-0e87-4550-af09-35c6bec93af1 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:00.255826 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1a252-0e87-4550-af09-35c6bec93af1 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:00.255932 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1a252-0e87-4550-af09-35c6bec93af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:00.340917 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-52c1a252-0e87-4550-af09-35c6bec93af1 None None] MFA Rules not processed for user `eb911b8748844a6488811ca03cb8d344`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:03:00.342172 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-52c1a252-0e87-4550-af09-35c6bec93af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:00.392880 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:00.425178 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 683/1372] 10.222.0.55 () {58 vars in 1061 bytes} [Wed Aug 24 17:03:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:03:00.432684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7b075-cbfb-4588-9e63-3e00d4fbc221 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:03:00.434197 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-61d7b075-cbfb-4588-9e63-3e00d4fbc221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:00.542085 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7b075-cbfb-4588-9e63-3e00d4fbc221 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:03:00.584152 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:00.624713 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5b9f3-372e-40e4-9df5-7a8e9ab347b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:03:00.625622 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5b9f3-372e-40e4-9df5-7a8e9ab347b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:00.625761 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5b9f3-372e-40e4-9df5-7a8e9ab347b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:00.626073 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5b9f3-372e-40e4-9df5-7a8e9ab347b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:00.627930 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-13a5b9f3-372e-40e4-9df5-7a8e9ab347b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:00.748726 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5b9f3-372e-40e4-9df5-7a8e9ab347b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:03:00.750263 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5b9f3-372e-40e4-9df5-7a8e9ab347b5 service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:03:00.771748 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 690/1373] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:03:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:03:01.205590 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a735ae-30c7-4cc2-9e69-ed3f8f696a7d None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:01.205820 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a735ae-30c7-4cc2-9e69-ed3f8f696a7d None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:01.206042 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a735ae-30c7-4cc2-9e69-ed3f8f696a7d None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:01.207535 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 684/1374] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 17:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:03:01.212918 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42855b-3869-4c85-a490-14b28e790952 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:01.213209 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42855b-3869-4c85-a490-14b28e790952 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:01.213545 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42855b-3869-4c85-a490-14b28e790952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:01.292162 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-7f42855b-3869-4c85-a490-14b28e790952 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:03:01.293394 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-7f42855b-3869-4c85-a490-14b28e790952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:01.314353 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:01.392465 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 691/1375] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 17:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:03:01.690364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a735ae-30c7-4cc2-9e69-ed3f8f696a7d None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:03:01.692550 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-19a735ae-30c7-4cc2-9e69-ed3f8f696a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:01.846300 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a735ae-30c7-4cc2-9e69-ed3f8f696a7d None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:03:01.901964 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:01.963729 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b6400-0647-4bc5-b5ff-f84197f00024 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:03:01.964437 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b6400-0647-4bc5-b5ff-f84197f00024 service nova] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:01.965187 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b6400-0647-4bc5-b5ff-f84197f00024 service nova] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:01.965481 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b6400-0647-4bc5-b5ff-f84197f00024 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:01.967146 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-d47b6400-0647-4bc5-b5ff-f84197f00024 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:02.056175 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b6400-0647-4bc5-b5ff-f84197f00024 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:03:02.057809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b6400-0647-4bc5-b5ff-f84197f00024 service nova] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:03:02.076458 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 685/1376] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:03:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:03:04.284843 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71410084-b4aa-48ca-abc6-6280521fe459 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:04.285349 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71410084-b4aa-48ca-abc6-6280521fe459 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:04.287635 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71410084-b4aa-48ca-abc6-6280521fe459 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:04.287635 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 692/1377] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 17:03:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:03:04.292997 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d0fb7-874a-442e-8421-941bc4c98901 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:04.293419 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d0fb7-874a-442e-8421-941bc4c98901 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:04.293570 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d0fb7-874a-442e-8421-941bc4c98901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:04.371746 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-7f7d0fb7-874a-442e-8421-941bc4c98901 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:03:04.372991 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-7f7d0fb7-874a-442e-8421-941bc4c98901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:04.381021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:04.491514 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 686/1378] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 17:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:03:04.799181 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71410084-b4aa-48ca-abc6-6280521fe459 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:03:04.801568 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-71410084-b4aa-48ca-abc6-6280521fe459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:04.966294 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71410084-b4aa-48ca-abc6-6280521fe459 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:03:04.970534 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:05.087771 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a62622-5e33-41c5-a140-0d0259e18c93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:03:05.088299 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a62622-5e33-41c5-a140-0d0259e18c93 service nova] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:05.088588 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a62622-5e33-41c5-a140-0d0259e18c93 service nova] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:05.088864 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a62622-5e33-41c5-a140-0d0259e18c93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:05.090447 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-91a62622-5e33-41c5-a140-0d0259e18c93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:05.195530 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a62622-5e33-41c5-a140-0d0259e18c93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:03:05.197202 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a62622-5e33-41c5-a140-0d0259e18c93 service nova] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:03:05.218825 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 693/1379] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:03:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:03:07.399601 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b4702-e07c-49d3-8832-bee4b0d12f9b None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:07.400224 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b4702-e07c-49d3-8832-bee4b0d12f9b None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:07.400224 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b4702-e07c-49d3-8832-bee4b0d12f9b None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:07.401723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 687/1380] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 17:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:03:07.406943 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146f5e5-ae6e-40ed-a49d-f1a2384a9a25 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:07.407383 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146f5e5-ae6e-40ed-a49d-f1a2384a9a25 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:07.407560 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146f5e5-ae6e-40ed-a49d-f1a2384a9a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:07.420425 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:07.491253 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-0146f5e5-ae6e-40ed-a49d-f1a2384a9a25 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:03:07.492659 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-0146f5e5-ae6e-40ed-a49d-f1a2384a9a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:07.610888 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 694/1381] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 17:03:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:03:07.916672 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b4702-e07c-49d3-8832-bee4b0d12f9b None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:03:07.918216 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-794b4702-e07c-49d3-8832-bee4b0d12f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:08.070105 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:08.081520 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b4702-e07c-49d3-8832-bee4b0d12f9b None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:03:08.204923 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bb84c-e429-4f31-94e2-f15e75f5c00e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:03:08.205446 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bb84c-e429-4f31-94e2-f15e75f5c00e service nova] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:08.205753 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bb84c-e429-4f31-94e2-f15e75f5c00e service nova] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:08.206660 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bb84c-e429-4f31-94e2-f15e75f5c00e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:08.208745 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-7e4bb84c-e429-4f31-94e2-f15e75f5c00e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:08.312395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4bb84c-e429-4f31-94e2-f15e75f5c00e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:03:08.313998 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4bb84c-e429-4f31-94e2-f15e75f5c00e service nova] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:03:08.325856 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:08.335574 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 688/1382] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:03:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:03:10.514240 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaae40a-0914-4acc-a0cf-a74f9978d03d None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:10.514806 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaae40a-0914-4acc-a0cf-a74f9978d03d None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:10.515024 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaae40a-0914-4acc-a0cf-a74f9978d03d None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:10.516830 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 695/1383] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 17:03:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:03:10.522595 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588a232-e44b-44c8-aa2c-d522ff3528ba None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:10.523064 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588a232-e44b-44c8-aa2c-d522ff3528ba None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:10.523210 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588a232-e44b-44c8-aa2c-d522ff3528ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:10.593515 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-1588a232-e44b-44c8-aa2c-d522ff3528ba None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:03:10.594770 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-1588a232-e44b-44c8-aa2c-d522ff3528ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:10.718116 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 689/1384] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 17:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:03:11.089889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaae40a-0914-4acc-a0cf-a74f9978d03d None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:03:11.091520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-cbaae40a-0914-4acc-a0cf-a74f9978d03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:11.181170 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:11.251507 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaae40a-0914-4acc-a0cf-a74f9978d03d None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:03:11.377015 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231814f-e6a3-4330-a511-05b7de756547 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:03:11.378834 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231814f-e6a3-4330-a511-05b7de756547 service nova] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:11.379236 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231814f-e6a3-4330-a511-05b7de756547 service nova] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:11.379490 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231814f-e6a3-4330-a511-05b7de756547 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:11.381188 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-d231814f-e6a3-4330-a511-05b7de756547 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:11.438225 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:11.481556 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d231814f-e6a3-4330-a511-05b7de756547 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:03:11.483980 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d231814f-e6a3-4330-a511-05b7de756547 service nova] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:03:11.509126 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 696/1385] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:03:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:03:13.473568 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a24168-c8ca-4c11-ae74-4e4a3c1117ea None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:13.474279 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a24168-c8ca-4c11-ae74-4e4a3c1117ea None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:13.474279 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a24168-c8ca-4c11-ae74-4e4a3c1117ea None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:13.475662 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 690/1386] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 17:03:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:03:13.481628 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73da9f-8113-4868-8cb8-9e5d6c64b49a None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:13.482506 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73da9f-8113-4868-8cb8-9e5d6c64b49a None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:13.482506 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73da9f-8113-4868-8cb8-9e5d6c64b49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:13.557718 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-bb73da9f-8113-4868-8cb8-9e5d6c64b49a None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:03:13.558969 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-bb73da9f-8113-4868-8cb8-9e5d6c64b49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:13.672936 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 697/1387] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 17:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:03:13.974659 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a24168-c8ca-4c11-ae74-4e4a3c1117ea None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:03:13.976210 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-54a24168-c8ca-4c11-ae74-4e4a3c1117ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:14.056257 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:14.217802 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a24168-c8ca-4c11-ae74-4e4a3c1117ea None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:03:14.247400 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062ab46-5065-45f2-8cd0-7757e640d6f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:03:14.248168 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062ab46-5065-45f2-8cd0-7757e640d6f2 service nova] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:14.248519 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062ab46-5065-45f2-8cd0-7757e640d6f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:14.248868 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062ab46-5065-45f2-8cd0-7757e640d6f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:14.251007 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-4062ab46-5065-45f2-8cd0-7757e640d6f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:14.302233 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:14.365632 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062ab46-5065-45f2-8cd0-7757e640d6f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:03:14.367350 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062ab46-5065-45f2-8cd0-7757e640d6f2 service nova] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:03:14.386401 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 691/1388] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:03:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:03:16.586729 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529593dc-33fb-459d-886c-e2a147d2bb3d None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:16.587343 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529593dc-33fb-459d-886c-e2a147d2bb3d None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:16.587343 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529593dc-33fb-459d-886c-e2a147d2bb3d None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:16.588715 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 698/1389] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 17:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:03:16.594172 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2065799-646a-49e4-9d0e-52a7554cc200 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:16.594622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2065799-646a-49e4-9d0e-52a7554cc200 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:16.594801 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2065799-646a-49e4-9d0e-52a7554cc200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:16.664049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-b2065799-646a-49e4-9d0e-52a7554cc200 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:03:16.665300 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-b2065799-646a-49e4-9d0e-52a7554cc200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:16.765260 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 692/1390] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 17:03:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:03:16.797500 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ae857-bcb2-4b5b-b2a5-bd43b47bbdfe None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:16.797784 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ae857-bcb2-4b5b-b2a5-bd43b47bbdfe None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:16.798063 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ae857-bcb2-4b5b-b2a5-bd43b47bbdfe None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:16.799531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 699/1391] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 17:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:03:16.805166 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04a164-159c-40bd-b73a-49319d2f60fc None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:16.805452 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04a164-159c-40bd-b73a-49319d2f60fc None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:16.805877 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04a164-159c-40bd-b73a-49319d2f60fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:16.822036 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:16.876168 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-4b04a164-159c-40bd-b73a-49319d2f60fc None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:03:16.877720 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-4b04a164-159c-40bd-b73a-49319d2f60fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:16.980191 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 693/1392] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 17:03:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:03:17.060533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ae857-bcb2-4b5b-b2a5-bd43b47bbdfe None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:03:17.062036 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-614ae857-bcb2-4b5b-b2a5-bd43b47bbdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:17.094249 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:17.212845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ae857-bcb2-4b5b-b2a5-bd43b47bbdfe None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:03:17.287581 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19424edf-8412-40c0-965d-0792b0130a7c None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:17.287734 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19424edf-8412-40c0-965d-0792b0130a7c None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:17.288185 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19424edf-8412-40c0-965d-0792b0130a7c None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:17.289726 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 694/1393] 10.222.0.55 () {54 vars in 967 bytes} [Wed Aug 24 17:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:03:17.294389 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7559382-69b2-405c-9be8-8ea67607601c None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:17.294670 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7559382-69b2-405c-9be8-8ea67607601c None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:17.294938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7559382-69b2-405c-9be8-8ea67607601c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:17.321680 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:17.334948 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6357b854-19b2-41a0-9ae3-7faeadf1a6a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:03:17.335579 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357b854-19b2-41a0-9ae3-7faeadf1a6a0 service nova] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:17.335853 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357b854-19b2-41a0-9ae3-7faeadf1a6a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:17.336116 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6357b854-19b2-41a0-9ae3-7faeadf1a6a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:17.337856 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-6357b854-19b2-41a0-9ae3-7faeadf1a6a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:17.372146 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-d7559382-69b2-405c-9be8-8ea67607601c None None] MFA Rules not processed for user `3a6aad0e9f5f4a0b9578a31082e726cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:03:17.373905 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-d7559382-69b2-405c-9be8-8ea67607601c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:17.410438 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:17.435635 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6357b854-19b2-41a0-9ae3-7faeadf1a6a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:03:17.437248 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6357b854-19b2-41a0-9ae3-7faeadf1a6a0 service nova] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:03:17.452008 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 695/1394] 10.222.0.55 () {58 vars in 1064 bytes} [Wed Aug 24 17:03:17 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:03:17.457086 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 700/1395] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:03:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:03:17.459995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7559382-69b2-405c-9be8-8ea67607601c None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:03:17.467854 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7559382-69b2-405c-9be8-8ea67607601c None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:03:17.541342 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654f3f1-efd4-46c4-be89-21a27498ffbc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6aad0e9f5f4a0b9578a31082e726cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:03:17.541969 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654f3f1-efd4-46c4-be89-21a27498ffbc service glance] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:17.542249 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654f3f1-efd4-46c4-be89-21a27498ffbc service glance] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:17.542516 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654f3f1-efd4-46c4-be89-21a27498ffbc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:17.544136 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-d654f3f1-efd4-46c4-be89-21a27498ffbc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:17.655087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:17.659335 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654f3f1-efd4-46c4-be89-21a27498ffbc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:03:17.661139 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654f3f1-efd4-46c4-be89-21a27498ffbc service glance] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:03:17.679684 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 696/1396] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:03:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:03:18.564091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee3af6-40d4-4d56-b0b6-da5b47fc03b4 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:18.564587 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee3af6-40d4-4d56-b0b6-da5b47fc03b4 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:18.564693 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee3af6-40d4-4d56-b0b6-da5b47fc03b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:18.632860 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-4cee3af6-40d4-4d56-b0b6-da5b47fc03b4 None None] MFA Rules not processed for user `ae9fc5f06a0441da80e656fa1e88db5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:03:18.634057 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-4cee3af6-40d4-4d56-b0b6-da5b47fc03b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:18.695696 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:18.723550 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 701/1397] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Aug 24 17:03:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:03:18.770319 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8538c2c-63e8-473e-9f8d-6a0c9aa9911c None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:18.770859 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8538c2c-63e8-473e-9f8d-6a0c9aa9911c None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:18.770963 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8538c2c-63e8-473e-9f8d-6a0c9aa9911c None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:18.772442 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 697/1398] 10.222.0.55 () {54 vars in 943 bytes} [Wed Aug 24 17:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:03:18.778902 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82278e5a-0fbc-46ee-a86e-e8c9f1fb751e None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:18.779288 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82278e5a-0fbc-46ee-a86e-e8c9f1fb751e None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:18.779641 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82278e5a-0fbc-46ee-a86e-e8c9f1fb751e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:18.863611 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-82278e5a-0fbc-46ee-a86e-e8c9f1fb751e None None] MFA Rules not processed for user `c067bc2d84b741d08ac47e40adae4b4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:03:18.864907 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-82278e5a-0fbc-46ee-a86e-e8c9f1fb751e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:18.979346 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 702/1399] 10.222.0.55 () {58 vars in 1040 bytes} [Wed Aug 24 17:03:18 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:03:18.988459 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8538c2c-63e8-473e-9f8d-6a0c9aa9911c None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:03:18.990048 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-e8538c2c-63e8-473e-9f8d-6a0c9aa9911c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:19.135064 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8538c2c-63e8-473e-9f8d-6a0c9aa9911c None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:03:19.207428 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:19.241494 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3ee684-9cb0-4c19-a402-fb416c0542aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c067bc2d84b741d08ac47e40adae4b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:03:19.242282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ee684-9cb0-4c19-a402-fb416c0542aa service swift] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:19.242561 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ee684-9cb0-4c19-a402-fb416c0542aa service swift] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:19.242833 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3ee684-9cb0-4c19-a402-fb416c0542aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:19.244495 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-3c3ee684-9cb0-4c19-a402-fb416c0542aa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:19.331415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ee684-9cb0-4c19-a402-fb416c0542aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:03:19.333032 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3ee684-9cb0-4c19-a402-fb416c0542aa service swift] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:03:19.341347 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 698/1400] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Aug 24 17:03:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:03:19.680025 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2d47e-26f5-49af-aab9-d0b3a835a705 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:19.680596 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2d47e-26f5-49af-aab9-d0b3a835a705 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:19.680596 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2d47e-26f5-49af-aab9-d0b3a835a705 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:19.681941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 703/1401] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 17:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:03:19.687171 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef510e01-5a3f-44a4-b7e7-51f020d25ef5 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:19.687459 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef510e01-5a3f-44a4-b7e7-51f020d25ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:19.687727 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef510e01-5a3f-44a4-b7e7-51f020d25ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:19.755064 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-ef510e01-5a3f-44a4-b7e7-51f020d25ef5 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:03:19.756307 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-ef510e01-5a3f-44a4-b7e7-51f020d25ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:19.815055 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:19.855523 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 699/1402] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 17:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:03:20.164209 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2d47e-26f5-49af-aab9-d0b3a835a705 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:03:20.164209 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-6ec2d47e-26f5-49af-aab9-d0b3a835a705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:20.207306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:20.344308 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2d47e-26f5-49af-aab9-d0b3a835a705 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:03:20.482601 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:20.485242 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c7f21-0d4a-4732-b508-41021e83b245 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:03:20.485825 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c7f21-0d4a-4732-b508-41021e83b245 service nova] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:20.486098 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c7f21-0d4a-4732-b508-41021e83b245 service nova] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:20.486900 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c7f21-0d4a-4732-b508-41021e83b245 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:20.488750 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-c64c7f21-0d4a-4732-b508-41021e83b245 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:20.596024 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c7f21-0d4a-4732-b508-41021e83b245 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:03:20.599581 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c7f21-0d4a-4732-b508-41021e83b245 service nova] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:03:20.619321 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 704/1403] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:03:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:03:22.870450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d987eed-53c5-47e7-abdd-f6e4a8a087cb None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:22.871089 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d987eed-53c5-47e7-abdd-f6e4a8a087cb None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:22.871089 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d987eed-53c5-47e7-abdd-f6e4a8a087cb None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:22.872861 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 700/1404] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 17:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:03:22.883727 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e1740-bf5e-4acd-ba6a-5da39e855249 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:22.883727 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e1740-bf5e-4acd-ba6a-5da39e855249 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:22.883727 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e1740-bf5e-4acd-ba6a-5da39e855249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:22.953823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-de5e1740-bf5e-4acd-ba6a-5da39e855249 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:03:22.953823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-de5e1740-bf5e-4acd-ba6a-5da39e855249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:23.029227 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:23.064055 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 705/1405] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 17:03:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:03:23.368277 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d987eed-53c5-47e7-abdd-f6e4a8a087cb None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:03:23.369953 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-3d987eed-53c5-47e7-abdd-f6e4a8a087cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:23.545372 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d987eed-53c5-47e7-abdd-f6e4a8a087cb None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:03:23.594656 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:23.693352 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20945f-e8dd-4e61-825a-fa6d5af3a442 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:03:23.694002 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20945f-e8dd-4e61-825a-fa6d5af3a442 service nova] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:23.694287 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20945f-e8dd-4e61-825a-fa6d5af3a442 service nova] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:23.694576 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20945f-e8dd-4e61-825a-fa6d5af3a442 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:23.696282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-3a20945f-e8dd-4e61-825a-fa6d5af3a442 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:23.797078 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20945f-e8dd-4e61-825a-fa6d5af3a442 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:03:23.798640 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20945f-e8dd-4e61-825a-fa6d5af3a442 service nova] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:03:23.818261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 701/1406] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:03:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:03:25.950912 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da77777-8d07-4a5a-8c66-80d8ce40b462 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:25.951501 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da77777-8d07-4a5a-8c66-80d8ce40b462 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:25.951501 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da77777-8d07-4a5a-8c66-80d8ce40b462 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:25.955434 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 706/1407] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 17:03:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:03:25.958824 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d44e98-d996-4d5c-8b7f-d6438bc7b727 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:25.959321 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d44e98-d996-4d5c-8b7f-d6438bc7b727 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:25.959587 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d44e98-d996-4d5c-8b7f-d6438bc7b727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:26.031953 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:26.042158 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-38d44e98-d996-4d5c-8b7f-d6438bc7b727 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:03:26.043445 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-38d44e98-d996-4d5c-8b7f-d6438bc7b727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:26.161267 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 702/1408] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 17:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:03:26.460084 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da77777-8d07-4a5a-8c66-80d8ce40b462 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:03:26.462273 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-2da77777-8d07-4a5a-8c66-80d8ce40b462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:26.637284 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da77777-8d07-4a5a-8c66-80d8ce40b462 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:03:26.713176 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:26.785616 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca721e8-445b-4525-8218-0b692cb85c7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:03:26.822138 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca721e8-445b-4525-8218-0b692cb85c7f service nova] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:26.822138 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca721e8-445b-4525-8218-0b692cb85c7f service nova] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:26.822138 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca721e8-445b-4525-8218-0b692cb85c7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:26.822138 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-3ca721e8-445b-4525-8218-0b692cb85c7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:26.903935 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca721e8-445b-4525-8218-0b692cb85c7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:03:26.905992 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca721e8-445b-4525-8218-0b692cb85c7f service nova] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:03:26.926703 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 707/1409] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:03:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:03:36.159563 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=44 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:37.295447 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=73 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:43.616490 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d680024-5495-460e-a989-eecf67d3aaea None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:43.617023 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d680024-5495-460e-a989-eecf67d3aaea None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:43.617023 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d680024-5495-460e-a989-eecf67d3aaea None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:43.618242 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 703/1410] 10.222.0.55 () {54 vars in 918 bytes} [Wed Aug 24 17:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:03:43.623348 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08ee4c-450a-42e0-abad-fcf5936d7e66 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:43.623844 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08ee4c-450a-42e0-abad-fcf5936d7e66 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:43.623949 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08ee4c-450a-42e0-abad-fcf5936d7e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:43.700386 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-ef08ee4c-450a-42e0-abad-fcf5936d7e66 None None] MFA Rules not processed for user `32ef97356edf406aad9ab5f502bdb0af`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:03:43.701606 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-ef08ee4c-450a-42e0-abad-fcf5936d7e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:43.808515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 708/1411] 10.222.0.55 () {58 vars in 1015 bytes} [Wed Aug 24 17:03:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:03:43.823148 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86b3f0-68d6-4973-ade7-b4a1289319c5 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:43.823442 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86b3f0-68d6-4973-ade7-b4a1289319c5 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:43.823721 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86b3f0-68d6-4973-ade7-b4a1289319c5 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:43.825087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 704/1412] 10.222.0.55 () {54 vars in 918 bytes} [Wed Aug 24 17:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:03:43.830267 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707f1ca-5a10-49d6-b486-241486e36979 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:43.830553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707f1ca-5a10-49d6-b486-241486e36979 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:43.830828 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707f1ca-5a10-49d6-b486-241486e36979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:43.904215 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:43.906815 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-1707f1ca-5a10-49d6-b486-241486e36979 None None] MFA Rules not processed for user `28a1c617fc264b118e61f2a97ecb3f39`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:03:43.908936 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-1707f1ca-5a10-49d6-b486-241486e36979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:44.026485 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 709/1413] 10.222.0.55 () {58 vars in 1015 bytes} [Wed Aug 24 17:03:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:03:46.478060 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f8cb7-cbbf-4fde-9f4e-df08ebc3e74a None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:46.478706 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f8cb7-cbbf-4fde-9f4e-df08ebc3e74a None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:46.478706 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f8cb7-cbbf-4fde-9f4e-df08ebc3e74a None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:46.480015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:03:46.485524 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a55fc-10ec-4aaf-a58a-851a48235bb4 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:46.486096 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a55fc-10ec-4aaf-a58a-851a48235bb4 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:46.486096 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a55fc-10ec-4aaf-a58a-851a48235bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:46.552068 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-649a55fc-10ec-4aaf-a58a-851a48235bb4 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:03:46.554415 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-649a55fc-10ec-4aaf-a58a-851a48235bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:46.613065 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:46.657775 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:03:46.965114 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f8cb7-cbbf-4fde-9f4e-df08ebc3e74a None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:03:46.966630 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-933f8cb7-cbbf-4fde-9f4e-df08ebc3e74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:47.115259 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f8cb7-cbbf-4fde-9f4e-df08ebc3e74a None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:03:47.188853 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:47.230451 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb7ed0-b39e-4e4a-86ed-a5e47f61c3c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:03:47.231056 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb7ed0-b39e-4e4a-86ed-a5e47f61c3c1 service nova] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:47.231363 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb7ed0-b39e-4e4a-86ed-a5e47f61c3c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:47.231635 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb7ed0-b39e-4e4a-86ed-a5e47f61c3c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:47.233252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-a4cb7ed0-b39e-4e4a-86ed-a5e47f61c3c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:47.325776 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb7ed0-b39e-4e4a-86ed-a5e47f61c3c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:03:47.327447 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb7ed0-b39e-4e4a-86ed-a5e47f61c3c1 service nova] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:03:47.346477 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 706/1416] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:03:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:03:48.244579 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c0a40-1548-4945-b0c4-cc7a8e8864ef None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:48.245128 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c0a40-1548-4945-b0c4-cc7a8e8864ef None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:48.245128 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c0a40-1548-4945-b0c4-cc7a8e8864ef None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:48.246341 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:03:48.252243 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f59ba7-5004-4c56-a70d-821858a4c9f2 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:48.252761 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f59ba7-5004-4c56-a70d-821858a4c9f2 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:48.252859 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f59ba7-5004-4c56-a70d-821858a4c9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:48.340208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-86f59ba7-5004-4c56-a70d-821858a4c9f2 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:03:48.341442 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-86f59ba7-5004-4c56-a70d-821858a4c9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:48.372225 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:48.447666 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:03:48.599265 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c0a40-1548-4945-b0c4-cc7a8e8864ef None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:03:48.600771 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-6e7c0a40-1548-4945-b0c4-cc7a8e8864ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:48.747178 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c0a40-1548-4945-b0c4-cc7a8e8864ef None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:03:48.788280 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:48.863938 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a9c0a-59bc-41a9-a62f-09951f717e35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:03:48.864494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a9c0a-59bc-41a9-a62f-09951f717e35 service nova] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:48.864774 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a9c0a-59bc-41a9-a62f-09951f717e35 service nova] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:48.865053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a9c0a-59bc-41a9-a62f-09951f717e35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:48.866679 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-e80a9c0a-59bc-41a9-a62f-09951f717e35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:48.957972 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a9c0a-59bc-41a9-a62f-09951f717e35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:03:48.959587 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a9c0a-59bc-41a9-a62f-09951f717e35 service nova] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:03:48.978027 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 712/1419] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:03:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:03:49.871244 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f8952-5407-457c-903a-0bab890b1f12 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:49.871770 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f8952-5407-457c-903a-0bab890b1f12 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:49.871770 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f8952-5407-457c-903a-0bab890b1f12 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:49.873139 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:03:49.879093 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ee5b0-3170-479d-92c7-079c0b1c0141 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:49.879537 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ee5b0-3170-479d-92c7-079c0b1c0141 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:49.879692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ee5b0-3170-479d-92c7-079c0b1c0141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:49.934529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:49.956648 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-8e4ee5b0-3170-479d-92c7-079c0b1c0141 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:03:49.957847 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-8e4ee5b0-3170-479d-92c7-079c0b1c0141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:50.055000 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:03:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:03:50.207985 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f8952-5407-457c-903a-0bab890b1f12 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:03:50.209420 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-972f8952-5407-457c-903a-0bab890b1f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:50.359351 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f8952-5407-457c-903a-0bab890b1f12 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:03:50.372119 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:50.475593 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcdf25b-f56f-4687-b476-3e2d3c0bfc51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:03:50.476115 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdf25b-f56f-4687-b476-3e2d3c0bfc51 service nova] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:50.476390 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdf25b-f56f-4687-b476-3e2d3c0bfc51 service nova] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:50.476657 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcdf25b-f56f-4687-b476-3e2d3c0bfc51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:50.478250 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-fdcdf25b-f56f-4687-b476-3e2d3c0bfc51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:50.567235 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcdf25b-f56f-4687-b476-3e2d3c0bfc51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:03:50.568881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcdf25b-f56f-4687-b476-3e2d3c0bfc51 service nova] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:03:50.588420 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 709/1422] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:03:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:03:51.452709 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eec545-b75f-4f38-9b23-ceef1f7c5070 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:51.453288 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eec545-b75f-4f38-9b23-ceef1f7c5070 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:51.453288 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eec545-b75f-4f38-9b23-ceef1f7c5070 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:51.454636 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:03:51.459717 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469607a-73bf-4d10-8e54-95707586b51f None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:51.460135 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469607a-73bf-4d10-8e54-95707586b51f None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:51.460254 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469607a-73bf-4d10-8e54-95707586b51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:51.480048 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:51.537734 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-1469607a-73bf-4d10-8e54-95707586b51f None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:03:51.538930 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-1469607a-73bf-4d10-8e54-95707586b51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:51.636407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:03:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:03:51.791352 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eec545-b75f-4f38-9b23-ceef1f7c5070 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:03:51.792861 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-68eec545-b75f-4f38-9b23-ceef1f7c5070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:51.906592 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:51.944151 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eec545-b75f-4f38-9b23-ceef1f7c5070 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:03:52.057586 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d920e-45d3-4813-a76b-7a39ac5a54f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:03:52.058192 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d920e-45d3-4813-a76b-7a39ac5a54f2 service nova] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:52.058465 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d920e-45d3-4813-a76b-7a39ac5a54f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:52.058731 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d920e-45d3-4813-a76b-7a39ac5a54f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:52.060363 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-7a3d920e-45d3-4813-a76b-7a39ac5a54f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:52.137564 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:52.151424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d920e-45d3-4813-a76b-7a39ac5a54f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:03:52.153013 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d920e-45d3-4813-a76b-7a39ac5a54f2 service nova] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:03:52.171691 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 715/1425] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:03:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:03:53.047952 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb224d-0ceb-42f7-ae19-61ebac2fba37 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:53.048999 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb224d-0ceb-42f7-ae19-61ebac2fba37 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:53.048999 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb224d-0ceb-42f7-ae19-61ebac2fba37 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:53.050641 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:03:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:03:53.056566 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09433f-960a-4eaa-bb35-16aa823f8e0c None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:53.057286 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09433f-960a-4eaa-bb35-16aa823f8e0c None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:53.057286 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09433f-960a-4eaa-bb35-16aa823f8e0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:53.259228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-4d09433f-960a-4eaa-bb35-16aa823f8e0c None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:03:53.260455 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-4d09433f-960a-4eaa-bb35-16aa823f8e0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:53.362848 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:03:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:03:53.519992 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb224d-0ceb-42f7-ae19-61ebac2fba37 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:03:53.521540 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-decb224d-0ceb-42f7-ae19-61ebac2fba37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:53.607933 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:53.672668 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb224d-0ceb-42f7-ae19-61ebac2fba37 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:03:53.789895 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef65440-e338-4a99-ae20-406662bd687f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:03:53.790501 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef65440-e338-4a99-ae20-406662bd687f service nova] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:53.790777 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef65440-e338-4a99-ae20-406662bd687f service nova] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:53.791047 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef65440-e338-4a99-ae20-406662bd687f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:53.792669 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-9ef65440-e338-4a99-ae20-406662bd687f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:53.841391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:53.884278 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef65440-e338-4a99-ae20-406662bd687f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:03:53.885886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef65440-e338-4a99-ae20-406662bd687f service nova] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:03:53.903835 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 712/1428] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:03:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:03:54.814728 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251357e-700a-4778-867f-641f7eb12fe6 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:54.815335 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251357e-700a-4778-867f-641f7eb12fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:54.815335 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251357e-700a-4778-867f-641f7eb12fe6 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:54.816647 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:03:54.821802 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a5706-ef6c-44ea-aa01-17165048fecc None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:54.822187 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a5706-ef6c-44ea-aa01-17165048fecc None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:54.822425 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169a5706-ef6c-44ea-aa01-17165048fecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:54.901826 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-169a5706-ef6c-44ea-aa01-17165048fecc None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:03:54.903040 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-169a5706-ef6c-44ea-aa01-17165048fecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:54.999096 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:03:55.152337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251357e-700a-4778-867f-641f7eb12fe6 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:03:55.153755 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-5251357e-700a-4778-867f-641f7eb12fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:55.203161 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:55.300555 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251357e-700a-4778-867f-641f7eb12fe6 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:03:55.413827 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789012a3-172f-407d-971e-85a87c545b49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:03:55.414333 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789012a3-172f-407d-971e-85a87c545b49 service nova] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:55.414609 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789012a3-172f-407d-971e-85a87c545b49 service nova] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:55.414922 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789012a3-172f-407d-971e-85a87c545b49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:55.416538 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-789012a3-172f-407d-971e-85a87c545b49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:55.423551 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:55.506723 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789012a3-172f-407d-971e-85a87c545b49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:03:55.508353 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789012a3-172f-407d-971e-85a87c545b49 service nova] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:03:55.526518 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 718/1431] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:03:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:03:56.412537 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361f214-3932-4b27-ac49-50bbb6e23d55 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:56.413103 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361f214-3932-4b27-ac49-50bbb6e23d55 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:56.413103 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361f214-3932-4b27-ac49-50bbb6e23d55 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:56.414456 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:03:56.419618 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2469a9b-8839-4237-989d-9c7379db1384 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:56.420028 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2469a9b-8839-4237-989d-9c7379db1384 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:56.420180 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2469a9b-8839-4237-989d-9c7379db1384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:56.497878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-f2469a9b-8839-4237-989d-9c7379db1384 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:03:56.499092 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-f2469a9b-8839-4237-989d-9c7379db1384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:56.569594 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:56.598362 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:03:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:03:56.766853 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361f214-3932-4b27-ac49-50bbb6e23d55 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:03:56.768305 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-a361f214-3932-4b27-ac49-50bbb6e23d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:56.787139 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:56.915465 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361f214-3932-4b27-ac49-50bbb6e23d55 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:03:57.003776 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:57.033301 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e301b-e7a4-42df-bd82-c6707d855ecb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:03:57.036100 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e301b-e7a4-42df-bd82-c6707d855ecb service nova] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:57.036100 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e301b-e7a4-42df-bd82-c6707d855ecb service nova] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:57.036100 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e301b-e7a4-42df-bd82-c6707d855ecb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:57.036100 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-676e301b-e7a4-42df-bd82-c6707d855ecb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:57.126572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e301b-e7a4-42df-bd82-c6707d855ecb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:03:57.128216 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e301b-e7a4-42df-bd82-c6707d855ecb service nova] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:03:57.146410 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 715/1434] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:03:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:03:58.026254 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b113a-91d3-4652-bb10-17d7c6e33819 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:58.029486 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b113a-91d3-4652-bb10-17d7c6e33819 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:58.029486 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b113a-91d3-4652-bb10-17d7c6e33819 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:58.029486 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:03:58.033600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd38bd-289d-4fbe-a6f0-74af97f44195 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:58.034079 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd38bd-289d-4fbe-a6f0-74af97f44195 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:58.034183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cd38bd-289d-4fbe-a6f0-74af97f44195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:58.112183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-d8cd38bd-289d-4fbe-a6f0-74af97f44195 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:03:58.113460 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-d8cd38bd-289d-4fbe-a6f0-74af97f44195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:58.155665 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:58.211578 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:03:58.364609 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b113a-91d3-4652-bb10-17d7c6e33819 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:03:58.366160 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-e84b113a-91d3-4652-bb10-17d7c6e33819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:58.512676 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b113a-91d3-4652-bb10-17d7c6e33819 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:03:58.568228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:58.628587 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d66e2f-0b9d-4476-a77e-32ca48c3adbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:03:58.629201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d66e2f-0b9d-4476-a77e-32ca48c3adbe service nova] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:58.629475 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d66e2f-0b9d-4476-a77e-32ca48c3adbe service nova] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:58.629739 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d66e2f-0b9d-4476-a77e-32ca48c3adbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:58.631385 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-06d66e2f-0b9d-4476-a77e-32ca48c3adbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:58.723649 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d66e2f-0b9d-4476-a77e-32ca48c3adbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:03:58.725225 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d66e2f-0b9d-4476-a77e-32ca48c3adbe service nova] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:03:58.743352 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 721/1437] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:03:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:03:59.622187 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cb659-b802-4697-822a-90e9b706da73 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:59.622763 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cb659-b802-4697-822a-90e9b706da73 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:59.622763 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cb659-b802-4697-822a-90e9b706da73 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:59.624039 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:03:59.628993 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1ad99-b17f-4397-adbb-943949269d9d None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:03:59.629399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1ad99-b17f-4397-adbb-943949269d9d None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:03:59.629539 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e1ad99-b17f-4397-adbb-943949269d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:03:59.705961 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-e2e1ad99-b17f-4397-adbb-943949269d9d None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:03:59.707180 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-e2e1ad99-b17f-4397-adbb-943949269d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:03:59.709243 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:03:59.803767 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:03:59.954665 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cb659-b802-4697-822a-90e9b706da73 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:03:59.956115 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-018cb659-b802-4697-822a-90e9b706da73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:00.103412 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cb659-b802-4697-822a-90e9b706da73 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:04:00.131193 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:00.218681 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73d725-e56b-4ced-b01e-6aa728f0c66a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:04:00.219481 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73d725-e56b-4ced-b01e-6aa728f0c66a service nova] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:00.219762 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73d725-e56b-4ced-b01e-6aa728f0c66a service nova] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:00.220034 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73d725-e56b-4ced-b01e-6aa728f0c66a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:00.221630 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-ad73d725-e56b-4ced-b01e-6aa728f0c66a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:00.311554 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73d725-e56b-4ced-b01e-6aa728f0c66a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:04:00.313312 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73d725-e56b-4ced-b01e-6aa728f0c66a service nova] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:04:00.331571 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 718/1440] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:03:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:04:02.228580 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec074831-dc92-49d8-a819-947f48a2b352 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:02.229158 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec074831-dc92-49d8-a819-947f48a2b352 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:02.229158 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec074831-dc92-49d8-a819-947f48a2b352 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:02.230579 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:04:02.236630 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6c733-3841-4e9e-913f-c22b9a42637d None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:02.237096 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6c733-3841-4e9e-913f-c22b9a42637d None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:02.237377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6c733-3841-4e9e-913f-c22b9a42637d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:02.280121 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:02.306880 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-4ee6c733-3841-4e9e-913f-c22b9a42637d None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:04:02.308224 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-4ee6c733-3841-4e9e-913f-c22b9a42637d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:02.410530 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:04:02.701292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec074831-dc92-49d8-a819-947f48a2b352 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:04:02.703400 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-ec074831-dc92-49d8-a819-947f48a2b352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:02.805116 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec074831-dc92-49d8-a819-947f48a2b352 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:04:02.837479 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:02.879940 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e870a7-21e5-42e6-9076-2849be3b4074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:04:02.881051 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e870a7-21e5-42e6-9076-2849be3b4074 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:02.881334 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e870a7-21e5-42e6-9076-2849be3b4074 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:02.881604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e870a7-21e5-42e6-9076-2849be3b4074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:02.883510 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-88e870a7-21e5-42e6-9076-2849be3b4074 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:02.992737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e870a7-21e5-42e6-9076-2849be3b4074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:04:02.994072 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e870a7-21e5-42e6-9076-2849be3b4074 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:04:03.012816 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 724/1443] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:04:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:04:05.084577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907ca49-d2fa-4a5e-ac67-c8a6711b1b64 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:05.085133 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907ca49-d2fa-4a5e-ac67-c8a6711b1b64 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:05.085133 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b907ca49-d2fa-4a5e-ac67-c8a6711b1b64 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:05.086480 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:04:05.092015 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0823e4-f101-4cda-9a9b-6121174adf6f None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:05.092484 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0823e4-f101-4cda-9a9b-6121174adf6f None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:05.092591 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0823e4-f101-4cda-9a9b-6121174adf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:05.159831 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-fd0823e4-f101-4cda-9a9b-6121174adf6f None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:04:05.160947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-fd0823e4-f101-4cda-9a9b-6121174adf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:05.175715 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:05.259311 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:04:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:04:05.550100 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907ca49-d2fa-4a5e-ac67-c8a6711b1b64 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:04:05.551741 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-b907ca49-d2fa-4a5e-ac67-c8a6711b1b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:05.655619 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b907ca49-d2fa-4a5e-ac67-c8a6711b1b64 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:04:05.667933 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:05.730045 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f198917-fbc8-4505-a59b-242a2ed8e160 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:04:05.730648 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f198917-fbc8-4505-a59b-242a2ed8e160 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:05.730920 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f198917-fbc8-4505-a59b-242a2ed8e160 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:05.731219 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f198917-fbc8-4505-a59b-242a2ed8e160 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:05.732811 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-5f198917-fbc8-4505-a59b-242a2ed8e160 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:05.841906 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f198917-fbc8-4505-a59b-242a2ed8e160 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:04:05.844116 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f198917-fbc8-4505-a59b-242a2ed8e160 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:04:05.863042 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 721/1446] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:04:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:04:08.208801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210f206-4fe2-498b-bfa7-c3a6a3d79526 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:08.209340 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210f206-4fe2-498b-bfa7-c3a6a3d79526 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:08.209340 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3210f206-4fe2-498b-bfa7-c3a6a3d79526 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:08.210604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:04:08.216031 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56703a2-eb90-409c-832f-181c6df15a83 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:08.216460 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56703a2-eb90-409c-832f-181c6df15a83 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:08.216624 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56703a2-eb90-409c-832f-181c6df15a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:08.264769 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:08.284824 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-f56703a2-eb90-409c-832f-181c6df15a83 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:04:08.286063 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-f56703a2-eb90-409c-832f-181c6df15a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:08.383318 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:04:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:04:08.675736 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210f206-4fe2-498b-bfa7-c3a6a3d79526 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:04:08.677250 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-3210f206-4fe2-498b-bfa7-c3a6a3d79526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:08.787020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3210f206-4fe2-498b-bfa7-c3a6a3d79526 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:04:08.826884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:08.861322 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf712d5-76a2-4701-98c1-db8398040822 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:04:08.861928 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf712d5-76a2-4701-98c1-db8398040822 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:08.862205 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf712d5-76a2-4701-98c1-db8398040822 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:08.862473 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf712d5-76a2-4701-98c1-db8398040822 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:08.864123 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-2bf712d5-76a2-4701-98c1-db8398040822 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:08.975905 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf712d5-76a2-4701-98c1-db8398040822 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:04:08.977287 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf712d5-76a2-4701-98c1-db8398040822 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:04:08.997085 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 727/1449] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:04:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:04:11.048405 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acd47e-015a-4178-9c04-6214db2c3fed None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:11.049430 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acd47e-015a-4178-9c04-6214db2c3fed None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:11.049561 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acd47e-015a-4178-9c04-6214db2c3fed None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:11.050922 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:04:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:04:11.056579 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d4e69-c163-43b4-a6d0-d559834d6849 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:11.056982 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d4e69-c163-43b4-a6d0-d559834d6849 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:11.057123 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d4e69-c163-43b4-a6d0-d559834d6849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:11.122874 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-4a6d4e69-c163-43b4-a6d0-d559834d6849 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:04:11.124022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-4a6d4e69-c163-43b4-a6d0-d559834d6849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:11.148663 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:11.226522 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:04:11.526629 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66acd47e-015a-4178-9c04-6214db2c3fed None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:04:11.528190 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-66acd47e-015a-4178-9c04-6214db2c3fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:11.635251 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66acd47e-015a-4178-9c04-6214db2c3fed None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:04:11.656570 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:11.712322 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08cb02b-011f-4808-9554-45b04d1a7e05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:04:11.712938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08cb02b-011f-4808-9554-45b04d1a7e05 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:11.713215 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08cb02b-011f-4808-9554-45b04d1a7e05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:11.713504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08cb02b-011f-4808-9554-45b04d1a7e05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:11.715098 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-a08cb02b-011f-4808-9554-45b04d1a7e05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:11.828117 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08cb02b-011f-4808-9554-45b04d1a7e05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:04:11.829559 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08cb02b-011f-4808-9554-45b04d1a7e05 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:04:11.847906 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 724/1452] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:04:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:04:13.979734 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecce8e6-d849-430b-8067-608de3e34c32 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:13.979734 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecce8e6-d849-430b-8067-608de3e34c32 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:13.979734 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecce8e6-d849-430b-8067-608de3e34c32 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:13.979734 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:04:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:04:13.980499 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7dd8b2-41e4-46cc-95f6-01685a4501d9 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:13.980499 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7dd8b2-41e4-46cc-95f6-01685a4501d9 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:13.980499 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7dd8b2-41e4-46cc-95f6-01685a4501d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:13.980499 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:13.980499 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-0c7dd8b2-41e4-46cc-95f6-01685a4501d9 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:04:13.980499 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-0c7dd8b2-41e4-46cc-95f6-01685a4501d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:14.070412 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:04:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:04:14.358161 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecce8e6-d849-430b-8067-608de3e34c32 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:04:14.360674 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-7ecce8e6-d849-430b-8067-608de3e34c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:14.466462 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecce8e6-d849-430b-8067-608de3e34c32 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:04:14.515904 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:14.543984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19a374-65a2-4f61-8795-8d65cbfb4a9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:04:14.544583 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19a374-65a2-4f61-8795-8d65cbfb4a9a service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:14.544855 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19a374-65a2-4f61-8795-8d65cbfb4a9a service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:14.545120 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19a374-65a2-4f61-8795-8d65cbfb4a9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:14.546996 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-3d19a374-65a2-4f61-8795-8d65cbfb4a9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:14.654386 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19a374-65a2-4f61-8795-8d65cbfb4a9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:04:14.656387 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19a374-65a2-4f61-8795-8d65cbfb4a9a service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:04:14.675054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 730/1455] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:04:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:04:16.700417 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7aa7a-a8f7-43c4-9cd3-538677c0977b None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:16.700985 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7aa7a-a8f7-43c4-9cd3-538677c0977b None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:16.700985 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7aa7a-a8f7-43c4-9cd3-538677c0977b None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:16.703152 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:04:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:04:16.708699 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01304b4f-345f-443e-9d1b-f202a9a9f566 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:16.709133 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01304b4f-345f-443e-9d1b-f202a9a9f566 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:16.709248 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01304b4f-345f-443e-9d1b-f202a9a9f566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:16.776167 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-01304b4f-345f-443e-9d1b-f202a9a9f566 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:04:16.777359 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-01304b4f-345f-443e-9d1b-f202a9a9f566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:16.813012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:16.880329 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:04:17.172394 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7aa7a-a8f7-43c4-9cd3-538677c0977b None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:04:17.174033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-49c7aa7a-a8f7-43c4-9cd3-538677c0977b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:17.277015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7aa7a-a8f7-43c4-9cd3-538677c0977b None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:04:17.307176 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:17.354020 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99fa34-3272-43e1-b161-fe27c84d3886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:04:17.354647 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99fa34-3272-43e1-b161-fe27c84d3886 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:17.358901 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99fa34-3272-43e1-b161-fe27c84d3886 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:17.358901 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99fa34-3272-43e1-b161-fe27c84d3886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:17.358901 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-2d99fa34-3272-43e1-b161-fe27c84d3886 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:17.467203 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99fa34-3272-43e1-b161-fe27c84d3886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:04:17.469225 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d99fa34-3272-43e1-b161-fe27c84d3886 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:04:17.488072 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 727/1458] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:04:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:04:19.450927 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6807210-aa44-4597-a804-47fcd27b2c5c None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:19.451531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6807210-aa44-4597-a804-47fcd27b2c5c None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:19.451531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6807210-aa44-4597-a804-47fcd27b2c5c None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:19.453417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:04:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:04:19.458741 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9ca85-3cec-412c-a065-6d6ad5cf8155 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:19.459219 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9ca85-3cec-412c-a065-6d6ad5cf8155 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:19.459330 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9ca85-3cec-412c-a065-6d6ad5cf8155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:19.528152 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-f9e9ca85-3cec-412c-a065-6d6ad5cf8155 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:04:19.529346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-f9e9ca85-3cec-412c-a065-6d6ad5cf8155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:19.537947 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:19.626295 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:04:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:04:19.913247 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6807210-aa44-4597-a804-47fcd27b2c5c None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:04:19.914759 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-a6807210-aa44-4597-a804-47fcd27b2c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:20.018233 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6807210-aa44-4597-a804-47fcd27b2c5c None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:04:20.074361 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:20.093173 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548600c0-1650-454d-b5f7-dc5f5123ada9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:04:20.093780 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548600c0-1650-454d-b5f7-dc5f5123ada9 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:20.094060 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548600c0-1650-454d-b5f7-dc5f5123ada9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:20.094325 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548600c0-1650-454d-b5f7-dc5f5123ada9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:20.095977 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-548600c0-1650-454d-b5f7-dc5f5123ada9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:20.204526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548600c0-1650-454d-b5f7-dc5f5123ada9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:04:20.205915 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548600c0-1650-454d-b5f7-dc5f5123ada9 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:04:20.223589 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 733/1461] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:04:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:04:22.221453 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8b787-4206-49df-a9b8-c316d00da355 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:22.222072 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8b787-4206-49df-a9b8-c316d00da355 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:22.222072 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8b787-4206-49df-a9b8-c316d00da355 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:22.223370 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:04:22.228812 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e573ae-d4f9-4bfd-82e9-32191a66f04e None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:22.229223 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e573ae-d4f9-4bfd-82e9-32191a66f04e None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:22.229396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e573ae-d4f9-4bfd-82e9-32191a66f04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:22.299048 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-c2e573ae-d4f9-4bfd-82e9-32191a66f04e None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:04:22.300307 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-c2e573ae-d4f9-4bfd-82e9-32191a66f04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:22.342646 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:22.404426 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:04:22.690748 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8b787-4206-49df-a9b8-c316d00da355 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:04:22.692434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-75c8b787-4206-49df-a9b8-c316d00da355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:22.794684 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8b787-4206-49df-a9b8-c316d00da355 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:04:22.832896 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:22.871705 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd6b1b-fd7e-421d-b639-16c3d92f743d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:04:22.871705 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd6b1b-fd7e-421d-b639-16c3d92f743d service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:22.872346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd6b1b-fd7e-421d-b639-16c3d92f743d service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:22.872640 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd6b1b-fd7e-421d-b639-16c3d92f743d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:22.874900 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-7bcd6b1b-fd7e-421d-b639-16c3d92f743d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:22.982590 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd6b1b-fd7e-421d-b639-16c3d92f743d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:04:22.984663 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd6b1b-fd7e-421d-b639-16c3d92f743d service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:04:23.003451 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 730/1464] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:04:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:04:24.988589 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f12bb-14b3-4f0d-8b98-b0b1f5ef2e20 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:24.989206 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f12bb-14b3-4f0d-8b98-b0b1f5ef2e20 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:24.989206 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f12bb-14b3-4f0d-8b98-b0b1f5ef2e20 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:24.990504 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:04:24.995776 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec6c8b-37ab-4504-8c53-b0b3f8eec0cd None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:24.996210 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec6c8b-37ab-4504-8c53-b0b3f8eec0cd None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:24.996312 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec6c8b-37ab-4504-8c53-b0b3f8eec0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:25.064905 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-a3ec6c8b-37ab-4504-8c53-b0b3f8eec0cd None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:04:25.066117 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-a3ec6c8b-37ab-4504-8c53-b0b3f8eec0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:25.084880 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:25.166119 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:04:25.455362 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f12bb-14b3-4f0d-8b98-b0b1f5ef2e20 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:04:25.456929 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-937f12bb-14b3-4f0d-8b98-b0b1f5ef2e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:25.562416 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f12bb-14b3-4f0d-8b98-b0b1f5ef2e20 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:04:25.629349 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:25.636191 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4d802-b3f3-42ae-a57d-0e7bd75cf775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:04:25.641402 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4d802-b3f3-42ae-a57d-0e7bd75cf775 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:25.641402 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4d802-b3f3-42ae-a57d-0e7bd75cf775 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:25.641402 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4d802-b3f3-42ae-a57d-0e7bd75cf775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:25.641402 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-3fa4d802-b3f3-42ae-a57d-0e7bd75cf775 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:25.755137 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4d802-b3f3-42ae-a57d-0e7bd75cf775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:04:25.756513 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4d802-b3f3-42ae-a57d-0e7bd75cf775 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:04:25.775666 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 736/1467] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:04:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:04:27.715554 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce12e70-bd9a-4140-bd33-5c67af02f74c None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:27.716066 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce12e70-bd9a-4140-bd33-5c67af02f74c None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:27.716178 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce12e70-bd9a-4140-bd33-5c67af02f74c None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:27.717468 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:04:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:04:27.722780 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ade79-92d9-4e90-8f11-e7a87aeff1d3 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:27.723214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ade79-92d9-4e90-8f11-e7a87aeff1d3 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:27.723356 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ade79-92d9-4e90-8f11-e7a87aeff1d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:27.789028 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-f80ade79-92d9-4e90-8f11-e7a87aeff1d3 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:04:27.790233 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-f80ade79-92d9-4e90-8f11-e7a87aeff1d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:27.839158 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:27.890784 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:04:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:04:28.178940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce12e70-bd9a-4140-bd33-5c67af02f74c None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:04:28.180492 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-2ce12e70-bd9a-4140-bd33-5c67af02f74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:28.284866 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce12e70-bd9a-4140-bd33-5c67af02f74c None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:04:28.332612 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:28.359540 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9a656-ea43-48c1-8868-e780630ae855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:04:28.360150 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9a656-ea43-48c1-8868-e780630ae855 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:28.360423 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9a656-ea43-48c1-8868-e780630ae855 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:28.360691 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9a656-ea43-48c1-8868-e780630ae855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:28.362289 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-45b9a656-ea43-48c1-8868-e780630ae855 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:28.473891 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9a656-ea43-48c1-8868-e780630ae855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:04:28.475269 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9a656-ea43-48c1-8868-e780630ae855 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:04:28.494679 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 733/1470] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:04:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:04:37.888189 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=22 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:38.492744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=66 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:48.607888 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773264a-c6fa-44bf-9325-8c8b78fd6cee None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:48.608424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773264a-c6fa-44bf-9325-8c8b78fd6cee None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:48.608424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9773264a-c6fa-44bf-9325-8c8b78fd6cee None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:48.609797 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 738/1471] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 17:04:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:04:48.615345 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b815dda-a0db-48c2-b81b-3789bb6a220b None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:48.615830 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b815dda-a0db-48c2-b81b-3789bb6a220b None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:48.615946 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b815dda-a0db-48c2-b81b-3789bb6a220b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:48.687723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-0b815dda-a0db-48c2-b81b-3789bb6a220b None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:04:48.688945 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-0b815dda-a0db-48c2-b81b-3789bb6a220b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:48.788525 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 734/1472] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 17:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:04:49.087987 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fccf4f-4592-4a9d-a067-47ab865bee49 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:49.088341 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fccf4f-4592-4a9d-a067-47ab865bee49 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:49.088615 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fccf4f-4592-4a9d-a067-47ab865bee49 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:49.090011 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 739/1473] 10.222.0.55 () {54 vars in 967 bytes} [Wed Aug 24 17:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:04:49.095903 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564a0dc-3681-42c3-92a3-9f7cff331807 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:49.096191 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564a0dc-3681-42c3-92a3-9f7cff331807 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:49.096521 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8564a0dc-3681-42c3-92a3-9f7cff331807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:49.175733 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-8564a0dc-3681-42c3-92a3-9f7cff331807 None None] MFA Rules not processed for user `3a6aad0e9f5f4a0b9578a31082e726cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:04:49.176872 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-8564a0dc-3681-42c3-92a3-9f7cff331807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:49.197964 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:49.255256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 735/1474] 10.222.0.55 () {58 vars in 1064 bytes} [Wed Aug 24 17:04:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:04:49.263265 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fccf4f-4592-4a9d-a067-47ab865bee49 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:04:49.264824 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-a8fccf4f-4592-4a9d-a067-47ab865bee49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:49.372100 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fccf4f-4592-4a9d-a067-47ab865bee49 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:04:49.446254 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fb7dff-97a4-47b3-ac91-d8624f3482ea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6aad0e9f5f4a0b9578a31082e726cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:04:49.446720 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb7dff-97a4-47b3-ac91-d8624f3482ea service glance] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:49.446993 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb7dff-97a4-47b3-ac91-d8624f3482ea service glance] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:49.447287 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fb7dff-97a4-47b3-ac91-d8624f3482ea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:49.448893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-f4fb7dff-97a4-47b3-ac91-d8624f3482ea service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:49.504161 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:49.559901 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb7dff-97a4-47b3-ac91-d8624f3482ea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:04:49.561320 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fb7dff-97a4-47b3-ac91-d8624f3482ea service glance] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:04:49.580135 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 740/1475] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:04:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:04:51.610099 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe83f9-412b-4584-8ee3-87fc3fb02dd4 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:51.610629 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe83f9-412b-4584-8ee3-87fc3fb02dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:51.610735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbe83f9-412b-4584-8ee3-87fc3fb02dd4 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:51.612063 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 736/1476] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 17:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:04:51.617346 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88629d-44a0-4c8d-961c-5fbcd56f1d2b None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:51.617748 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88629d-44a0-4c8d-961c-5fbcd56f1d2b None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:51.617864 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e88629d-44a0-4c8d-961c-5fbcd56f1d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:51.686437 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-3e88629d-44a0-4c8d-961c-5fbcd56f1d2b None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:04:51.687700 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-3e88629d-44a0-4c8d-961c-5fbcd56f1d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:51.788468 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 741/1477] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 17:04:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:04:52.068765 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe83f9-412b-4584-8ee3-87fc3fb02dd4 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:04:52.070286 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-8cbe83f9-412b-4584-8ee3-87fc3fb02dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:52.198289 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbe83f9-412b-4584-8ee3-87fc3fb02dd4 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:04:52.248605 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:52.295886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ffbbc-18f7-4193-9823-0fa221156fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:04:52.296488 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ffbbc-18f7-4193-9823-0fa221156fff admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:52.296771 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ffbbc-18f7-4193-9823-0fa221156fff admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:52.297027 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ffbbc-18f7-4193-9823-0fa221156fff admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:52.297655 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ffbbc-18f7-4193-9823-0fa221156fff admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:04:52.299461 dv-cinder-779578-5-smb devstack@keystone.service[81760]: WARNING py.warnings [None req-f46ffbbc-18f7-4193-9823-0fa221156fff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:04:52.299461 dv-cinder-779578-5-smb devstack@keystone.service[81760]: warnings.warn(msg) Aug 24 17:04:52.299461 dv-cinder-779578-5-smb devstack@keystone.service[81760]: Aug 24 17:04:52.300647 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ffbbc-18f7-4193-9823-0fa221156fff admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:04:52.320001 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 737/1478] 10.222.0.55 () {56 vars in 1108 bytes} [Wed Aug 24 17:04:52 2022] GET /identity/v3/projects => generated 2553 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:04:54.281772 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945638de-f0d5-4ea9-b8a0-a4dbc13e4491 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:54.282409 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945638de-f0d5-4ea9-b8a0-a4dbc13e4491 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:54.282409 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945638de-f0d5-4ea9-b8a0-a4dbc13e4491 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:54.283774 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 742/1479] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 17:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:04:54.289417 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30038d-e8dd-49a8-9d1e-789581ea5830 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:54.289848 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30038d-e8dd-49a8-9d1e-789581ea5830 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:54.289942 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30038d-e8dd-49a8-9d1e-789581ea5830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:54.358703 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-9b30038d-e8dd-49a8-9d1e-789581ea5830 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:04:54.359969 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-9b30038d-e8dd-49a8-9d1e-789581ea5830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:54.460816 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 738/1480] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 17:04:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:04:54.758633 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945638de-f0d5-4ea9-b8a0-a4dbc13e4491 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:04:54.760162 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-945638de-f0d5-4ea9-b8a0-a4dbc13e4491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:54.770176 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:54.910209 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945638de-f0d5-4ea9-b8a0-a4dbc13e4491 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:04:54.990562 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:55.024615 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cc850-db1b-4d52-933e-8e8036f01adf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:04:55.025638 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cc850-db1b-4d52-933e-8e8036f01adf service nova] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:55.026146 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cc850-db1b-4d52-933e-8e8036f01adf service nova] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:55.026656 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cc850-db1b-4d52-933e-8e8036f01adf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:55.029293 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-881cc850-db1b-4d52-933e-8e8036f01adf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:55.126993 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cc850-db1b-4d52-933e-8e8036f01adf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:04:55.128608 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cc850-db1b-4d52-933e-8e8036f01adf service nova] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:04:55.147196 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 743/1481] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:04:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:04:57.295198 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2baad3-edfb-4769-83c8-aadc2016557d None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:57.295781 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2baad3-edfb-4769-83c8-aadc2016557d None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:57.295781 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2baad3-edfb-4769-83c8-aadc2016557d None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:57.297093 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 739/1482] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 17:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:04:57.302367 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85e0bf-64e4-48c9-81a6-05322e1e2a20 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:57.302823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85e0bf-64e4-48c9-81a6-05322e1e2a20 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:57.302942 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db85e0bf-64e4-48c9-81a6-05322e1e2a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:57.370804 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-db85e0bf-64e4-48c9-81a6-05322e1e2a20 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:04:57.372654 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-db85e0bf-64e4-48c9-81a6-05322e1e2a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:57.420277 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:57.470327 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 744/1483] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 17:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:04:57.761046 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2baad3-edfb-4769-83c8-aadc2016557d None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:04:57.763227 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-0f2baad3-edfb-4769-83c8-aadc2016557d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:57.787209 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:57.867668 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2baad3-edfb-4769-83c8-aadc2016557d None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:04:57.946011 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c355256-6625-49cb-b88b-4fbc7e309e9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:04:57.946619 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c355256-6625-49cb-b88b-4fbc7e309e9d service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:04:57.946899 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c355256-6625-49cb-b88b-4fbc7e309e9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:04:57.947209 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c355256-6625-49cb-b88b-4fbc7e309e9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:04:57.948799 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-4c355256-6625-49cb-b88b-4fbc7e309e9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:04:58.026033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:04:58.062238 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c355256-6625-49cb-b88b-4fbc7e309e9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:04:58.063744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c355256-6625-49cb-b88b-4fbc7e309e9d service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:04:58.083261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 740/1484] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:04:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:05:00.077226 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df12ca-c4eb-4fb4-9eb3-8d1f50ce5293 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:05:00.077805 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df12ca-c4eb-4fb4-9eb3-8d1f50ce5293 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:05:00.077805 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df12ca-c4eb-4fb4-9eb3-8d1f50ce5293 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:05:00.079132 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 745/1485] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 17:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:05:00.092150 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaadeb0-7015-4360-9235-f15bb97a9bb0 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:05:00.092150 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaadeb0-7015-4360-9235-f15bb97a9bb0 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:05:00.092150 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaadeb0-7015-4360-9235-f15bb97a9bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:05:00.151041 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-ddaadeb0-7015-4360-9235-f15bb97a9bb0 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:05:00.152226 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-ddaadeb0-7015-4360-9235-f15bb97a9bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:05:00.257586 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 741/1486] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 17:05:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:05:00.557215 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df12ca-c4eb-4fb4-9eb3-8d1f50ce5293 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:05:00.558765 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-f6df12ca-c4eb-4fb4-9eb3-8d1f50ce5293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:05:00.662139 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df12ca-c4eb-4fb4-9eb3-8d1f50ce5293 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:05:00.736808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:05:00.738582 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac343b5d-a637-4145-b207-c90fdad1911d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:05:00.739233 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac343b5d-a637-4145-b207-c90fdad1911d service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:05:00.739512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac343b5d-a637-4145-b207-c90fdad1911d service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:05:00.739783 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac343b5d-a637-4145-b207-c90fdad1911d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:05:00.741376 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-ac343b5d-a637-4145-b207-c90fdad1911d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:05:00.851292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac343b5d-a637-4145-b207-c90fdad1911d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:05:00.852652 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac343b5d-a637-4145-b207-c90fdad1911d service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:05:00.872307 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 746/1487] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:05:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:05:02.962729 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef0d34-eeaf-43a9-aadf-d16bcb42d188 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:05:02.963314 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef0d34-eeaf-43a9-aadf-d16bcb42d188 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:05:02.963314 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ef0d34-eeaf-43a9-aadf-d16bcb42d188 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:05:02.964715 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 742/1488] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 17:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:05:02.970091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c14a9d-afb2-4d11-810c-ec0d2c0a444d None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:05:02.970520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c14a9d-afb2-4d11-810c-ec0d2c0a444d None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:05:02.970626 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c14a9d-afb2-4d11-810c-ec0d2c0a444d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:05:03.047088 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-94c14a9d-afb2-4d11-810c-ec0d2c0a444d None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:05:03.048347 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-94c14a9d-afb2-4d11-810c-ec0d2c0a444d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:05:03.102174 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:05:03.147830 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 747/1489] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 17:05:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:05:03.442454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef0d34-eeaf-43a9-aadf-d16bcb42d188 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:05:03.444217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-a0ef0d34-eeaf-43a9-aadf-d16bcb42d188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:05:03.482156 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:05:03.553574 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ef0d34-eeaf-43a9-aadf-d16bcb42d188 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:05:03.628095 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0394d419-eb23-4eea-bd14-b06659424be4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:05:03.628746 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394d419-eb23-4eea-bd14-b06659424be4 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:05:03.629029 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394d419-eb23-4eea-bd14-b06659424be4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:05:03.629308 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0394d419-eb23-4eea-bd14-b06659424be4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:05:03.630942 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-0394d419-eb23-4eea-bd14-b06659424be4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:05:03.712505 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:05:03.742104 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0394d419-eb23-4eea-bd14-b06659424be4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:05:03.743643 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0394d419-eb23-4eea-bd14-b06659424be4 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:05:03.762436 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 743/1490] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:05:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:05:06.152777 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b2dfd-5ca6-405e-a4b6-aca0a6b6b3c1 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:05:06.153334 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b2dfd-5ca6-405e-a4b6-aca0a6b6b3c1 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:05:06.153334 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b2dfd-5ca6-405e-a4b6-aca0a6b6b3c1 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:05:06.154845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 748/1491] 10.222.0.55 () {54 vars in 927 bytes} [Wed Aug 24 17:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:05:06.160441 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19a415-7c21-47d2-a959-458bc6dbcdbd None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:05:06.160898 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19a415-7c21-47d2-a959-458bc6dbcdbd None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:05:06.161023 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19a415-7c21-47d2-a959-458bc6dbcdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:05:06.227060 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-2d19a415-7c21-47d2-a959-458bc6dbcdbd None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:05:06.228312 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-2d19a415-7c21-47d2-a959-458bc6dbcdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:05:06.326922 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 744/1492] 10.222.0.55 () {58 vars in 1024 bytes} [Wed Aug 24 17:05:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:05:06.631711 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b2dfd-5ca6-405e-a4b6-aca0a6b6b3c1 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:05:06.633650 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-0c6b2dfd-5ca6-405e-a4b6-aca0a6b6b3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:05:06.740089 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b2dfd-5ca6-405e-a4b6-aca0a6b6b3c1 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:05:06.814922 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96638eaf-a8f7-4b38-ab3e-4d466584e5e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:05:06.815551 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96638eaf-a8f7-4b38-ab3e-4d466584e5e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:05:06.815831 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96638eaf-a8f7-4b38-ab3e-4d466584e5e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:05:06.816102 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96638eaf-a8f7-4b38-ab3e-4d466584e5e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:05:06.817697 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-96638eaf-a8f7-4b38-ab3e-4d466584e5e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:05:06.827037 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:05:06.935919 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96638eaf-a8f7-4b38-ab3e-4d466584e5e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:05:06.937267 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96638eaf-a8f7-4b38-ab3e-4d466584e5e4 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:05:06.955860 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 749/1493] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:05:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:05:16.324324 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=82 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:05:16.953591 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=50 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:06:37.879395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b16f6c-020a-4f25-b0e7-f477dfbf07e7 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:06:37.879972 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b16f6c-020a-4f25-b0e7-f477dfbf07e7 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:06:37.879972 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b16f6c-020a-4f25-b0e7-f477dfbf07e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:06:37.960956 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-56b16f6c-020a-4f25-b0e7-f477dfbf07e7 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:06:37.962165 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-56b16f6c-020a-4f25-b0e7-f477dfbf07e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:06:38.062498 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 745/1494] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:06:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:06:38.070902 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593eae31-118c-4179-91be-4d4bf8a31001 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:06:38.071438 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593eae31-118c-4179-91be-4d4bf8a31001 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:06:38.071548 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593eae31-118c-4179-91be-4d4bf8a31001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:06:38.147467 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-593eae31-118c-4179-91be-4d4bf8a31001 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:06:38.148604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-593eae31-118c-4179-91be-4d4bf8a31001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:06:38.245874 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 750/1495] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:06:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:06:38.251344 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b16f6c-020a-4f25-b0e7-f477dfbf07e7 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:06:38.252667 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-56b16f6c-020a-4f25-b0e7-f477dfbf07e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:06:38.265336 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b16f6c-020a-4f25-b0e7-f477dfbf07e7 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:06:38.327572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:06:38.361533 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c6931-2c9a-48d3-9a45-01f1a588bc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:06:38.362140 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c6931-2c9a-48d3-9a45-01f1a588bc2e admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:06:38.362417 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c6931-2c9a-48d3-9a45-01f1a588bc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:06:38.362685 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3c6931-2c9a-48d3-9a45-01f1a588bc2e admin admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:06:38.363351 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c6931-2c9a-48d3-9a45-01f1a588bc2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:06:38.363654 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c6931-2c9a-48d3-9a45-01f1a588bc2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:06:38.364666 dv-cinder-779578-5-smb devstack@keystone.service[81760]: WARNING py.warnings [None req-0b3c6931-2c9a-48d3-9a45-01f1a588bc2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:06:38.364666 dv-cinder-779578-5-smb devstack@keystone.service[81760]: warnings.warn(msg) Aug 24 17:06:38.364666 dv-cinder-779578-5-smb devstack@keystone.service[81760]: Aug 24 17:06:38.365730 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3c6931-2c9a-48d3-9a45-01f1a588bc2e admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:06:38.378569 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 746/1496] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:06:38.386947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593eae31-118c-4179-91be-4d4bf8a31001 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:06:38.396804 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593eae31-118c-4179-91be-4d4bf8a31001 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:06:38.458555 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:06:38.492639 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8807e3a-3d4c-4017-81d7-3720b45968d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:06:38.493239 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8807e3a-3d4c-4017-81d7-3720b45968d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:06:38.493523 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8807e3a-3d4c-4017-81d7-3720b45968d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:06:38.493797 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8807e3a-3d4c-4017-81d7-3720b45968d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:06:38.494425 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8807e3a-3d4c-4017-81d7-3720b45968d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:06:38.496179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: WARNING py.warnings [None req-d8807e3a-3d4c-4017-81d7-3720b45968d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:06:38.496179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: warnings.warn(msg) Aug 24 17:06:38.496179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: Aug 24 17:06:38.497872 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8807e3a-3d4c-4017-81d7-3720b45968d1 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:06:38.631551 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 751/1497] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:06:38 2022] POST /identity/v3/projects => generated 375 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:06:38.635829 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c6931-2c9a-48d3-9a45-01f1a588bc2e admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:06:38.637337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-0b3c6931-2c9a-48d3-9a45-01f1a588bc2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:06:38.672124 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3c6931-2c9a-48d3-9a45-01f1a588bc2e admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:06:38.767846 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f6924-21ec-45c1-a94c-240f4d07aae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:06:38.768418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f6924-21ec-45c1-a94c-240f4d07aae3 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:06:38.768699 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f6924-21ec-45c1-a94c-240f4d07aae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:06:38.768975 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f6924-21ec-45c1-a94c-240f4d07aae3 admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:06:38.769598 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f6924-21ec-45c1-a94c-240f4d07aae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:06:38.770657 dv-cinder-779578-5-smb devstack@keystone.service[81760]: WARNING py.warnings [None req-ca8f6924-21ec-45c1-a94c-240f4d07aae3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:06:38.770657 dv-cinder-779578-5-smb devstack@keystone.service[81760]: warnings.warn(msg) Aug 24 17:06:38.770657 dv-cinder-779578-5-smb devstack@keystone.service[81760]: Aug 24 17:06:38.772044 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f6924-21ec-45c1-a94c-240f4d07aae3 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:06:38.922647 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 747/1498] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:06:38 2022] POST /identity/v3/users => generated 288 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:06:38.926884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8807e3a-3d4c-4017-81d7-3720b45968d1 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:06:38.928433 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-d8807e3a-3d4c-4017-81d7-3720b45968d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:06:38.992353 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8807e3a-3d4c-4017-81d7-3720b45968d1 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:06:39.077815 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:06:39.088842 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9a38f-1eb3-45fd-b447-851759a51a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:06:39.089550 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9a38f-1eb3-45fd-b447-851759a51a69 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:06:39.089831 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9a38f-1eb3-45fd-b447-851759a51a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:06:39.090102 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9a38f-1eb3-45fd-b447-851759a51a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:06:39.090750 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9a38f-1eb3-45fd-b447-851759a51a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:06:39.092825 dv-cinder-779578-5-smb devstack@keystone.service[81761]: WARNING py.warnings [None req-31d9a38f-1eb3-45fd-b447-851759a51a69 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:06:39.092825 dv-cinder-779578-5-smb devstack@keystone.service[81761]: warnings.warn(msg) Aug 24 17:06:39.092825 dv-cinder-779578-5-smb devstack@keystone.service[81761]: Aug 24 17:06:39.093707 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9a38f-1eb3-45fd-b447-851759a51a69 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:06:39.106229 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 752/1499] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:06:39.111413 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f6924-21ec-45c1-a94c-240f4d07aae3 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:06:39.112938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-ca8f6924-21ec-45c1-a94c-240f4d07aae3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:06:39.124399 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f6924-21ec-45c1-a94c-240f4d07aae3 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:06:39.149477 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:06:39.219511 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821f704-58ac-4cbd-a1ff-5932832cbac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:06:39.220368 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821f704-58ac-4cbd-a1ff-5932832cbac7 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:06:39.220772 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821f704-58ac-4cbd-a1ff-5932832cbac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:06:39.221177 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821f704-58ac-4cbd-a1ff-5932832cbac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:06:39.221927 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821f704-58ac-4cbd-a1ff-5932832cbac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:06:39.222923 dv-cinder-779578-5-smb devstack@keystone.service[81760]: WARNING py.warnings [None req-d821f704-58ac-4cbd-a1ff-5932832cbac7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:06:39.222923 dv-cinder-779578-5-smb devstack@keystone.service[81760]: warnings.warn(msg) Aug 24 17:06:39.222923 dv-cinder-779578-5-smb devstack@keystone.service[81760]: Aug 24 17:06:39.223833 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821f704-58ac-4cbd-a1ff-5932832cbac7 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:06:39.236790 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 748/1500] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:06:39.241136 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9a38f-1eb3-45fd-b447-851759a51a69 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:06:39.242670 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-31d9a38f-1eb3-45fd-b447-851759a51a69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:06:39.277758 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9a38f-1eb3-45fd-b447-851759a51a69 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:06:39.375027 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c69e48-9d09-46b8-aa89-049378307903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:06:39.375640 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c69e48-9d09-46b8-aa89-049378307903 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:06:39.375923 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c69e48-9d09-46b8-aa89-049378307903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:06:39.376196 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c69e48-9d09-46b8-aa89-049378307903 admin admin] PATH_INFO: `/v3/projects/6b1de4a403fe4c55a963363cf9250bc0/users/8797d52be4b94620a65252d8cda874e1/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:06:39.398093 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c69e48-9d09-46b8-aa89-049378307903 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b1de4a403fe4c55a963363cf9250bc0, user_id=8797d52be4b94620a65252d8cda874e1, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:06:39.399388 dv-cinder-779578-5-smb devstack@keystone.service[81761]: WARNING py.warnings [None req-92c69e48-9d09-46b8-aa89-049378307903 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:06:39.399388 dv-cinder-779578-5-smb devstack@keystone.service[81761]: warnings.warn(msg) Aug 24 17:06:39.399388 dv-cinder-779578-5-smb devstack@keystone.service[81761]: Aug 24 17:06:39.401336 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c69e48-9d09-46b8-aa89-049378307903 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:06:39.515957 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 753/1501] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:06:39 2022] PUT /identity/v3/projects/6b1de4a403fe4c55a963363cf9250bc0/users/8797d52be4b94620a65252d8cda874e1/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:06:39.528124 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e22b5e-2b8f-47d4-ba7d-568e206e846a None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:06:39.528415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e22b5e-2b8f-47d4-ba7d-568e206e846a None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:06:39.528696 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e22b5e-2b8f-47d4-ba7d-568e206e846a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:06:39.587702 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-16e22b5e-2b8f-47d4-ba7d-568e206e846a None None] MFA Rules not processed for user `8797d52be4b94620a65252d8cda874e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:06:39.588924 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-16e22b5e-2b8f-47d4-ba7d-568e206e846a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:06:39.785353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 749/1502] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:06:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:06:39.799450 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759991c-9f10-4bb5-afe4-6c2f1aa3482f None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:06:39.799760 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759991c-9f10-4bb5-afe4-6c2f1aa3482f None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:06:39.800032 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f759991c-9f10-4bb5-afe4-6c2f1aa3482f None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:06:39.801367 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 754/1503] 10.222.0.55 () {54 vars in 964 bytes} [Wed Aug 24 17:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:06:39.806154 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cb214-721d-41dd-85c0-bb4ccb84ed85 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:06:39.806439 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cb214-721d-41dd-85c0-bb4ccb84ed85 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:06:39.806717 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277cb214-721d-41dd-85c0-bb4ccb84ed85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:06:39.837782 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:06:39.882853 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-277cb214-721d-41dd-85c0-bb4ccb84ed85 None None] MFA Rules not processed for user `eb911b8748844a6488811ca03cb8d344`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:06:39.884108 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-277cb214-721d-41dd-85c0-bb4ccb84ed85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:06:39.962582 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 750/1504] 10.222.0.55 () {58 vars in 1061 bytes} [Wed Aug 24 17:06:39 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:06:39.971556 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759991c-9f10-4bb5-afe4-6c2f1aa3482f None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:06:39.973093 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-f759991c-9f10-4bb5-afe4-6c2f1aa3482f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:06:40.024519 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:06:40.078932 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f759991c-9f10-4bb5-afe4-6c2f1aa3482f None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:06:40.152226 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a039b-afae-45e6-a98a-da3e9baccb20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:06:40.152828 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a039b-afae-45e6-a98a-da3e9baccb20 service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:06:40.153108 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a039b-afae-45e6-a98a-da3e9baccb20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:06:40.153380 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a039b-afae-45e6-a98a-da3e9baccb20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:06:40.154977 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-fb2a039b-afae-45e6-a98a-da3e9baccb20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:06:40.255814 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a039b-afae-45e6-a98a-da3e9baccb20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:06:40.257320 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a039b-afae-45e6-a98a-da3e9baccb20 service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:06:40.260789 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:06:40.278226 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 755/1505] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:06:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:06:40.326885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23228f6-644d-44de-980c-cbb3a32f1632 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:06:40.327229 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23228f6-644d-44de-980c-cbb3a32f1632 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:06:40.327508 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23228f6-644d-44de-980c-cbb3a32f1632 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:06:40.328758 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 751/1506] 10.222.0.55 () {52 vars in 830 bytes} [Wed Aug 24 17:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:06:40.332466 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a039b-afae-45e6-a98a-da3e9baccb20 service cinder] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:06:40.333615 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-fb2a039b-afae-45e6-a98a-da3e9baccb20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:06:40.431877 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a039b-afae-45e6-a98a-da3e9baccb20 service cinder] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:06:40.526813 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a5561-30b4-4231-a081-2e1173f5859b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:06:40.527465 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a5561-30b4-4231-a081-2e1173f5859b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:06:40.527742 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a5561-30b4-4231-a081-2e1173f5859b admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:06:40.528011 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a5561-30b4-4231-a081-2e1173f5859b admin admin] PATH_INFO: `/v3/users/8797d52be4b94620a65252d8cda874e1` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:06:40.541235 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a5561-30b4-4231-a081-2e1173f5859b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8797d52be4b94620a65252d8cda874e1)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:06:40.542552 dv-cinder-779578-5-smb devstack@keystone.service[81761]: WARNING py.warnings [None req-fa2a5561-30b4-4231-a081-2e1173f5859b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:06:40.542552 dv-cinder-779578-5-smb devstack@keystone.service[81761]: warnings.warn(msg) Aug 24 17:06:40.542552 dv-cinder-779578-5-smb devstack@keystone.service[81761]: Aug 24 17:06:40.543614 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2a5561-30b4-4231-a081-2e1173f5859b admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:06:40.554275 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:06:40.746507 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-fa2a5561-30b4-4231-a081-2e1173f5859b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8797d52be4b94620a65252d8cda874e1'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:06:40.760346 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-fa2a5561-30b4-4231-a081-2e1173f5859b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8797d52be4b94620a65252d8cda874e1'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:06:40.822775 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-fa2a5561-30b4-4231-a081-2e1173f5859b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8797d52be4b94620a65252d8cda874e1'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:06:40.823237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-fa2a5561-30b4-4231-a081-2e1173f5859b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8797d52be4b94620a65252d8cda874e1'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:06:40.823768 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-fa2a5561-30b4-4231-a081-2e1173f5859b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8797d52be4b94620a65252d8cda874e1'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:06:40.852959 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 756/1507] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:06:40 2022] DELETE /identity/v3/users/8797d52be4b94620a65252d8cda874e1 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:06:40.858197 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b11846-56fd-4855-95bb-bce66974b142 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:06:40.858474 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b11846-56fd-4855-95bb-bce66974b142 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:06:40.858794 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b11846-56fd-4855-95bb-bce66974b142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:06:40.915987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-08b11846-56fd-4855-95bb-bce66974b142 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:06:40.917187 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-08b11846-56fd-4855-95bb-bce66974b142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:06:40.993014 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:06:41.005438 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 752/1508] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:06:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:06:41.015954 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a5561-30b4-4231-a081-2e1173f5859b admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:06:41.017233 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-fa2a5561-30b4-4231-a081-2e1173f5859b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:06:41.157981 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a5561-30b4-4231-a081-2e1173f5859b admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:06:41.216688 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:06:41.235673 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd00bd6-d804-40a4-9d74-3761c62144f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:06:41.236280 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd00bd6-d804-40a4-9d74-3761c62144f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:06:41.236557 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd00bd6-d804-40a4-9d74-3761c62144f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:06:41.236824 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd00bd6-d804-40a4-9d74-3761c62144f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:06:41.238419 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-1bd00bd6-d804-40a4-9d74-3761c62144f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:06:41.354280 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd00bd6-d804-40a4-9d74-3761c62144f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:06:41.355768 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd00bd6-d804-40a4-9d74-3761c62144f5 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:06:41.375325 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 757/1509] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:06:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:06:41.848739 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b11846-56fd-4855-95bb-bce66974b142 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:06:41.850271 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-08b11846-56fd-4855-95bb-bce66974b142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:06:41.864049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b11846-56fd-4855-95bb-bce66974b142 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:06:41.968541 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b3e6b1-5c54-4f4b-9ef2-629bb3c9e3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:06:41.969175 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3e6b1-5c54-4f4b-9ef2-629bb3c9e3e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:06:41.969452 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3e6b1-5c54-4f4b-9ef2-629bb3c9e3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:06:41.969723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3e6b1-5c54-4f4b-9ef2-629bb3c9e3e5 admin admin] PATH_INFO: `/v3/projects/6b1de4a403fe4c55a963363cf9250bc0` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:06:41.980068 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b3e6b1-5c54-4f4b-9ef2-629bb3c9e3e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b1de4a403fe4c55a963363cf9250bc0)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:06:41.981080 dv-cinder-779578-5-smb devstack@keystone.service[81760]: WARNING py.warnings [None req-82b3e6b1-5c54-4f4b-9ef2-629bb3c9e3e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:06:41.981080 dv-cinder-779578-5-smb devstack@keystone.service[81760]: warnings.warn(msg) Aug 24 17:06:41.981080 dv-cinder-779578-5-smb devstack@keystone.service[81760]: Aug 24 17:06:41.983488 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b3e6b1-5c54-4f4b-9ef2-629bb3c9e3e5 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:06:42.204621 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-82b3e6b1-5c54-4f4b-9ef2-629bb3c9e3e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b1de4a403fe4c55a963363cf9250bc0', 'request_id': 'req-82b3e6b1-5c54-4f4b-9ef2-629bb3c9e3e5'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:06:42.210556 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-82b3e6b1-5c54-4f4b-9ef2-629bb3c9e3e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b1de4a403fe4c55a963363cf9250bc0', 'request_id': 'req-82b3e6b1-5c54-4f4b-9ef2-629bb3c9e3e5'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:06:42.224898 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-82b3e6b1-5c54-4f4b-9ef2-629bb3c9e3e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b1de4a403fe4c55a963363cf9250bc0', 'request_id': 'req-82b3e6b1-5c54-4f4b-9ef2-629bb3c9e3e5'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:06:42.310210 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-82b3e6b1-5c54-4f4b-9ef2-629bb3c9e3e5 admin admin] The token cache is being invalidate because project 6b1de4a403fe4c55a963363cf9250bc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:06:42.310480 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-82b3e6b1-5c54-4f4b-9ef2-629bb3c9e3e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:06:42.310896 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-82b3e6b1-5c54-4f4b-9ef2-629bb3c9e3e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:06:42.312429 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 753/1510] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:06:41 2022] DELETE /identity/v3/projects/6b1de4a403fe4c55a963363cf9250bc0 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:06:51.423827 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=62 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:06:52.308030 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:22.824465 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa8974-a237-486b-b190-2f28cad56c84 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:22.825133 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa8974-a237-486b-b190-2f28cad56c84 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:22.825133 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa8974-a237-486b-b190-2f28cad56c84 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:22.826343 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:08:22.831536 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c587a1b-6964-4039-885e-12b3056eaee7 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:22.831976 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c587a1b-6964-4039-885e-12b3056eaee7 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:22.832083 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c587a1b-6964-4039-885e-12b3056eaee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:22.918580 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-9c587a1b-6964-4039-885e-12b3056eaee7 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:08:22.919892 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-9c587a1b-6964-4039-885e-12b3056eaee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:23.031973 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:08:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:08:23.190040 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa8974-a237-486b-b190-2f28cad56c84 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:08:23.192470 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-feaa8974-a237-486b-b190-2f28cad56c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:23.336004 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa8974-a237-486b-b190-2f28cad56c84 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:08:23.342823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a732ce-59f6-45cf-b6c0-79edefe311fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:08:23.343625 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a732ce-59f6-45cf-b6c0-79edefe311fc service nova] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:23.343958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a732ce-59f6-45cf-b6c0-79edefe311fc service nova] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:23.344292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a732ce-59f6-45cf-b6c0-79edefe311fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:23.354462 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a732ce-59f6-45cf-b6c0-79edefe311fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:08:23.356191 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a732ce-59f6-45cf-b6c0-79edefe311fc service nova] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:08:23.366121 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 759/1513] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:08:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:08:24.230703 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d258b-43c3-4e81-90c1-1525da8d38ba None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:24.231283 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d258b-43c3-4e81-90c1-1525da8d38ba None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:24.231283 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d258b-43c3-4e81-90c1-1525da8d38ba None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:24.232574 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:08:24.237808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df46abf-6911-4291-be93-85210997b7e7 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:24.238347 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df46abf-6911-4291-be93-85210997b7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:24.238347 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df46abf-6911-4291-be93-85210997b7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:24.260155 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-0df46abf-6911-4291-be93-85210997b7e7 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:08:24.261406 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-0df46abf-6911-4291-be93-85210997b7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:24.269951 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:08:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:08:24.428768 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d258b-43c3-4e81-90c1-1525da8d38ba None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:08:24.443795 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d258b-43c3-4e81-90c1-1525da8d38ba None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:08:24.450594 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b59639-4807-424d-992d-4f2ea47a6ace service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:08:24.451262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b59639-4807-424d-992d-4f2ea47a6ace service nova] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:24.451538 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b59639-4807-424d-992d-4f2ea47a6ace service nova] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:24.451809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b59639-4807-424d-992d-4f2ea47a6ace service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:24.462786 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b59639-4807-424d-992d-4f2ea47a6ace service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:08:24.464440 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b59639-4807-424d-992d-4f2ea47a6ace service nova] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:08:24.475773 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 756/1516] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:08:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:08:25.383152 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d334fb6-6c3c-4ec6-bf4d-2eb74117e75e None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:25.383770 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d334fb6-6c3c-4ec6-bf4d-2eb74117e75e None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:25.383770 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d334fb6-6c3c-4ec6-bf4d-2eb74117e75e None None] PATH_INFO: `/v3` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:25.384993 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 761/1517] 10.222.0.47 () {54 vars in 925 bytes} [Wed Aug 24 17:08:25 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:08:25.398574 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7857f-09ce-4110-b088-deccce5eb75a None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:25.399305 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7857f-09ce-4110-b088-deccce5eb75a None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:25.399305 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc7857f-09ce-4110-b088-deccce5eb75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:25.465404 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-0dc7857f-09ce-4110-b088-deccce5eb75a None None] MFA Rules not processed for user `32ef97356edf406aad9ab5f502bdb0af`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:08:25.466689 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-0dc7857f-09ce-4110-b088-deccce5eb75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:25.485804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:25.543579 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 757/1518] 10.222.0.47 () {58 vars in 1015 bytes} [Wed Aug 24 17:08:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:08:29.736737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d3d5e-e2f0-4623-94c9-ffd8fce4d8e4 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:29.737307 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d3d5e-e2f0-4623-94c9-ffd8fce4d8e4 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:29.737307 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d3d5e-e2f0-4623-94c9-ffd8fce4d8e4 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:29.738623 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 762/1519] 10.222.0.55 () {54 vars in 961 bytes} [Wed Aug 24 17:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:08:29.744113 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18c72f-44e6-44f0-9802-2afddf6e4db1 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:29.744600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18c72f-44e6-44f0-9802-2afddf6e4db1 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:29.744797 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18c72f-44e6-44f0-9802-2afddf6e4db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:29.765812 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-ce18c72f-44e6-44f0-9802-2afddf6e4db1 None None] MFA Rules not processed for user `32ef97356edf406aad9ab5f502bdb0af`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:08:29.767030 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-ce18c72f-44e6-44f0-9802-2afddf6e4db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:29.777236 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 758/1520] 10.222.0.55 () {58 vars in 1058 bytes} [Wed Aug 24 17:08:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:08:29.784959 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d3d5e-e2f0-4623-94c9-ffd8fce4d8e4 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:08:29.798885 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d3d5e-e2f0-4623-94c9-ffd8fce4d8e4 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:08:29.804027 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6cfcc-3ecf-4247-a11a-a3b71727601d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ef97356edf406aad9ab5f502bdb0af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:08:29.804665 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6cfcc-3ecf-4247-a11a-a3b71727601d service placement] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:29.804942 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6cfcc-3ecf-4247-a11a-a3b71727601d service placement] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:29.805300 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6cfcc-3ecf-4247-a11a-a3b71727601d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:29.813808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f6cfcc-3ecf-4247-a11a-a3b71727601d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:08:29.815419 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f6cfcc-3ecf-4247-a11a-a3b71727601d service placement] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:08:29.826005 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 763/1521] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:08:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:08:35.938833 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a66ebb-329a-46f9-92ef-4fa981afeea2 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:35.939431 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a66ebb-329a-46f9-92ef-4fa981afeea2 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:35.939431 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a66ebb-329a-46f9-92ef-4fa981afeea2 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:35.940696 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:08:35.945998 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22005a7-b1db-421f-967e-186c857de9a5 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:35.946704 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22005a7-b1db-421f-967e-186c857de9a5 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:35.946704 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22005a7-b1db-421f-967e-186c857de9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:35.966839 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-a22005a7-b1db-421f-967e-186c857de9a5 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:08:35.968161 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-a22005a7-b1db-421f-967e-186c857de9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:35.978543 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:08:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:08:36.136090 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a66ebb-329a-46f9-92ef-4fa981afeea2 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:08:36.156589 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a66ebb-329a-46f9-92ef-4fa981afeea2 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:08:36.162007 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9863a-b97b-4261-8b04-da89417f5779 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:08:36.162622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9863a-b97b-4261-8b04-da89417f5779 service nova] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:36.162898 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9863a-b97b-4261-8b04-da89417f5779 service nova] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:36.163209 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9863a-b97b-4261-8b04-da89417f5779 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:36.174092 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9863a-b97b-4261-8b04-da89417f5779 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:08:36.178476 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9863a-b97b-4261-8b04-da89417f5779 service nova] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:08:36.185690 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 760/1524] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:08:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:08:37.046267 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f553a1-eb93-4ea6-b8a0-a6a68a4849e7 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:37.046828 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f553a1-eb93-4ea6-b8a0-a6a68a4849e7 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:37.046828 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f553a1-eb93-4ea6-b8a0-a6a68a4849e7 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:37.048238 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 17:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:08:37.055000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b3139-36b0-44ed-a2c4-737bf83a2325 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:37.055627 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b3139-36b0-44ed-a2c4-737bf83a2325 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:37.055949 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b3139-36b0-44ed-a2c4-737bf83a2325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:37.081576 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-012b3139-36b0-44ed-a2c4-737bf83a2325 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:08:37.082869 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-012b3139-36b0-44ed-a2c4-737bf83a2325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:37.091923 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 17:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:08:37.251269 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f553a1-eb93-4ea6-b8a0-a6a68a4849e7 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:08:37.270020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f553a1-eb93-4ea6-b8a0-a6a68a4849e7 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:08:37.277682 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe90d0e-2f24-4f92-9391-006674563fbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:08:37.278313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe90d0e-2f24-4f92-9391-006674563fbe service nova] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:37.278590 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe90d0e-2f24-4f92-9391-006674563fbe service nova] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:37.278861 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe90d0e-2f24-4f92-9391-006674563fbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:37.288773 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe90d0e-2f24-4f92-9391-006674563fbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:08:37.290888 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe90d0e-2f24-4f92-9391-006674563fbe service nova] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:08:37.302339 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 766/1527] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:08:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:08:41.360166 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eeb240-93f4-412e-9bfd-bd61420b776d None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:41.360795 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eeb240-93f4-412e-9bfd-bd61420b776d None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:41.360795 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eeb240-93f4-412e-9bfd-bd61420b776d None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:41.362038 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:08:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:08:41.368151 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4899c6-7339-4e74-b510-612e145f5d3e None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:41.368991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4899c6-7339-4e74-b510-612e145f5d3e None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:41.369154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4899c6-7339-4e74-b510-612e145f5d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:41.389670 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-ee4899c6-7339-4e74-b510-612e145f5d3e None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:08:41.390911 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-ee4899c6-7339-4e74-b510-612e145f5d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:41.400451 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:08:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:08:41.693480 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eeb240-93f4-412e-9bfd-bd61420b776d None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:08:41.695913 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-38eeb240-93f4-412e-9bfd-bd61420b776d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:41.787286 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eeb240-93f4-412e-9bfd-bd61420b776d None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:08:41.794412 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18c7a6-054e-4298-92fd-63307a277f95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:08:41.795438 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18c7a6-054e-4298-92fd-63307a277f95 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:41.795817 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18c7a6-054e-4298-92fd-63307a277f95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:41.796190 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18c7a6-054e-4298-92fd-63307a277f95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:41.807690 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18c7a6-054e-4298-92fd-63307a277f95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:08:41.809170 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18c7a6-054e-4298-92fd-63307a277f95 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:08:41.824390 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 763/1530] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:08:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:08:43.859718 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40982783-8929-47c3-b99a-0e3ed820b920 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:43.860294 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40982783-8929-47c3-b99a-0e3ed820b920 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:43.860294 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40982783-8929-47c3-b99a-0e3ed820b920 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:43.861650 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:08:43.868510 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27175ab-9f05-498e-bd0a-2f8ae00ece2e None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:43.869056 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27175ab-9f05-498e-bd0a-2f8ae00ece2e None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:43.869056 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27175ab-9f05-498e-bd0a-2f8ae00ece2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:43.891416 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-a27175ab-9f05-498e-bd0a-2f8ae00ece2e None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:08:43.892936 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-a27175ab-9f05-498e-bd0a-2f8ae00ece2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:43.901205 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:08:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:08:44.203525 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40982783-8929-47c3-b99a-0e3ed820b920 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:08:44.214708 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40982783-8929-47c3-b99a-0e3ed820b920 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:08:44.218492 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb14c2a7-0423-499c-bcb4-b9d25d82030b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:08:44.219150 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14c2a7-0423-499c-bcb4-b9d25d82030b service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:44.219439 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14c2a7-0423-499c-bcb4-b9d25d82030b service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:44.219717 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb14c2a7-0423-499c-bcb4-b9d25d82030b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:44.229745 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14c2a7-0423-499c-bcb4-b9d25d82030b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:08:44.231222 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb14c2a7-0423-499c-bcb4-b9d25d82030b service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:08:44.242464 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 769/1533] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:08:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:08:47.926500 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42222242-0d56-4401-a141-192bd0a4b81b None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:47.927176 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42222242-0d56-4401-a141-192bd0a4b81b None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:47.927176 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42222242-0d56-4401-a141-192bd0a4b81b None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:47.929018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:08:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:08:47.934683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da696051-6435-437e-8b53-55c87b43dbd4 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:47.935219 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da696051-6435-437e-8b53-55c87b43dbd4 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:47.935340 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da696051-6435-437e-8b53-55c87b43dbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:47.957168 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-da696051-6435-437e-8b53-55c87b43dbd4 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:08:47.958405 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-da696051-6435-437e-8b53-55c87b43dbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:47.967014 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:08:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:08:48.534223 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42222242-0d56-4401-a141-192bd0a4b81b None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:08:48.536079 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-42222242-0d56-4401-a141-192bd0a4b81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:48.609685 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:08:48.626049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42222242-0d56-4401-a141-192bd0a4b81b None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:08:48.629661 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760014a4-7409-4a1b-9677-c36090d81868 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:08:48.630344 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760014a4-7409-4a1b-9677-c36090d81868 service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:48.630670 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760014a4-7409-4a1b-9677-c36090d81868 service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:48.630942 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760014a4-7409-4a1b-9677-c36090d81868 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:48.642221 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760014a4-7409-4a1b-9677-c36090d81868 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:08:48.643708 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760014a4-7409-4a1b-9677-c36090d81868 service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:08:48.655344 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 766/1536] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:08:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:08:50.668815 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472acda7-e3e6-4027-9054-3321721b0a35 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:50.669405 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472acda7-e3e6-4027-9054-3321721b0a35 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:50.669672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472acda7-e3e6-4027-9054-3321721b0a35 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:50.671969 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 17:08:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:08:50.678866 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551d112-c0c8-4d9e-93d0-6f61905c6a4e None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:50.679458 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551d112-c0c8-4d9e-93d0-6f61905c6a4e None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:50.679565 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551d112-c0c8-4d9e-93d0-6f61905c6a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:50.699673 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-a551d112-c0c8-4d9e-93d0-6f61905c6a4e None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:08:50.700921 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-a551d112-c0c8-4d9e-93d0-6f61905c6a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:50.709384 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 17:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:08:51.277470 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472acda7-e3e6-4027-9054-3321721b0a35 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:08:51.279155 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-472acda7-e3e6-4027-9054-3321721b0a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:08:51.292671 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472acda7-e3e6-4027-9054-3321721b0a35 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:08:51.299080 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b9c86b-6948-4ef5-8670-10a99e8fcea9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:08:51.299080 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9c86b-6948-4ef5-8670-10a99e8fcea9 service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:08:51.299080 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9c86b-6948-4ef5-8670-10a99e8fcea9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:08:51.299080 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b9c86b-6948-4ef5-8670-10a99e8fcea9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:08:51.307331 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b9c86b-6948-4ef5-8670-10a99e8fcea9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:08:51.308764 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b9c86b-6948-4ef5-8670-10a99e8fcea9 service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:08:51.319591 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 772/1539] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:08:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:09:00.694230 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=11 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:09:01.314269 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=89 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:23.909814 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad6430-50fa-4f51-93c5-3876e61354c5 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:23.910479 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad6430-50fa-4f51-93c5-3876e61354c5 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:23.910479 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad6430-50fa-4f51-93c5-3876e61354c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:23.939535 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-37ad6430-50fa-4f51-93c5-3876e61354c5 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:23.939535 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-37ad6430-50fa-4f51-93c5-3876e61354c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:23.951216 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 768/1540] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:23.960396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0657a2-3e08-4817-b375-3ea3b433acda None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:23.961048 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0657a2-3e08-4817-b375-3ea3b433acda None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:23.961048 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0657a2-3e08-4817-b375-3ea3b433acda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:23.970360 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c7bd5-ca07-4632-946b-95ec27b1606f None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:23.971032 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c7bd5-ca07-4632-946b-95ec27b1606f None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:23.971728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16c7bd5-ca07-4632-946b-95ec27b1606f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:23.995436 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-8f0657a2-3e08-4817-b375-3ea3b433acda None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:23.996849 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-8f0657a2-3e08-4817-b375-3ea3b433acda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:24.010104 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 773/1541] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:24.011489 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-c16c7bd5-ca07-4632-946b-95ec27b1606f None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:24.013103 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-c16c7bd5-ca07-4632-946b-95ec27b1606f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:24.020637 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0657a2-3e08-4817-b375-3ea3b433acda None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:24.031539 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0657a2-3e08-4817-b375-3ea3b433acda None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:24.033614 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 769/1542] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:10:24.042611 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a166b-3103-4393-a90d-70b03139eca6 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:24.043104 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b09b8-1172-445f-9ddd-2563bb11f99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:24.043643 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a166b-3103-4393-a90d-70b03139eca6 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:24.043864 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b09b8-1172-445f-9ddd-2563bb11f99c admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:24.044125 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b09b8-1172-445f-9ddd-2563bb11f99c admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:24.044397 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b09b8-1172-445f-9ddd-2563bb11f99c admin admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:24.044763 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a166b-3103-4393-a90d-70b03139eca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:24.045058 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b09b8-1172-445f-9ddd-2563bb11f99c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:10:24.045363 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b09b8-1172-445f-9ddd-2563bb11f99c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:24.046387 dv-cinder-779578-5-smb devstack@keystone.service[81761]: WARNING py.warnings [None req-7d4b09b8-1172-445f-9ddd-2563bb11f99c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:10:24.046387 dv-cinder-779578-5-smb devstack@keystone.service[81761]: warnings.warn(msg) Aug 24 17:10:24.046387 dv-cinder-779578-5-smb devstack@keystone.service[81761]: Aug 24 17:10:24.051545 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b09b8-1172-445f-9ddd-2563bb11f99c admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:24.071731 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 774/1543] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:10:24.087449 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-766a166b-3103-4393-a90d-70b03139eca6 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:24.088027 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b09b8-1172-445f-9ddd-2563bb11f99c admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:24.089847 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-766a166b-3103-4393-a90d-70b03139eca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:24.110897 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 770/1544] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:10:24.111154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b09b8-1172-445f-9ddd-2563bb11f99c admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:24.116008 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a166b-3103-4393-a90d-70b03139eca6 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:24.119280 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2aee91a-e6b8-445e-a181-0b0bd6f9aa65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:24.119912 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aee91a-e6b8-445e-a181-0b0bd6f9aa65 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:24.120199 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aee91a-e6b8-445e-a181-0b0bd6f9aa65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:24.120475 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aee91a-e6b8-445e-a181-0b0bd6f9aa65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:24.121279 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aee91a-e6b8-445e-a181-0b0bd6f9aa65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:24.127220 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2aee91a-e6b8-445e-a181-0b0bd6f9aa65 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:24.138089 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a166b-3103-4393-a90d-70b03139eca6 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:24.159959 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fcc98a-764f-45f9-b251-952238834612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:24.161005 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcc98a-764f-45f9-b251-952238834612 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:24.161841 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcc98a-764f-45f9-b251-952238834612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:24.162359 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fcc98a-764f-45f9-b251-952238834612 admin admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:24.163699 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fcc98a-764f-45f9-b251-952238834612 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:10:24.164230 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fcc98a-764f-45f9-b251-952238834612 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:24.166152 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fcc98a-764f-45f9-b251-952238834612 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:24.190726 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 771/1545] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:10:24.192536 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc090338-9790-4a7f-b93c-205f58b1fc95 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:24.193045 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc090338-9790-4a7f-b93c-205f58b1fc95 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:24.193527 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc090338-9790-4a7f-b93c-205f58b1fc95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:24.229155 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-fc090338-9790-4a7f-b93c-205f58b1fc95 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:24.230851 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-fc090338-9790-4a7f-b93c-205f58b1fc95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:24.241175 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 775/1546] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:10:24 2022] POST /identity/v3/projects => generated 405 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:10:24.242467 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed8c69-613f-4608-a53f-f83d79a962d5 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:24.242755 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed8c69-613f-4608-a53f-f83d79a962d5 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:24.243034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed8c69-613f-4608-a53f-f83d79a962d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:24.244568 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 772/1547] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:24.245808 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc090338-9790-4a7f-b93c-205f58b1fc95 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:24.269728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc090338-9790-4a7f-b93c-205f58b1fc95 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:24.286267 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-62ed8c69-613f-4608-a53f-f83d79a962d5 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:24.288236 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-62ed8c69-613f-4608-a53f-f83d79a962d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:24.379977 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 776/1548] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:24.381594 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed8c69-613f-4608-a53f-f83d79a962d5 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:24.391693 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed8c69-613f-4608-a53f-f83d79a962d5 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:24.393323 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3eba3f-f4e4-4ad3-97e0-dab40d39ae8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:24.394138 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eba3f-f4e4-4ad3-97e0-dab40d39ae8c admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:24.394420 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eba3f-f4e4-4ad3-97e0-dab40d39ae8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:24.394698 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3eba3f-f4e4-4ad3-97e0-dab40d39ae8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:24.395488 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3eba3f-f4e4-4ad3-97e0-dab40d39ae8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:24.396460 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54205bb1-e71b-4e42-9f7c-0af1aa4e5e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:24.396609 dv-cinder-779578-5-smb devstack@keystone.service[81760]: WARNING py.warnings [None req-ba3eba3f-f4e4-4ad3-97e0-dab40d39ae8c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:10:24.396609 dv-cinder-779578-5-smb devstack@keystone.service[81760]: warnings.warn(msg) Aug 24 17:10:24.396609 dv-cinder-779578-5-smb devstack@keystone.service[81760]: Aug 24 17:10:24.397068 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54205bb1-e71b-4e42-9f7c-0af1aa4e5e98 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:24.397349 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54205bb1-e71b-4e42-9f7c-0af1aa4e5e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:24.397623 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54205bb1-e71b-4e42-9f7c-0af1aa4e5e98 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:24.397776 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3eba3f-f4e4-4ad3-97e0-dab40d39ae8c admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:24.398249 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54205bb1-e71b-4e42-9f7c-0af1aa4e5e98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:24.399308 dv-cinder-779578-5-smb devstack@keystone.service[81761]: WARNING py.warnings [None req-54205bb1-e71b-4e42-9f7c-0af1aa4e5e98 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:10:24.399308 dv-cinder-779578-5-smb devstack@keystone.service[81761]: warnings.warn(msg) Aug 24 17:10:24.399308 dv-cinder-779578-5-smb devstack@keystone.service[81761]: Aug 24 17:10:24.400524 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54205bb1-e71b-4e42-9f7c-0af1aa4e5e98 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:24.527053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 777/1549] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:10:24 2022] POST /identity/v3/users => generated 303 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:24.528404 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771f1a3-31d2-4395-9cfb-cca03331f19b None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:24.528695 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771f1a3-31d2-4395-9cfb-cca03331f19b None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:24.528974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771f1a3-31d2-4395-9cfb-cca03331f19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:24.550434 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-5771f1a3-31d2-4395-9cfb-cca03331f19b None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:24.556575 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-5771f1a3-31d2-4395-9cfb-cca03331f19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:24.556714 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 773/1550] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:10:24 2022] POST /identity/v3/projects => generated 393 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:24.556714 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df300d7-7d60-4239-a300-04d702dfec33 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:24.556714 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df300d7-7d60-4239-a300-04d702dfec33 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:24.556714 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df300d7-7d60-4239-a300-04d702dfec33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:24.575685 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-7df300d7-7d60-4239-a300-04d702dfec33 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:24.576924 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-7df300d7-7d60-4239-a300-04d702dfec33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:24.615941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 778/1551] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:24.617285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614732f3-1d7e-4a40-bcf4-39f2a8bb89e8 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:24.617571 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614732f3-1d7e-4a40-bcf4-39f2a8bb89e8 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:24.617840 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614732f3-1d7e-4a40-bcf4-39f2a8bb89e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:24.638600 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-614732f3-1d7e-4a40-bcf4-39f2a8bb89e8 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:24.639725 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-614732f3-1d7e-4a40-bcf4-39f2a8bb89e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:24.647049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 774/1552] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:24.648241 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 779/1553] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:24.648383 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a329929-2169-4277-b6e1-e103aee95eb4 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:24.648600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a329929-2169-4277-b6e1-e103aee95eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:24.648869 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a329929-2169-4277-b6e1-e103aee95eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:24.649256 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb142de3-0cd4-44f0-b788-4870fdbb517e None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:24.649538 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb142de3-0cd4-44f0-b788-4870fdbb517e None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:24.649819 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb142de3-0cd4-44f0-b788-4870fdbb517e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:24.673442 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-bb142de3-0cd4-44f0-b788-4870fdbb517e None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:24.674711 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-bb142de3-0cd4-44f0-b788-4870fdbb517e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:24.674831 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-2a329929-2169-4277-b6e1-e103aee95eb4 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:24.676049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-2a329929-2169-4277-b6e1-e103aee95eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:24.682620 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 780/1554] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:24.690256 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb65fa6-f544-48eb-bc5c-2834b78cc3ad None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:24.690256 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb65fa6-f544-48eb-bc5c-2834b78cc3ad None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:24.690256 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb65fa6-f544-48eb-bc5c-2834b78cc3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:24.690591 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 775/1555] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:24.690591 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a329929-2169-4277-b6e1-e103aee95eb4 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:24.699615 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a329929-2169-4277-b6e1-e103aee95eb4 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:24.704337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-3bb65fa6-f544-48eb-bc5c-2834b78cc3ad None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:24.705306 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89b602-11d6-4d01-aa02-0038971ae353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:24.705546 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-3bb65fa6-f544-48eb-bc5c-2834b78cc3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:24.705923 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89b602-11d6-4d01-aa02-0038971ae353 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:24.706203 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89b602-11d6-4d01-aa02-0038971ae353 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:24.706474 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c89b602-11d6-4d01-aa02-0038971ae353 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:24.707142 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89b602-11d6-4d01-aa02-0038971ae353 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:24.708750 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c89b602-11d6-4d01-aa02-0038971ae353 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:24.713558 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 781/1556] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:24.714443 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb65fa6-f544-48eb-bc5c-2834b78cc3ad None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:24.726577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 776/1557] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:24.726577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89b602-11d6-4d01-aa02-0038971ae353 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:24.726980 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb65fa6-f544-48eb-bc5c-2834b78cc3ad None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:24.730051 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accc640-291c-42ad-aff9-f5588721a025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:24.730667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accc640-291c-42ad-aff9-f5588721a025 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:24.730947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accc640-291c-42ad-aff9-f5588721a025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:24.731253 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7accc640-291c-42ad-aff9-f5588721a025 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:24.731939 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7accc640-291c-42ad-aff9-f5588721a025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:24.733848 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7accc640-291c-42ad-aff9-f5588721a025 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:24.734601 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c89b602-11d6-4d01-aa02-0038971ae353 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:24.739376 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465dad0c-c3a0-4f0e-ad4c-3822f3c2f629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:24.739983 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dad0c-c3a0-4f0e-ad4c-3822f3c2f629 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:24.740262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dad0c-c3a0-4f0e-ad4c-3822f3c2f629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:24.740535 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dad0c-c3a0-4f0e-ad4c-3822f3c2f629 admin admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:24.741240 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465dad0c-c3a0-4f0e-ad4c-3822f3c2f629 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:10:24.741541 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465dad0c-c3a0-4f0e-ad4c-3822f3c2f629 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:24.743173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465dad0c-c3a0-4f0e-ad4c-3822f3c2f629 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:24.745847 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:24.757207 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 777/1558] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:10:24.758643 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c68e5-c28c-4ae1-bdc6-694cff362493 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:24.758927 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c68e5-c28c-4ae1-bdc6-694cff362493 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:24.759239 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c68e5-c28c-4ae1-bdc6-694cff362493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:24.778912 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-897c68e5-c28c-4ae1-bdc6-694cff362493 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:24.780165 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-897c68e5-c28c-4ae1-bdc6-694cff362493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:24.788672 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 778/1559] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:24.789886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26234845-5836-449c-af64-0d89733ac8d0 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:24.790170 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26234845-5836-449c-af64-0d89733ac8d0 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:24.790446 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26234845-5836-449c-af64-0d89733ac8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:24.810397 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-26234845-5836-449c-af64-0d89733ac8d0 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:24.811673 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-26234845-5836-449c-af64-0d89733ac8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:24.820276 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 779/1560] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:24.822360 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2332aa6-8ea5-4c1c-aab7-c4843f9c42dc None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:24.822360 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2332aa6-8ea5-4c1c-aab7-c4843f9c42dc None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:24.822360 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2332aa6-8ea5-4c1c-aab7-c4843f9c42dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:24.829738 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:24.841595 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-c2332aa6-8ea5-4c1c-aab7-c4843f9c42dc None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:24.842818 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-c2332aa6-8ea5-4c1c-aab7-c4843f9c42dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:24.850885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 780/1561] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:24.863344 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfabfcc-d768-4bb1-ac49-6fb7ef4bc1df None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:24.863344 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfabfcc-d768-4bb1-ac49-6fb7ef4bc1df None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:24.863344 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfabfcc-d768-4bb1-ac49-6fb7ef4bc1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:24.873876 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-0bfabfcc-d768-4bb1-ac49-6fb7ef4bc1df None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:24.876369 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-0bfabfcc-d768-4bb1-ac49-6fb7ef4bc1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:24.884278 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 781/1562] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:24.885085 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfabfcc-d768-4bb1-ac49-6fb7ef4bc1df None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:24.891995 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 782/1563] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:10:24 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:24.891995 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accc640-291c-42ad-aff9-f5588721a025 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:24.896662 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfabfcc-d768-4bb1-ac49-6fb7ef4bc1df None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:24.901362 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7accc640-291c-42ad-aff9-f5588721a025 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:24.901529 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf8ff6-a4b1-419e-86d4-ede8637da4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:24.902123 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf8ff6-a4b1-419e-86d4-ede8637da4b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:24.902308 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf8ff6-a4b1-419e-86d4-ede8637da4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:24.902636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdf8ff6-a4b1-419e-86d4-ede8637da4b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:24.903442 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf8ff6-a4b1-419e-86d4-ede8637da4b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:10:24.903746 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf8ff6-a4b1-419e-86d4-ede8637da4b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:24.905393 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdf8ff6-a4b1-419e-86d4-ede8637da4b7 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:24.907259 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25fd8b-5b0f-45c1-b8ce-1f493bf9f1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:24.908007 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25fd8b-5b0f-45c1-b8ce-1f493bf9f1c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:24.908294 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25fd8b-5b0f-45c1-b8ce-1f493bf9f1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:24.908705 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da25fd8b-5b0f-45c1-b8ce-1f493bf9f1c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:24.909398 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da25fd8b-5b0f-45c1-b8ce-1f493bf9f1c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:24.911016 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da25fd8b-5b0f-45c1-b8ce-1f493bf9f1c6 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:24.918322 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 782/1564] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:10:24.920684 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf8ff6-a4b1-419e-86d4-ede8637da4b7 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:24.923531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 783/1565] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:24.924490 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25fd8b-5b0f-45c1-b8ce-1f493bf9f1c6 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:24.934134 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdf8ff6-a4b1-419e-86d4-ede8637da4b7 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:24.934715 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da25fd8b-5b0f-45c1-b8ce-1f493bf9f1c6 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:24.940108 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2024db-5cab-4d41-ae6a-f3ba678c9bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:24.940337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5720c8b-622e-463d-a530-9a3406371a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:24.940723 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2024db-5cab-4d41-ae6a-f3ba678c9bfa admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:24.940944 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5720c8b-622e-463d-a530-9a3406371a68 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:24.941043 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2024db-5cab-4d41-ae6a-f3ba678c9bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:24.941223 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5720c8b-622e-463d-a530-9a3406371a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:24.941329 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2024db-5cab-4d41-ae6a-f3ba678c9bfa admin admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:24.941495 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5720c8b-622e-463d-a530-9a3406371a68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:24.941907 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2024db-5cab-4d41-ae6a-f3ba678c9bfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:10:24.942118 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5720c8b-622e-463d-a530-9a3406371a68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:24.942233 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2024db-5cab-4d41-ae6a-f3ba678c9bfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:24.943841 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2024db-5cab-4d41-ae6a-f3ba678c9bfa admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:24.944103 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5720c8b-622e-463d-a530-9a3406371a68 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:24.956366 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 784/1566] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:10:24.957223 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2024db-5cab-4d41-ae6a-f3ba678c9bfa admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:24.967077 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2024db-5cab-4d41-ae6a-f3ba678c9bfa admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:24.972414 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4957d32-6fa8-45f4-a685-ac3fed62bfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:24.978012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4957d32-6fa8-45f4-a685-ac3fed62bfe8 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:24.978012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4957d32-6fa8-45f4-a685-ac3fed62bfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:24.978012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4957d32-6fa8-45f4-a685-ac3fed62bfe8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:24.978012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4957d32-6fa8-45f4-a685-ac3fed62bfe8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:10:24.978012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4957d32-6fa8-45f4-a685-ac3fed62bfe8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:24.978012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4957d32-6fa8-45f4-a685-ac3fed62bfe8 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:24.988997 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 785/1567] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:10:24.989999 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4957d32-6fa8-45f4-a685-ac3fed62bfe8 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:25.000499 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4957d32-6fa8-45f4-a685-ac3fed62bfe8 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:25.005613 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c0310-c43b-43c1-84b1-92f6b1ae270c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:25.006221 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c0310-c43b-43c1-84b1-92f6b1ae270c admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:25.006671 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c0310-c43b-43c1-84b1-92f6b1ae270c admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:25.006919 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c0310-c43b-43c1-84b1-92f6b1ae270c admin admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:25.007434 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c0310-c43b-43c1-84b1-92f6b1ae270c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:10:25.007738 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c0310-c43b-43c1-84b1-92f6b1ae270c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:25.009349 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c0310-c43b-43c1-84b1-92f6b1ae270c admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:25.022181 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 786/1568] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:10:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:10:25.023082 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c0310-c43b-43c1-84b1-92f6b1ae270c admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:25.037164 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 783/1569] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:10:24 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:25.037365 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c0310-c43b-43c1-84b1-92f6b1ae270c admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:25.037465 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5720c8b-622e-463d-a530-9a3406371a68 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:25.097247 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4c94d-d8c1-4ada-a19d-4fbfdbd27c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:25.097872 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4c94d-d8c1-4ada-a19d-4fbfdbd27c30 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:25.098156 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4c94d-d8c1-4ada-a19d-4fbfdbd27c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:25.098274 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5720c8b-622e-463d-a530-9a3406371a68 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:25.098433 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4c94d-d8c1-4ada-a19d-4fbfdbd27c30 admin admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:25.099082 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4c94d-d8c1-4ada-a19d-4fbfdbd27c30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:10:25.099417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4c94d-d8c1-4ada-a19d-4fbfdbd27c30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:25.101034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4c94d-d8c1-4ada-a19d-4fbfdbd27c30 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:25.103103 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5186d-5b88-4c33-a236-165c6b79b23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:25.103736 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5186d-5b88-4c33-a236-165c6b79b23f admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:25.104016 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5186d-5b88-4c33-a236-165c6b79b23f admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:25.104289 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5186d-5b88-4c33-a236-165c6b79b23f admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:25.104931 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5186d-5b88-4c33-a236-165c6b79b23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:25.106521 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5186d-5b88-4c33-a236-165c6b79b23f admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:25.113970 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 787/1570] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:10:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:10:25.114873 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4c94d-d8c1-4ada-a19d-4fbfdbd27c30 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:25.127700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 784/1571] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:25.127912 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4c94d-d8c1-4ada-a19d-4fbfdbd27c30 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:25.128017 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5186d-5b88-4c33-a236-165c6b79b23f admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:25.130594 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bf5e7-2981-40be-bd92-27561d2c361d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:25.131307 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bf5e7-2981-40be-bd92-27561d2c361d admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:25.131585 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bf5e7-2981-40be-bd92-27561d2c361d admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:25.131854 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294bf5e7-2981-40be-bd92-27561d2c361d admin admin] PATH_INFO: `/v3/projects/96a3350f9fd7421fbddddad58c64c939/users/8e7265f14108492191ccc4f6b3bf7548/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:25.136684 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5186d-5b88-4c33-a236-165c6b79b23f admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:25.142177 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9df5e-7512-4eb7-992b-278074d5097b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:25.142869 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9df5e-7512-4eb7-992b-278074d5097b admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:25.143187 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9df5e-7512-4eb7-992b-278074d5097b admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:25.143464 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9df5e-7512-4eb7-992b-278074d5097b admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:25.144119 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9df5e-7512-4eb7-992b-278074d5097b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:25.146092 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e9df5e-7512-4eb7-992b-278074d5097b admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:25.149199 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294bf5e7-2981-40be-bd92-27561d2c361d admin admin] RBAC: Authorizing `identity:create_grant(project_id=96a3350f9fd7421fbddddad58c64c939, user_id=8e7265f14108492191ccc4f6b3bf7548, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:25.151856 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294bf5e7-2981-40be-bd92-27561d2c361d admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:25.250385 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 788/1572] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:10:25 2022] PUT /identity/v3/projects/96a3350f9fd7421fbddddad58c64c939/users/8e7265f14108492191ccc4f6b3bf7548/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:25.251752 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bf5e7-2981-40be-bd92-27561d2c361d admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:25.289177 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 785/1573] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:10:25 2022] POST /identity/v3/projects => generated 403 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:25.289177 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9df5e-7512-4eb7-992b-278074d5097b admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:25.328927 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294bf5e7-2981-40be-bd92-27561d2c361d admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:25.357674 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:25.359675 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e9df5e-7512-4eb7-992b-278074d5097b admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:25.364845 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf553d3-c2f3-4f2c-a38a-2c051e0ebd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:25.365485 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf553d3-c2f3-4f2c-a38a-2c051e0ebd87 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:25.365759 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf553d3-c2f3-4f2c-a38a-2c051e0ebd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:25.366038 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf553d3-c2f3-4f2c-a38a-2c051e0ebd87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:25.366666 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf553d3-c2f3-4f2c-a38a-2c051e0ebd87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:25.368634 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf553d3-c2f3-4f2c-a38a-2c051e0ebd87 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:25.400247 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471a9f5-3289-491d-a0a7-48cde035acc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:25.400815 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471a9f5-3289-491d-a0a7-48cde035acc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:25.401086 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471a9f5-3289-491d-a0a7-48cde035acc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:25.401409 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b471a9f5-3289-491d-a0a7-48cde035acc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:25.402109 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471a9f5-3289-491d-a0a7-48cde035acc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:25.404179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b471a9f5-3289-491d-a0a7-48cde035acc1 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:25.506486 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 786/1574] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:10:25 2022] POST /identity/v3/projects => generated 379 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:25.507520 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf553d3-c2f3-4f2c-a38a-2c051e0ebd87 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:25.521566 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:25.537606 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 789/1575] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:10:25 2022] POST /identity/v3/projects => generated 385 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:25.544600 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471a9f5-3289-491d-a0a7-48cde035acc1 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:25.577550 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf553d3-c2f3-4f2c-a38a-2c051e0ebd87 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:25.604875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b471a9f5-3289-491d-a0a7-48cde035acc1 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:25.609888 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ceb44-e049-4cd0-a552-3dcf34ddcbe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:25.610488 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ceb44-e049-4cd0-a552-3dcf34ddcbe9 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:25.610784 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ceb44-e049-4cd0-a552-3dcf34ddcbe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:25.611033 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ceb44-e049-4cd0-a552-3dcf34ddcbe9 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:25.611682 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ceb44-e049-4cd0-a552-3dcf34ddcbe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:25.613659 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ceb44-e049-4cd0-a552-3dcf34ddcbe9 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:25.640714 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03da3e-39dd-4742-a792-f33916c3e5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:25.641906 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03da3e-39dd-4742-a792-f33916c3e5b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:25.642143 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03da3e-39dd-4742-a792-f33916c3e5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:25.642412 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03da3e-39dd-4742-a792-f33916c3e5b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:25.643043 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03da3e-39dd-4742-a792-f33916c3e5b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:25.644988 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03da3e-39dd-4742-a792-f33916c3e5b7 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:25.724841 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 790/1576] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:10:25 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:25.725569 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ceb44-e049-4cd0-a552-3dcf34ddcbe9 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:25.736070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ceb44-e049-4cd0-a552-3dcf34ddcbe9 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:25.740192 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 787/1577] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:10:25 2022] POST /identity/v3/projects => generated 375 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:25.740192 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03da3e-39dd-4742-a792-f33916c3e5b7 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:25.799248 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09d9b9-c173-48b0-aa33-0cfda3a23b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:25.800332 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09d9b9-c173-48b0-aa33-0cfda3a23b01 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:25.800332 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09d9b9-c173-48b0-aa33-0cfda3a23b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:25.800555 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09d9b9-c173-48b0-aa33-0cfda3a23b01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:25.800997 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c09d9b9-c173-48b0-aa33-0cfda3a23b01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:25.803192 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c09d9b9-c173-48b0-aa33-0cfda3a23b01 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:25.803729 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03da3e-39dd-4742-a792-f33916c3e5b7 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:25.808566 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd478b0-1154-4229-8468-9f34816c7bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:25.809098 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd478b0-1154-4229-8468-9f34816c7bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:25.809375 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd478b0-1154-4229-8468-9f34816c7bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:25.809642 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd478b0-1154-4229-8468-9f34816c7bb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:25.810282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd478b0-1154-4229-8468-9f34816c7bb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:25.813381 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd478b0-1154-4229-8468-9f34816c7bb9 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:25.824465 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 788/1578] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:25.825900 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fa8c7-2da7-42eb-98fd-8b73e8434a5e None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:25.826183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fa8c7-2da7-42eb-98fd-8b73e8434a5e None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:25.826492 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fa8c7-2da7-42eb-98fd-8b73e8434a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:25.847687 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-903fa8c7-2da7-42eb-98fd-8b73e8434a5e None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:25.848032 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-903fa8c7-2da7-42eb-98fd-8b73e8434a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:25.855733 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 789/1579] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:25.856536 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fa8c7-2da7-42eb-98fd-8b73e8434a5e None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:25.867633 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fa8c7-2da7-42eb-98fd-8b73e8434a5e None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:25.872586 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459b4c1-16ab-4166-bb40-43f2fa540ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:25.873130 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459b4c1-16ab-4166-bb40-43f2fa540ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:25.873409 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459b4c1-16ab-4166-bb40-43f2fa540ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:25.873690 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459b4c1-16ab-4166-bb40-43f2fa540ad6 admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:25.875088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459b4c1-16ab-4166-bb40-43f2fa540ad6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:25.876577 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 791/1580] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:10:25 2022] POST /identity/v3/projects => generated 373 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:25.885916 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09d9b9-c173-48b0-aa33-0cfda3a23b01 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:25.886049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459b4c1-16ab-4166-bb40-43f2fa540ad6 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:25.908164 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:25.945632 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09d9b9-c173-48b0-aa33-0cfda3a23b01 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:25.950855 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d31665-2eaf-4416-99ec-3f076e68350f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:25.957036 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d31665-2eaf-4416-99ec-3f076e68350f admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:25.957036 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d31665-2eaf-4416-99ec-3f076e68350f admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:25.957036 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d31665-2eaf-4416-99ec-3f076e68350f admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:25.957036 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d31665-2eaf-4416-99ec-3f076e68350f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:25.957449 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 790/1581] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:10:25 2022] POST /identity/v3/users => generated 302 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:25.957913 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d31665-2eaf-4416-99ec-3f076e68350f admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:25.957994 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459b4c1-16ab-4166-bb40-43f2fa540ad6 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:25.969967 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459b4c1-16ab-4166-bb40-43f2fa540ad6 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:25.973404 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa0293-78eb-45b1-aa1e-4770abbad54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:25.974055 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa0293-78eb-45b1-aa1e-4770abbad54c admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:25.974332 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa0293-78eb-45b1-aa1e-4770abbad54c admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:25.974600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa0293-78eb-45b1-aa1e-4770abbad54c admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:25.975319 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa0293-78eb-45b1-aa1e-4770abbad54c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:25.977195 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefa0293-78eb-45b1-aa1e-4770abbad54c admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:26.057072 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 792/1582] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:10:25 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:26.057072 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d31665-2eaf-4416-99ec-3f076e68350f admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:26.065923 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d31665-2eaf-4416-99ec-3f076e68350f admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:26.070501 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d967d64-49c1-41c3-a288-25c1ebdbe554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:26.071104 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d967d64-49c1-41c3-a288-25c1ebdbe554 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:26.071406 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d967d64-49c1-41c3-a288-25c1ebdbe554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:26.071673 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d967d64-49c1-41c3-a288-25c1ebdbe554 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:26.072309 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d967d64-49c1-41c3-a288-25c1ebdbe554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:26.073923 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d967d64-49c1-41c3-a288-25c1ebdbe554 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:26.084971 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:26.085167 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 793/1583] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:26.086358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d967d64-49c1-41c3-a288-25c1ebdbe554 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:26.093231 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 791/1584] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:10:25 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:26.094000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa0293-78eb-45b1-aa1e-4770abbad54c admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:26.097962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d967d64-49c1-41c3-a288-25c1ebdbe554 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:26.103021 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025691b-88de-4b73-bdc6-b31b278a0088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:26.103674 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025691b-88de-4b73-bdc6-b31b278a0088 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:26.103953 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025691b-88de-4b73-bdc6-b31b278a0088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:26.104276 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025691b-88de-4b73-bdc6-b31b278a0088 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:26.104906 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefa0293-78eb-45b1-aa1e-4770abbad54c admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:26.105040 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025691b-88de-4b73-bdc6-b31b278a0088 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:26.106840 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025691b-88de-4b73-bdc6-b31b278a0088 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:26.110086 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f1d69-a8d6-4cf3-8326-e066db10754e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:26.115260 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f1d69-a8d6-4cf3-8326-e066db10754e admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:26.115260 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f1d69-a8d6-4cf3-8326-e066db10754e admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:26.115260 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8f1d69-a8d6-4cf3-8326-e066db10754e admin admin] PATH_INFO: `/v3/projects/0131d0330fac4b8089503e5d0e830841/users/3659772c227a4a179d30340e9573d556/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:26.127352 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8f1d69-a8d6-4cf3-8326-e066db10754e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0131d0330fac4b8089503e5d0e830841, user_id=3659772c227a4a179d30340e9573d556, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:26.128380 dv-cinder-779578-5-smb devstack@keystone.service[81760]: WARNING py.warnings [None req-be8f1d69-a8d6-4cf3-8326-e066db10754e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:10:26.128380 dv-cinder-779578-5-smb devstack@keystone.service[81760]: warnings.warn(msg) Aug 24 17:10:26.128380 dv-cinder-779578-5-smb devstack@keystone.service[81760]: Aug 24 17:10:26.130319 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8f1d69-a8d6-4cf3-8326-e066db10754e admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:26.247653 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 792/1585] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:10:26 2022] PUT /identity/v3/projects/0131d0330fac4b8089503e5d0e830841/users/3659772c227a4a179d30340e9573d556/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:26.248415 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 794/1586] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:10:26 2022] POST /identity/v3/users => generated 288 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:26.250000 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025691b-88de-4b73-bdc6-b31b278a0088 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:26.250632 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f1d69-a8d6-4cf3-8326-e066db10754e admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:26.270126 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025691b-88de-4b73-bdc6-b31b278a0088 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:26.325672 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8f1d69-a8d6-4cf3-8326-e066db10754e admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:26.330656 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e97e77-7ce8-4d20-af86-de389e30d764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:26.331442 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e97e77-7ce8-4d20-af86-de389e30d764 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:26.332155 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e97e77-7ce8-4d20-af86-de389e30d764 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:26.332155 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e97e77-7ce8-4d20-af86-de389e30d764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:26.346661 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20ead7-47e1-463f-8cb4-980a48c39b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:26.347450 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20ead7-47e1-463f-8cb4-980a48c39b95 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:26.347838 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20ead7-47e1-463f-8cb4-980a48c39b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:26.348030 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20ead7-47e1-463f-8cb4-980a48c39b95 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:26.348640 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20ead7-47e1-463f-8cb4-980a48c39b95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:26.351277 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20ead7-47e1-463f-8cb4-980a48c39b95 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:26.401303 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e97e77-7ce8-4d20-af86-de389e30d764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:26.402752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e97e77-7ce8-4d20-af86-de389e30d764 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:26.412887 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 793/1587] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:10:26.413782 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e97e77-7ce8-4d20-af86-de389e30d764 service neutron] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:26.429606 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e97e77-7ce8-4d20-af86-de389e30d764 service neutron] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:26.435641 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca169e78-a2c0-4d0e-9bb5-25a2fba03479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:26.436267 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca169e78-a2c0-4d0e-9bb5-25a2fba03479 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:26.436549 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca169e78-a2c0-4d0e-9bb5-25a2fba03479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:26.436825 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca169e78-a2c0-4d0e-9bb5-25a2fba03479 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:26.438158 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 795/1588] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:10:26 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:26.438324 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca169e78-a2c0-4d0e-9bb5-25a2fba03479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:26.439136 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20ead7-47e1-463f-8cb4-980a48c39b95 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:26.440076 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca169e78-a2c0-4d0e-9bb5-25a2fba03479 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:26.449458 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20ead7-47e1-463f-8cb4-980a48c39b95 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:26.453613 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 794/1589] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:26.453613 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca169e78-a2c0-4d0e-9bb5-25a2fba03479 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:26.459313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68584bd2-b122-43bc-995d-135827514f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:26.459313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68584bd2-b122-43bc-995d-135827514f88 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:26.459313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68584bd2-b122-43bc-995d-135827514f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:26.459313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68584bd2-b122-43bc-995d-135827514f88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:26.459683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68584bd2-b122-43bc-995d-135827514f88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:26.459683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68584bd2-b122-43bc-995d-135827514f88 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:26.462536 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca169e78-a2c0-4d0e-9bb5-25a2fba03479 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:26.467324 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08befbb-59d4-41f9-8d77-74b8cc1c0848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:26.467938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08befbb-59d4-41f9-8d77-74b8cc1c0848 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:26.468250 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08befbb-59d4-41f9-8d77-74b8cc1c0848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:26.468533 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08befbb-59d4-41f9-8d77-74b8cc1c0848 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:26.469180 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08befbb-59d4-41f9-8d77-74b8cc1c0848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:26.469498 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 796/1590] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:26.471006 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08befbb-59d4-41f9-8d77-74b8cc1c0848 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:26.473455 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68584bd2-b122-43bc-995d-135827514f88 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:26.483283 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 795/1591] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:26.483283 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08befbb-59d4-41f9-8d77-74b8cc1c0848 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:26.483570 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68584bd2-b122-43bc-995d-135827514f88 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:26.490752 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847abcfe-45e4-4aa2-ade4-d32f07cd7162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:26.491408 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847abcfe-45e4-4aa2-ade4-d32f07cd7162 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:26.491689 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847abcfe-45e4-4aa2-ade4-d32f07cd7162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:26.491962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847abcfe-45e4-4aa2-ade4-d32f07cd7162 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:26.492616 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847abcfe-45e4-4aa2-ade4-d32f07cd7162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:26.494287 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08befbb-59d4-41f9-8d77-74b8cc1c0848 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:26.494426 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847abcfe-45e4-4aa2-ade4-d32f07cd7162 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:26.499069 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f17c7f-718d-46e3-a014-c63f61b199dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:26.500503 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f17c7f-718d-46e3-a014-c63f61b199dc admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:26.500791 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f17c7f-718d-46e3-a014-c63f61b199dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:26.501068 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f17c7f-718d-46e3-a014-c63f61b199dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:26.501715 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f17c7f-718d-46e3-a014-c63f61b199dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:26.503356 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f17c7f-718d-46e3-a014-c63f61b199dc admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:26.507685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 797/1592] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:26.512472 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c42eed-c082-4f53-9101-ad22e66309ed None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:26.512757 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c42eed-c082-4f53-9101-ad22e66309ed None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:26.513032 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c42eed-c082-4f53-9101-ad22e66309ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:26.519439 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 796/1593] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:26.519439 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f17c7f-718d-46e3-a014-c63f61b199dc admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:26.530013 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f17c7f-718d-46e3-a014-c63f61b199dc admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:26.535755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b61159-673e-4572-a133-eb21df909c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:26.536403 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b61159-673e-4572-a133-eb21df909c05 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:26.536676 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b61159-673e-4572-a133-eb21df909c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:26.537103 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b61159-673e-4572-a133-eb21df909c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:26.537671 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b61159-673e-4572-a133-eb21df909c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:26.539320 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b61159-673e-4572-a133-eb21df909c05 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:26.540369 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-69c42eed-c082-4f53-9101-ad22e66309ed None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:26.542039 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-69c42eed-c082-4f53-9101-ad22e66309ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:26.551134 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 798/1594] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:26.551992 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c42eed-c082-4f53-9101-ad22e66309ed None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:26.554818 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 797/1595] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:26.554818 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b61159-673e-4572-a133-eb21df909c05 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:26.571237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c42eed-c082-4f53-9101-ad22e66309ed None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:26.572319 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b61159-673e-4572-a133-eb21df909c05 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:26.578269 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62329ac-ca3c-4948-95d4-949a10c1a454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:26.578492 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3395f3b-25e6-4ffe-9318-4c9ca2d872ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:26.578864 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3395f3b-25e6-4ffe-9318-4c9ca2d872ab admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:26.579047 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3395f3b-25e6-4ffe-9318-4c9ca2d872ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:26.579292 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62329ac-ca3c-4948-95d4-949a10c1a454 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:26.579388 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3395f3b-25e6-4ffe-9318-4c9ca2d872ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:26.579467 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62329ac-ca3c-4948-95d4-949a10c1a454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:26.579813 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62329ac-ca3c-4948-95d4-949a10c1a454 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:26.580059 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3395f3b-25e6-4ffe-9318-4c9ca2d872ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:26.580462 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62329ac-ca3c-4948-95d4-949a10c1a454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:26.581825 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3395f3b-25e6-4ffe-9318-4c9ca2d872ab admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:26.582205 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62329ac-ca3c-4948-95d4-949a10c1a454 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:26.597427 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 798/1596] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:26.597427 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62329ac-ca3c-4948-95d4-949a10c1a454 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:26.597748 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 799/1597] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:26.598146 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3395f3b-25e6-4ffe-9318-4c9ca2d872ab admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:26.609134 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3395f3b-25e6-4ffe-9318-4c9ca2d872ab admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:26.611209 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62329ac-ca3c-4948-95d4-949a10c1a454 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:26.613796 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917dfbe-1f40-41dc-ab1e-1538daf16736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:26.614404 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917dfbe-1f40-41dc-ab1e-1538daf16736 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:26.614683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917dfbe-1f40-41dc-ab1e-1538daf16736 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:26.614952 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917dfbe-1f40-41dc-ab1e-1538daf16736 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:26.615648 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917dfbe-1f40-41dc-ab1e-1538daf16736 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:26.616132 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90929d-cae7-48ca-b3cd-76b343ac4b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:26.616822 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90929d-cae7-48ca-b3cd-76b343ac4b71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:26.617110 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90929d-cae7-48ca-b3cd-76b343ac4b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:26.617234 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917dfbe-1f40-41dc-ab1e-1538daf16736 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:26.617420 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a90929d-cae7-48ca-b3cd-76b343ac4b71 admin admin] PATH_INFO: `/v3/projects/5498cab6745f4735b2772cbd2fb9c79b/users/2cad680ebdab4fd4996f39f2e08eabb7/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:26.628167 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 800/1598] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:26.629003 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917dfbe-1f40-41dc-ab1e-1538daf16736 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:26.637153 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a90929d-cae7-48ca-b3cd-76b343ac4b71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5498cab6745f4735b2772cbd2fb9c79b, user_id=2cad680ebdab4fd4996f39f2e08eabb7, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:26.638855 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917dfbe-1f40-41dc-ab1e-1538daf16736 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:26.639954 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a90929d-cae7-48ca-b3cd-76b343ac4b71 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:26.645143 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d06471-3d5f-45b9-9455-912e11987a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:26.645773 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d06471-3d5f-45b9-9455-912e11987a43 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:26.646039 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d06471-3d5f-45b9-9455-912e11987a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:26.646312 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d06471-3d5f-45b9-9455-912e11987a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:26.646982 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d06471-3d5f-45b9-9455-912e11987a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:26.648651 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d06471-3d5f-45b9-9455-912e11987a43 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:26.661729 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 801/1599] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:26.662605 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d06471-3d5f-45b9-9455-912e11987a43 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:26.679304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d06471-3d5f-45b9-9455-912e11987a43 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:26.684035 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41afeee-d7da-4ebb-9a38-0b955c55764e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:26.684680 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41afeee-d7da-4ebb-9a38-0b955c55764e admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:26.684960 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41afeee-d7da-4ebb-9a38-0b955c55764e admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:26.685234 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41afeee-d7da-4ebb-9a38-0b955c55764e admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:26.686514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41afeee-d7da-4ebb-9a38-0b955c55764e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:26.688926 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41afeee-d7da-4ebb-9a38-0b955c55764e admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:26.695195 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:26.701658 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 802/1600] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:26.702524 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41afeee-d7da-4ebb-9a38-0b955c55764e admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:26.707489 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 799/1601] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:10:26 2022] PUT /identity/v3/projects/5498cab6745f4735b2772cbd2fb9c79b/users/2cad680ebdab4fd4996f39f2e08eabb7/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:26.709131 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90929d-cae7-48ca-b3cd-76b343ac4b71 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:26.711935 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-d41afeee-d7da-4ebb-9a38-0b955c55764e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:26.719186 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:26.728764 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41afeee-d7da-4ebb-9a38-0b955c55764e admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:26.790935 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a90929d-cae7-48ca-b3cd-76b343ac4b71 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:26.796318 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83ab63-29b2-4ec8-8a23-037068683d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:26.796932 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83ab63-29b2-4ec8-8a23-037068683d75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:26.797214 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83ab63-29b2-4ec8-8a23-037068683d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:26.797642 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83ab63-29b2-4ec8-8a23-037068683d75 admin admin] PATH_INFO: `/v3/projects/6148b5892d59461eac9e4a340023b1a5/users/44873929d67a4ebfb8388323c2dd2f51/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:26.810234 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c2f52-8ebc-49ec-9b35-ff747d34468c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:26.810848 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c2f52-8ebc-49ec-9b35-ff747d34468c service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:26.811321 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c2f52-8ebc-49ec-9b35-ff747d34468c service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:26.811599 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3c2f52-8ebc-49ec-9b35-ff747d34468c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:26.817021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83ab63-29b2-4ec8-8a23-037068683d75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6148b5892d59461eac9e4a340023b1a5, user_id=44873929d67a4ebfb8388323c2dd2f51, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:26.820320 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83ab63-29b2-4ec8-8a23-037068683d75 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:26.832599 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c2f52-8ebc-49ec-9b35-ff747d34468c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:26.832599 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3c2f52-8ebc-49ec-9b35-ff747d34468c service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:26.836941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 803/1602] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:10:26.837547 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c2f52-8ebc-49ec-9b35-ff747d34468c service neutron] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:26.846781 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3c2f52-8ebc-49ec-9b35-ff747d34468c service neutron] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:26.852081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd848a-9629-4c48-842c-9ae742d76ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:26.852733 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd848a-9629-4c48-842c-9ae742d76ab6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:26.853012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd848a-9629-4c48-842c-9ae742d76ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:26.853285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bd848a-9629-4c48-842c-9ae742d76ab6 admin admin] PATH_INFO: `/v3/projects/2754140684a847fa9592df3e16aa42df/users/f2e414a711f74b20a0eb0f89bb2bf6f7/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:26.870295 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bd848a-9629-4c48-842c-9ae742d76ab6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2754140684a847fa9592df3e16aa42df, user_id=f2e414a711f74b20a0eb0f89bb2bf6f7, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:26.873024 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bd848a-9629-4c48-842c-9ae742d76ab6 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:26.948486 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 800/1603] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:10:26 2022] PUT /identity/v3/projects/6148b5892d59461eac9e4a340023b1a5/users/44873929d67a4ebfb8388323c2dd2f51/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:26.949164 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 804/1604] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:10:26 2022] PUT /identity/v3/projects/2754140684a847fa9592df3e16aa42df/users/f2e414a711f74b20a0eb0f89bb2bf6f7/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:26.949606 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83ab63-29b2-4ec8-8a23-037068683d75 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:26.950448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd848a-9629-4c48-842c-9ae742d76ab6 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:27.036645 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83ab63-29b2-4ec8-8a23-037068683d75 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:27.042178 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f7353-a4b4-4da1-9e88-45c58f975e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:27.042848 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f7353-a4b4-4da1-9e88-45c58f975e48 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:27.043146 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f7353-a4b4-4da1-9e88-45c58f975e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:27.043427 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799f7353-a4b4-4da1-9e88-45c58f975e48 admin admin] PATH_INFO: `/v3/projects/e170dd65d39649de9b6bdd5d367091be/users/9d829f56be8a4000946c6ca93007937c/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:27.046907 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bd848a-9629-4c48-842c-9ae742d76ab6 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:27.054518 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028723d6-b1c7-491e-a606-dd9acd037aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:27.055345 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028723d6-b1c7-491e-a606-dd9acd037aa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:27.055635 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028723d6-b1c7-491e-a606-dd9acd037aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:27.055914 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028723d6-b1c7-491e-a606-dd9acd037aa7 admin admin] PATH_INFO: `/v3/projects/25be1ecb85fb47ed9401fdde54de07a1/users/8e2a6865d8eb4c4196179304158cafd4/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:27.064011 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f7353-a4b4-4da1-9e88-45c58f975e48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e170dd65d39649de9b6bdd5d367091be, user_id=9d829f56be8a4000946c6ca93007937c, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:27.067180 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799f7353-a4b4-4da1-9e88-45c58f975e48 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:27.074647 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028723d6-b1c7-491e-a606-dd9acd037aa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25be1ecb85fb47ed9401fdde54de07a1, user_id=8e2a6865d8eb4c4196179304158cafd4, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:27.077462 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028723d6-b1c7-491e-a606-dd9acd037aa7 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:27.170013 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 801/1605] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:10:26 2022] PUT /identity/v3/projects/e170dd65d39649de9b6bdd5d367091be/users/9d829f56be8a4000946c6ca93007937c/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:27.171015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f7353-a4b4-4da1-9e88-45c58f975e48 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:27.179735 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 805/1606] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:10:26 2022] PUT /identity/v3/projects/25be1ecb85fb47ed9401fdde54de07a1/users/8e2a6865d8eb4c4196179304158cafd4/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:27.182863 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaf0b5-ba23-426d-8f72-70361ed489da None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:27.183669 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaf0b5-ba23-426d-8f72-70361ed489da None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:27.184150 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaf0b5-ba23-426d-8f72-70361ed489da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:27.213251 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-6ceaf0b5-ba23-426d-8f72-70361ed489da None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:27.215430 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-6ceaf0b5-ba23-426d-8f72-70361ed489da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:27.282015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799f7353-a4b4-4da1-9e88-45c58f975e48 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:27.309226 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 806/1607] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:27.313167 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:27.313261 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b107ec0-7d49-4fae-aff0-1d7b00bc4968 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:27.313261 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b107ec0-7d49-4fae-aff0-1d7b00bc4968 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:27.313261 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b107ec0-7d49-4fae-aff0-1d7b00bc4968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:27.320766 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:27.337763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-4b107ec0-7d49-4fae-aff0-1d7b00bc4968 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:27.339900 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-4b107ec0-7d49-4fae-aff0-1d7b00bc4968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:27.361193 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 807/1608] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:27.362707 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e83843-cd2c-47ae-99c5-6c647ff19509 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:27.363054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e83843-cd2c-47ae-99c5-6c647ff19509 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:27.363444 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e83843-cd2c-47ae-99c5-6c647ff19509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:27.366102 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167a58b-6ac5-4fa7-b596-e0fad7006a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:27.367246 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167a58b-6ac5-4fa7-b596-e0fad7006a1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:27.367803 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167a58b-6ac5-4fa7-b596-e0fad7006a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:27.368284 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167a58b-6ac5-4fa7-b596-e0fad7006a1e admin admin] PATH_INFO: `/v3/projects/1638304304f94925ac86f9dda77b8fff/users/ed0aa142aaf44cfa847beb3b7ed38476/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:27.386473 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167a58b-6ac5-4fa7-b596-e0fad7006a1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1638304304f94925ac86f9dda77b8fff, user_id=ed0aa142aaf44cfa847beb3b7ed38476, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:27.396040 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167a58b-6ac5-4fa7-b596-e0fad7006a1e admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:27.396223 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-c5e83843-cd2c-47ae-99c5-6c647ff19509 None None] MFA Rules not processed for user `44873929d67a4ebfb8388323c2dd2f51`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:27.397160 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-c5e83843-cd2c-47ae-99c5-6c647ff19509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:27.469734 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 808/1609] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:27 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:27.471307 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e34d9a-d4ae-4e1a-8c6d-fba6e83528d3 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:27.471986 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e34d9a-d4ae-4e1a-8c6d-fba6e83528d3 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:27.471986 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e34d9a-d4ae-4e1a-8c6d-fba6e83528d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:27.493849 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 802/1610] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:10:27 2022] PUT /identity/v3/projects/1638304304f94925ac86f9dda77b8fff/users/ed0aa142aaf44cfa847beb3b7ed38476/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:27.495649 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5b08c-6fe0-45e1-9417-75d2bc039d16 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:27.496163 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5b08c-6fe0-45e1-9417-75d2bc039d16 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:27.496652 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb5b08c-6fe0-45e1-9417-75d2bc039d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:27.503502 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-59e34d9a-d4ae-4e1a-8c6d-fba6e83528d3 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:27.505222 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-59e34d9a-d4ae-4e1a-8c6d-fba6e83528d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:27.554213 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-5eb5b08c-6fe0-45e1-9417-75d2bc039d16 None None] MFA Rules not processed for user `8e2a6865d8eb4c4196179304158cafd4`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:27.556331 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-5eb5b08c-6fe0-45e1-9417-75d2bc039d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:27.600901 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 809/1611] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:27.601977 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e34d9a-d4ae-4e1a-8c6d-fba6e83528d3 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:27.643143 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 803/1612] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:27.644116 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5b08c-6fe0-45e1-9417-75d2bc039d16 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:27.680442 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e34d9a-d4ae-4e1a-8c6d-fba6e83528d3 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:27.690446 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496f0e0-875d-4821-a948-e0866f83af72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:27.691648 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496f0e0-875d-4821-a948-e0866f83af72 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:27.692213 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496f0e0-875d-4821-a948-e0866f83af72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:27.692953 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496f0e0-875d-4821-a948-e0866f83af72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:27.710692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4496f0e0-875d-4821-a948-e0866f83af72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:27.713614 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4496f0e0-875d-4821-a948-e0866f83af72 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:27.717384 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb5b08c-6fe0-45e1-9417-75d2bc039d16 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:27.724324 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf4931-44f1-4d7f-a45f-90c88cb392ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:27.725020 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf4931-44f1-4d7f-a45f-90c88cb392ab service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:27.725369 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf4931-44f1-4d7f-a45f-90c88cb392ab service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:27.725731 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf4931-44f1-4d7f-a45f-90c88cb392ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:27.729098 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 810/1613] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:10:27.730189 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496f0e0-875d-4821-a948-e0866f83af72 service neutron] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:27.743656 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496f0e0-875d-4821-a948-e0866f83af72 service neutron] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:27.748492 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73f5a7-5be5-49f4-b8ea-5e7cc4d471c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:27.748703 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf4931-44f1-4d7f-a45f-90c88cb392ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:27.750438 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73f5a7-5be5-49f4-b8ea-5e7cc4d471c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:27.751286 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73f5a7-5be5-49f4-b8ea-5e7cc4d471c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:27.751633 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73f5a7-5be5-49f4-b8ea-5e7cc4d471c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:27.751781 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debf4931-44f1-4d7f-a45f-90c88cb392ab service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:27.752417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73f5a7-5be5-49f4-b8ea-5e7cc4d471c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:27.755247 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73f5a7-5be5-49f4-b8ea-5e7cc4d471c2 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:27.771731 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 804/1614] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:10:27.776128 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f680d-4e9c-4d34-bdb5-84e157146127 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:27.777437 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f680d-4e9c-4d34-bdb5-84e157146127 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:27.777704 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601f680d-4e9c-4d34-bdb5-84e157146127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:27.816946 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-601f680d-4e9c-4d34-bdb5-84e157146127 None None] MFA Rules not processed for user `ed0aa142aaf44cfa847beb3b7ed38476`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:27.818242 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-601f680d-4e9c-4d34-bdb5-84e157146127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:27.848914 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:27.906986 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 811/1615] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:10:27 2022] POST /identity/v3/projects => generated 405 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:27.908696 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73f5a7-5be5-49f4-b8ea-5e7cc4d471c2 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:27.909558 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 805/1616] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:27.912011 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d2335-bd68-4bf1-be90-44be5fed2e2e None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:27.913564 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d2335-bd68-4bf1-be90-44be5fed2e2e None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:27.914203 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d2335-bd68-4bf1-be90-44be5fed2e2e None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:27.925469 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 806/1617] 10.222.0.55 () {54 vars in 962 bytes} [Wed Aug 24 17:10:27 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:10:27.928113 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2158e9-ad28-47de-a22b-411c04913220 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:27.929033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2158e9-ad28-47de-a22b-411c04913220 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:27.929322 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2158e9-ad28-47de-a22b-411c04913220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:27.934494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:27.966841 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-ff2158e9-ad28-47de-a22b-411c04913220 None None] MFA Rules not processed for user `8e7265f14108492191ccc4f6b3bf7548`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:27.969050 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-ff2158e9-ad28-47de-a22b-411c04913220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:28.006700 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73f5a7-5be5-49f4-b8ea-5e7cc4d471c2 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:28.013122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7682b23-5848-48c2-b117-e13e8beba087 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:28.014239 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7682b23-5848-48c2-b117-e13e8beba087 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:28.014519 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7682b23-5848-48c2-b117-e13e8beba087 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:28.015666 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7682b23-5848-48c2-b117-e13e8beba087 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:28.060117 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 807/1618] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:27 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:28.061121 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2158e9-ad28-47de-a22b-411c04913220 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:28.084659 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7682b23-5848-48c2-b117-e13e8beba087 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:28.086761 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7682b23-5848-48c2-b117-e13e8beba087 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:28.096521 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 812/1619] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:10:28.097855 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf84c16-9c67-4a3b-975c-6f408c62bc24 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:28.098137 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf84c16-9c67-4a3b-975c-6f408c62bc24 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:28.098412 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf84c16-9c67-4a3b-975c-6f408c62bc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:28.143538 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2158e9-ad28-47de-a22b-411c04913220 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:28.144918 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-eaf84c16-9c67-4a3b-975c-6f408c62bc24 None None] MFA Rules not processed for user `28a1c617fc264b118e61f2a97ecb3f39`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:28.146338 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-eaf84c16-9c67-4a3b-975c-6f408c62bc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:28.149027 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f961d6ad-1e00-439d-b734-82019b60c81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:28.149783 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961d6ad-1e00-439d-b734-82019b60c81f admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:28.150060 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961d6ad-1e00-439d-b734-82019b60c81f admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:28.150332 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f961d6ad-1e00-439d-b734-82019b60c81f admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:28.150963 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961d6ad-1e00-439d-b734-82019b60c81f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:28.152952 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f961d6ad-1e00-439d-b734-82019b60c81f admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:28.223132 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 813/1620] 10.222.0.55 () {58 vars in 1059 bytes} [Wed Aug 24 17:10:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:28.224484 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a2f28-7b3e-447c-975e-7ac2663dc946 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:28.224771 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a2f28-7b3e-447c-975e-7ac2663dc946 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:28.225052 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0a2f28-7b3e-447c-975e-7ac2663dc946 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:28.226335 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 814/1621] 10.222.0.55 () {54 vars in 962 bytes} [Wed Aug 24 17:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:10:28.231286 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a2f28-7b3e-447c-975e-7ac2663dc946 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:28.245779 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0a2f28-7b3e-447c-975e-7ac2663dc946 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:28.249872 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 808/1622] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:10:28 2022] POST /identity/v3/users => generated 309 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:28.254160 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7349d3-9cce-43ca-b8ff-52a8e55c06cc None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:28.254673 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7349d3-9cce-43ca-b8ff-52a8e55c06cc None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:28.255025 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7349d3-9cce-43ca-b8ff-52a8e55c06cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:28.255629 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffe28a-265b-44a3-85df-1c91b0e8f218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:28.257069 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffe28a-265b-44a3-85df-1c91b0e8f218 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:28.257175 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffe28a-265b-44a3-85df-1c91b0e8f218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:28.258147 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cffe28a-265b-44a3-85df-1c91b0e8f218 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:28.259538 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cffe28a-265b-44a3-85df-1c91b0e8f218 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:28.264256 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cffe28a-265b-44a3-85df-1c91b0e8f218 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:28.286679 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-1e7349d3-9cce-43ca-b8ff-52a8e55c06cc None None] MFA Rules not processed for user `28a1c617fc264b118e61f2a97ecb3f39`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:28.291605 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-1e7349d3-9cce-43ca-b8ff-52a8e55c06cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:28.300632 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 809/1623] 10.222.0.55 () {58 vars in 1059 bytes} [Wed Aug 24 17:10:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:28.301502 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7349d3-9cce-43ca-b8ff-52a8e55c06cc None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:28.313105 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7349d3-9cce-43ca-b8ff-52a8e55c06cc None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:28.319390 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b060d-8aff-4ed5-9678-42eea5de99ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:28.320018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b060d-8aff-4ed5-9678-42eea5de99ee service nova] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:28.320291 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b060d-8aff-4ed5-9678-42eea5de99ee service nova] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:28.320560 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b060d-8aff-4ed5-9678-42eea5de99ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:28.380727 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b060d-8aff-4ed5-9678-42eea5de99ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:28.383448 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91b060d-8aff-4ed5-9678-42eea5de99ee service nova] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:28.392587 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 810/1624] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:10:28.395941 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b060d-8aff-4ed5-9678-42eea5de99ee service nova] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:28.408962 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b060d-8aff-4ed5-9678-42eea5de99ee service nova] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:28.412501 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 815/1625] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:10:28 2022] POST /identity/v3/projects => generated 403 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:28.413787 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffe28a-265b-44a3-85df-1c91b0e8f218 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:28.414690 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68382989-ce97-4ddf-b6d2-df3609254cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:28.415703 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68382989-ce97-4ddf-b6d2-df3609254cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:28.416093 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68382989-ce97-4ddf-b6d2-df3609254cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:28.416488 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68382989-ce97-4ddf-b6d2-df3609254cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:28.417243 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68382989-ce97-4ddf-b6d2-df3609254cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:28.419076 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68382989-ce97-4ddf-b6d2-df3609254cd0 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:28.436356 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 811/1626] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:28.440901 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68382989-ce97-4ddf-b6d2-df3609254cd0 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:28.450214 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68382989-ce97-4ddf-b6d2-df3609254cd0 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:28.533342 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc119754-e9a2-464a-90e3-47cb157a169e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:28.534877 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc119754-e9a2-464a-90e3-47cb157a169e admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:28.535003 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cffe28a-265b-44a3-85df-1c91b0e8f218 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:28.535261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc119754-e9a2-464a-90e3-47cb157a169e admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:28.535648 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc119754-e9a2-464a-90e3-47cb157a169e admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:28.536461 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc119754-e9a2-464a-90e3-47cb157a169e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:28.541355 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb3219-f31b-46c6-abcd-080f6822fef3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:28.545936 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc119754-e9a2-464a-90e3-47cb157a169e admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:28.546222 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb3219-f31b-46c6-abcd-080f6822fef3 service nova] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:28.546222 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb3219-f31b-46c6-abcd-080f6822fef3 service nova] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:28.546222 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cb3219-f31b-46c6-abcd-080f6822fef3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:28.664422 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 812/1627] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:10:28 2022] POST /identity/v3/users => generated 308 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:28.664804 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb3219-f31b-46c6-abcd-080f6822fef3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:28.665343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc119754-e9a2-464a-90e3-47cb157a169e admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:28.666763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cb3219-f31b-46c6-abcd-080f6822fef3 service nova] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:28.683564 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 816/1628] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:10:28.683564 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb3219-f31b-46c6-abcd-080f6822fef3 service nova] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:28.696287 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc119754-e9a2-464a-90e3-47cb157a169e admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:28.704066 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd2a3d-ab27-481e-a211-098c122740ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:28.704066 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd2a3d-ab27-481e-a211-098c122740ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:28.704066 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd2a3d-ab27-481e-a211-098c122740ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:28.704066 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd2a3d-ab27-481e-a211-098c122740ab admin admin] PATH_INFO: `/v3/projects/ad56daf2c3e044a189e98c5bd9deef71/users/8dd4c57e7b0047e9a2c561ecbb1f8b7c/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:28.721105 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cb3219-f31b-46c6-abcd-080f6822fef3 service nova] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:28.724594 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd2a3d-ab27-481e-a211-098c122740ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad56daf2c3e044a189e98c5bd9deef71, user_id=8dd4c57e7b0047e9a2c561ecbb1f8b7c, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:28.728264 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd2a3d-ab27-481e-a211-098c122740ab admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:28.733165 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357571e-0680-4b0f-a84d-a9025834889a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:28.739534 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357571e-0680-4b0f-a84d-a9025834889a admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:28.739534 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357571e-0680-4b0f-a84d-a9025834889a admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:28.739534 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357571e-0680-4b0f-a84d-a9025834889a admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:28.739534 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357571e-0680-4b0f-a84d-a9025834889a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:28.739534 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357571e-0680-4b0f-a84d-a9025834889a admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:28.753465 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 817/1629] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:28.758183 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357571e-0680-4b0f-a84d-a9025834889a admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:28.788945 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357571e-0680-4b0f-a84d-a9025834889a admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:28.800944 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52910d8-f7e7-412b-9965-5483211784d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:28.801806 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52910d8-f7e7-412b-9965-5483211784d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:28.802156 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52910d8-f7e7-412b-9965-5483211784d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:28.802553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52910d8-f7e7-412b-9965-5483211784d2 admin admin] PATH_INFO: `/v3/projects/19fe2b98c006495cb426b91b2d17933a/users/6db32cb7a31746f7bc3e304a9ccb73b7/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:28.821747 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52910d8-f7e7-412b-9965-5483211784d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19fe2b98c006495cb426b91b2d17933a, user_id=6db32cb7a31746f7bc3e304a9ccb73b7, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:28.824954 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52910d8-f7e7-412b-9965-5483211784d2 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:28.847726 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 813/1630] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:10:28 2022] PUT /identity/v3/projects/ad56daf2c3e044a189e98c5bd9deef71/users/8dd4c57e7b0047e9a2c561ecbb1f8b7c/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:28.847726 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd5aa3-814d-4e4e-8aca-5224bbe8d9a9 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:28.847726 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd5aa3-814d-4e4e-8aca-5224bbe8d9a9 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:28.847726 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd5aa3-814d-4e4e-8aca-5224bbe8d9a9 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:28.849852 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 814/1631] 10.222.0.55 () {54 vars in 912 bytes} [Wed Aug 24 17:10:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:10:28.850825 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd5aa3-814d-4e4e-8aca-5224bbe8d9a9 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:28.885203 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 818/1632] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:10:28 2022] PUT /identity/v3/projects/19fe2b98c006495cb426b91b2d17933a/users/6db32cb7a31746f7bc3e304a9ccb73b7/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:28.887382 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b3b91-1c1c-4e0d-99cb-7ac6aae7db96 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:28.887651 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b3b91-1c1c-4e0d-99cb-7ac6aae7db96 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:28.888432 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b3b91-1c1c-4e0d-99cb-7ac6aae7db96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:28.941242 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-8e6b3b91-1c1c-4e0d-99cb-7ac6aae7db96 None None] MFA Rules not processed for user `28a1c617fc264b118e61f2a97ecb3f39`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:28.943839 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-8e6b3b91-1c1c-4e0d-99cb-7ac6aae7db96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:29.013389 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd5aa3-814d-4e4e-8aca-5224bbe8d9a9 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:29.100587 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 819/1633] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Aug 24 17:10:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:29.102069 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b3b91-1c1c-4e0d-99cb-7ac6aae7db96 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:29.133425 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e190d8-f2a7-4920-84ca-cba9ae129f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:29.134201 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e190d8-f2a7-4920-84ca-cba9ae129f12 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:29.134621 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e190d8-f2a7-4920-84ca-cba9ae129f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:29.135104 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e190d8-f2a7-4920-84ca-cba9ae129f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:29.136126 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e190d8-f2a7-4920-84ca-cba9ae129f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:29.138111 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e190d8-f2a7-4920-84ca-cba9ae129f12 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:29.156355 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 815/1634] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:29.156355 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147a8f3-aebc-4e50-b111-5a6135a62db8 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:29.156355 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147a8f3-aebc-4e50-b111-5a6135a62db8 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:29.156355 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147a8f3-aebc-4e50-b111-5a6135a62db8 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:29.159742 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 816/1635] 10.222.0.55 () {54 vars in 912 bytes} [Wed Aug 24 17:10:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:10:29.160650 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147a8f3-aebc-4e50-b111-5a6135a62db8 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:29.211855 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b3b91-1c1c-4e0d-99cb-7ac6aae7db96 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:29.231093 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84549f6c-2eb2-4a1b-b30b-fc5eb5c4c3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:29.231757 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84549f6c-2eb2-4a1b-b30b-fc5eb5c4c3bb admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:29.232035 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84549f6c-2eb2-4a1b-b30b-fc5eb5c4c3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:29.232306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84549f6c-2eb2-4a1b-b30b-fc5eb5c4c3bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:29.232956 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84549f6c-2eb2-4a1b-b30b-fc5eb5c4c3bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:29.237861 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84549f6c-2eb2-4a1b-b30b-fc5eb5c4c3bb admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:29.260617 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 820/1636] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:29.261599 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84549f6c-2eb2-4a1b-b30b-fc5eb5c4c3bb admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:29.275354 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84549f6c-2eb2-4a1b-b30b-fc5eb5c4c3bb admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:29.283062 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7155c9-8ec9-4ba1-8e4e-59eb543c3891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:29.283917 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7155c9-8ec9-4ba1-8e4e-59eb543c3891 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:29.295215 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7155c9-8ec9-4ba1-8e4e-59eb543c3891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:29.295215 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7155c9-8ec9-4ba1-8e4e-59eb543c3891 admin admin] PATH_INFO: `/v3/projects/ad56daf2c3e044a189e98c5bd9deef71/users/8dd4c57e7b0047e9a2c561ecbb1f8b7c/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:29.295215 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7155c9-8ec9-4ba1-8e4e-59eb543c3891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad56daf2c3e044a189e98c5bd9deef71, user_id=8dd4c57e7b0047e9a2c561ecbb1f8b7c, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:29.295215 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7155c9-8ec9-4ba1-8e4e-59eb543c3891 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:29.300460 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147a8f3-aebc-4e50-b111-5a6135a62db8 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:29.322337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 821/1637] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:10:29 2022] PUT /identity/v3/projects/ad56daf2c3e044a189e98c5bd9deef71/users/8dd4c57e7b0047e9a2c561ecbb1f8b7c/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:29.322337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e815f-384a-4b38-952a-a89e5af9c150 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:29.322337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e815f-384a-4b38-952a-a89e5af9c150 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:29.322337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e815f-384a-4b38-952a-a89e5af9c150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:29.351002 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-6f9e815f-384a-4b38-952a-a89e5af9c150 None None] MFA Rules not processed for user `28a1c617fc264b118e61f2a97ecb3f39`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:29.352451 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-6f9e815f-384a-4b38-952a-a89e5af9c150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:29.780020 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:29.780020 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d030e77a-6ad9-4960-a321-c576304d4339 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:29.780020 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030e77a-6ad9-4960-a321-c576304d4339 service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:29.780020 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030e77a-6ad9-4960-a321-c576304d4339 service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:29.784472 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d030e77a-6ad9-4960-a321-c576304d4339 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:29.789240 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:29.789240 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 822/1638] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Aug 24 17:10:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:29.789240 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e815f-384a-4b38-952a-a89e5af9c150 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:29.794456 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030e77a-6ad9-4960-a321-c576304d4339 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:29.794456 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d030e77a-6ad9-4960-a321-c576304d4339 service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:29.794456 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 817/1639] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:10:29.794456 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57f685-f3f9-4af9-8402-7286343e11b1 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:29.794456 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57f685-f3f9-4af9-8402-7286343e11b1 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:29.794456 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe57f685-f3f9-4af9-8402-7286343e11b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:29.799531 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-fe57f685-f3f9-4af9-8402-7286343e11b1 None None] MFA Rules not processed for user `8dd4c57e7b0047e9a2c561ecbb1f8b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:29.799531 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-fe57f685-f3f9-4af9-8402-7286343e11b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:29.803382 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e815f-384a-4b38-952a-a89e5af9c150 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:29.803382 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85970e0a-b960-4499-96c9-859e9bb82c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:29.803382 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85970e0a-b960-4499-96c9-859e9bb82c6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:29.803382 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85970e0a-b960-4499-96c9-859e9bb82c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:29.804738 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85970e0a-b960-4499-96c9-859e9bb82c6a admin admin] PATH_INFO: `/v3/projects/19fe2b98c006495cb426b91b2d17933a/users/6db32cb7a31746f7bc3e304a9ccb73b7/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:29.804738 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85970e0a-b960-4499-96c9-859e9bb82c6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=19fe2b98c006495cb426b91b2d17933a, user_id=6db32cb7a31746f7bc3e304a9ccb73b7, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:29.804738 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85970e0a-b960-4499-96c9-859e9bb82c6a admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:29.804738 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 823/1640] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:10:29 2022] PUT /identity/v3/projects/19fe2b98c006495cb426b91b2d17933a/users/6db32cb7a31746f7bc3e304a9ccb73b7/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:29.804738 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85970e0a-b960-4499-96c9-859e9bb82c6a admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:29.811278 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 818/1641] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:29 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:29.811526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85970e0a-b960-4499-96c9-859e9bb82c6a admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:29.812324 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57f685-f3f9-4af9-8402-7286343e11b1 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:29.812621 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf3dfd-60c7-4c3d-b240-7b80fcd5ac19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:29.812621 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf3dfd-60c7-4c3d-b240-7b80fcd5ac19 service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:29.812621 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf3dfd-60c7-4c3d-b240-7b80fcd5ac19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:29.812621 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdf3dfd-60c7-4c3d-b240-7b80fcd5ac19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:29.813173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe57f685-f3f9-4af9-8402-7286343e11b1 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:29.813173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef4699-a07c-4a22-86fd-08ac5682ba51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:29.813173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef4699-a07c-4a22-86fd-08ac5682ba51 service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:29.813173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef4699-a07c-4a22-86fd-08ac5682ba51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:29.813701 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef4699-a07c-4a22-86fd-08ac5682ba51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:29.848275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef4699-a07c-4a22-86fd-08ac5682ba51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:29.851656 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef4699-a07c-4a22-86fd-08ac5682ba51 service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:29.863938 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf3dfd-60c7-4c3d-b240-7b80fcd5ac19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:29.865698 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdf3dfd-60c7-4c3d-b240-7b80fcd5ac19 service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:29.890426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 819/1642] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:29 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:10:29.891237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 824/1643] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:10:30.132046 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef4699-a07c-4a22-86fd-08ac5682ba51 service cinder] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:30.275301 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf3dfd-60c7-4c3d-b240-7b80fcd5ac19 service cinder] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:30.326100 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef4699-a07c-4a22-86fd-08ac5682ba51 service cinder] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:30.345877 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176b9c2-eb61-4a7b-9f9b-ec2fadbc5a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:30.346956 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176b9c2-eb61-4a7b-9f9b-ec2fadbc5a3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:30.347478 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176b9c2-eb61-4a7b-9f9b-ec2fadbc5a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:30.348349 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176b9c2-eb61-4a7b-9f9b-ec2fadbc5a3d admin admin] PATH_INFO: `/v3/users/8e2a6865d8eb4c4196179304158cafd4` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:30.354940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176b9c2-eb61-4a7b-9f9b-ec2fadbc5a3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e2a6865d8eb4c4196179304158cafd4)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:30.362977 dv-cinder-779578-5-smb devstack@keystone.service[81760]: WARNING py.warnings [None req-a176b9c2-eb61-4a7b-9f9b-ec2fadbc5a3d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:10:30.362977 dv-cinder-779578-5-smb devstack@keystone.service[81760]: warnings.warn(msg) Aug 24 17:10:30.362977 dv-cinder-779578-5-smb devstack@keystone.service[81760]: Aug 24 17:10:30.364797 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdf3dfd-60c7-4c3d-b240-7b80fcd5ac19 service cinder] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:30.367147 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176b9c2-eb61-4a7b-9f9b-ec2fadbc5a3d admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:30.369731 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d2bdc9-4e85-4a1e-9282-f130470db40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:30.370393 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2bdc9-4e85-4a1e-9282-f130470db40b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:30.370673 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2bdc9-4e85-4a1e-9282-f130470db40b admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:30.371091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d2bdc9-4e85-4a1e-9282-f130470db40b admin admin] PATH_INFO: `/v3/users/44873929d67a4ebfb8388323c2dd2f51` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:30.372619 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2bdc9-4e85-4a1e-9282-f130470db40b admin admin] RBAC: Authorizing `identity:delete_user(user_id=44873929d67a4ebfb8388323c2dd2f51)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:30.374951 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d2bdc9-4e85-4a1e-9282-f130470db40b admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:30.701728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:30.723531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-81d2bdc9-4e85-4a1e-9282-f130470db40b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44873929d67a4ebfb8388323c2dd2f51'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:30.728263 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-a176b9c2-eb61-4a7b-9f9b-ec2fadbc5a3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e2a6865d8eb4c4196179304158cafd4'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:30.729262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-a176b9c2-eb61-4a7b-9f9b-ec2fadbc5a3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e2a6865d8eb4c4196179304158cafd4'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:30.744097 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-81d2bdc9-4e85-4a1e-9282-f130470db40b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44873929d67a4ebfb8388323c2dd2f51'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:30.767248 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-a176b9c2-eb61-4a7b-9f9b-ec2fadbc5a3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e2a6865d8eb4c4196179304158cafd4'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:30.769977 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-a176b9c2-eb61-4a7b-9f9b-ec2fadbc5a3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e2a6865d8eb4c4196179304158cafd4'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:30.832326 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-81d2bdc9-4e85-4a1e-9282-f130470db40b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44873929d67a4ebfb8388323c2dd2f51'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:30.833041 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-81d2bdc9-4e85-4a1e-9282-f130470db40b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44873929d67a4ebfb8388323c2dd2f51'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:30.833672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-81d2bdc9-4e85-4a1e-9282-f130470db40b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44873929d67a4ebfb8388323c2dd2f51'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:30.855609 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:30.864816 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 825/1644] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:10:30 2022] DELETE /identity/v3/users/44873929d67a4ebfb8388323c2dd2f51 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:30.874947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5ed80-7ae1-46d3-834d-ad7bb5a1653b None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:30.875440 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5ed80-7ae1-46d3-834d-ad7bb5a1653b None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:30.876115 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5ed80-7ae1-46d3-834d-ad7bb5a1653b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:30.900634 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-afe5ed80-7ae1-46d3-834d-ad7bb5a1653b None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:30.902254 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-afe5ed80-7ae1-46d3-834d-ad7bb5a1653b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:30.906439 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-a176b9c2-eb61-4a7b-9f9b-ec2fadbc5a3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e2a6865d8eb4c4196179304158cafd4'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:30.974162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 820/1645] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:10:30 2022] DELETE /identity/v3/users/8e2a6865d8eb4c4196179304158cafd4 => generated 0 bytes in 843 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:30.978435 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cffeb-dc1a-496b-8d31-ef18fb05e072 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:30.978961 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cffeb-dc1a-496b-8d31-ef18fb05e072 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:30.979045 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731cffeb-dc1a-496b-8d31-ef18fb05e072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:31.043981 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-731cffeb-dc1a-496b-8d31-ef18fb05e072 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:31.045907 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-731cffeb-dc1a-496b-8d31-ef18fb05e072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:31.066868 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 826/1646] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:31.159018 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5ed80-7ae1-46d3-834d-ad7bb5a1653b None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:31.160727 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-afe5ed80-7ae1-46d3-834d-ad7bb5a1653b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:31.279592 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 821/1647] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:31.320281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5ed80-7ae1-46d3-834d-ad7bb5a1653b None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:31.378860 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cffeb-dc1a-496b-8d31-ef18fb05e072 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:31.456917 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6f102-5c9b-4009-a0d2-6761844047fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:31.459616 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6f102-5c9b-4009-a0d2-6761844047fe service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:31.459984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6f102-5c9b-4009-a0d2-6761844047fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:31.461092 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b6f102-5c9b-4009-a0d2-6761844047fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:31.476947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b6f102-5c9b-4009-a0d2-6761844047fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:31.479893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b6f102-5c9b-4009-a0d2-6761844047fe service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:31.495902 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 827/1648] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:10:31.519415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731cffeb-dc1a-496b-8d31-ef18fb05e072 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:31.530452 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb95ba-ad49-47af-b738-b2f62fbd8441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:31.531629 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb95ba-ad49-47af-b738-b2f62fbd8441 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:31.531906 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb95ba-ad49-47af-b738-b2f62fbd8441 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:31.532172 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fb95ba-ad49-47af-b738-b2f62fbd8441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:31.556122 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb95ba-ad49-47af-b738-b2f62fbd8441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:31.557706 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fb95ba-ad49-47af-b738-b2f62fbd8441 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:31.583173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 822/1649] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:10:32.209509 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:32.277528 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:33.094798 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:33.135733 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6f102-5c9b-4009-a0d2-6761844047fe service neutron] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:33.139643 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-75b6f102-5c9b-4009-a0d2-6761844047fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:33.169824 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b6f102-5c9b-4009-a0d2-6761844047fe service neutron] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:33.184252 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd55f80-9413-4992-b9e5-fdc3eb5fefd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:33.184919 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd55f80-9413-4992-b9e5-fdc3eb5fefd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:33.185203 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd55f80-9413-4992-b9e5-fdc3eb5fefd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:33.185838 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd55f80-9413-4992-b9e5-fdc3eb5fefd1 admin admin] PATH_INFO: `/v3/projects/6148b5892d59461eac9e4a340023b1a5` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:33.187839 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd55f80-9413-4992-b9e5-fdc3eb5fefd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6148b5892d59461eac9e4a340023b1a5)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:33.195222 dv-cinder-779578-5-smb devstack@keystone.service[81761]: WARNING py.warnings [None req-8cd55f80-9413-4992-b9e5-fdc3eb5fefd1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 17:10:33.195222 dv-cinder-779578-5-smb devstack@keystone.service[81761]: warnings.warn(msg) Aug 24 17:10:33.195222 dv-cinder-779578-5-smb devstack@keystone.service[81761]: Aug 24 17:10:33.196825 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd55f80-9413-4992-b9e5-fdc3eb5fefd1 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:33.403597 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-8cd55f80-9413-4992-b9e5-fdc3eb5fefd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6148b5892d59461eac9e4a340023b1a5', 'request_id': 'req-8cd55f80-9413-4992-b9e5-fdc3eb5fefd1'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:33.403774 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb95ba-ad49-47af-b738-b2f62fbd8441 service neutron] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:33.410046 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-a5fb95ba-ad49-47af-b738-b2f62fbd8441 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:33.424473 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-8cd55f80-9413-4992-b9e5-fdc3eb5fefd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6148b5892d59461eac9e4a340023b1a5', 'request_id': 'req-8cd55f80-9413-4992-b9e5-fdc3eb5fefd1'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:33.439926 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fb95ba-ad49-47af-b738-b2f62fbd8441 service neutron] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:33.517803 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-8cd55f80-9413-4992-b9e5-fdc3eb5fefd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6148b5892d59461eac9e4a340023b1a5', 'request_id': 'req-8cd55f80-9413-4992-b9e5-fdc3eb5fefd1'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:33.558169 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-8cd55f80-9413-4992-b9e5-fdc3eb5fefd1 admin admin] The token cache is being invalidate because project 6148b5892d59461eac9e4a340023b1a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:10:33.558590 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-8cd55f80-9413-4992-b9e5-fdc3eb5fefd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:33.560199 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-8cd55f80-9413-4992-b9e5-fdc3eb5fefd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:33.568565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 828/1650] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:10:33 2022] DELETE /identity/v3/projects/6148b5892d59461eac9e4a340023b1a5 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:33.569705 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd55f80-9413-4992-b9e5-fdc3eb5fefd1 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:33.571432 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-8cd55f80-9413-4992-b9e5-fdc3eb5fefd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:33.669780 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd55f80-9413-4992-b9e5-fdc3eb5fefd1 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:33.675749 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1fe6e-9c33-4224-bec4-4849997d78f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:33.676561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1fe6e-9c33-4224-bec4-4849997d78f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:33.676938 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1fe6e-9c33-4224-bec4-4849997d78f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:33.677221 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1fe6e-9c33-4224-bec4-4849997d78f0 admin admin] PATH_INFO: `/v3/users/8dd4c57e7b0047e9a2c561ecbb1f8b7c` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:33.678801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1fe6e-9c33-4224-bec4-4849997d78f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dd4c57e7b0047e9a2c561ecbb1f8b7c)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:33.681030 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1fe6e-9c33-4224-bec4-4849997d78f0 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:33.693936 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e6e82c-4750-4a33-89f7-d5f9cbc8b0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:33.694531 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6e82c-4750-4a33-89f7-d5f9cbc8b0f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:33.694812 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6e82c-4750-4a33-89f7-d5f9cbc8b0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:33.695088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e6e82c-4750-4a33-89f7-d5f9cbc8b0f4 admin admin] PATH_INFO: `/v3/projects/25be1ecb85fb47ed9401fdde54de07a1` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:33.700509 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6e82c-4750-4a33-89f7-d5f9cbc8b0f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25be1ecb85fb47ed9401fdde54de07a1)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:33.702910 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e6e82c-4750-4a33-89f7-d5f9cbc8b0f4 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:33.923784 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:33.966531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-9ba1fe6e-9c33-4224-bec4-4849997d78f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dd4c57e7b0047e9a2c561ecbb1f8b7c'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:33.974634 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-73e6e82c-4750-4a33-89f7-d5f9cbc8b0f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25be1ecb85fb47ed9401fdde54de07a1', 'request_id': 'req-73e6e82c-4750-4a33-89f7-d5f9cbc8b0f4'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:33.982987 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-9ba1fe6e-9c33-4224-bec4-4849997d78f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dd4c57e7b0047e9a2c561ecbb1f8b7c'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:34.004922 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-73e6e82c-4750-4a33-89f7-d5f9cbc8b0f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25be1ecb85fb47ed9401fdde54de07a1', 'request_id': 'req-73e6e82c-4750-4a33-89f7-d5f9cbc8b0f4'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:34.031792 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-73e6e82c-4750-4a33-89f7-d5f9cbc8b0f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25be1ecb85fb47ed9401fdde54de07a1', 'request_id': 'req-73e6e82c-4750-4a33-89f7-d5f9cbc8b0f4'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:34.050481 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-9ba1fe6e-9c33-4224-bec4-4849997d78f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dd4c57e7b0047e9a2c561ecbb1f8b7c'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:34.053661 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-9ba1fe6e-9c33-4224-bec4-4849997d78f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dd4c57e7b0047e9a2c561ecbb1f8b7c'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:34.053661 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-9ba1fe6e-9c33-4224-bec4-4849997d78f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dd4c57e7b0047e9a2c561ecbb1f8b7c'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:34.105747 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 829/1651] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:10:33 2022] DELETE /identity/v3/users/8dd4c57e7b0047e9a2c561ecbb1f8b7c => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:34.170530 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1fe6e-9c33-4224-bec4-4849997d78f0 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:34.172218 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-9ba1fe6e-9c33-4224-bec4-4849997d78f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:34.178029 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-73e6e82c-4750-4a33-89f7-d5f9cbc8b0f4 admin admin] The token cache is being invalidate because project 25be1ecb85fb47ed9401fdde54de07a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:10:34.178647 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-73e6e82c-4750-4a33-89f7-d5f9cbc8b0f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:34.179483 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-73e6e82c-4750-4a33-89f7-d5f9cbc8b0f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:34.187519 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 823/1652] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:10:33 2022] DELETE /identity/v3/projects/25be1ecb85fb47ed9401fdde54de07a1 => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:34.189178 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4f1b9-d23b-4989-8db8-ab5477f8d92c None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:34.189505 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4f1b9-d23b-4989-8db8-ab5477f8d92c None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:34.189774 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a4f1b9-d23b-4989-8db8-ab5477f8d92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:34.228994 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-93a4f1b9-d23b-4989-8db8-ab5477f8d92c None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:34.230274 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-93a4f1b9-d23b-4989-8db8-ab5477f8d92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:34.288838 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1fe6e-9c33-4224-bec4-4849997d78f0 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:34.314884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed471b0-1066-4b75-8d54-697d187a6e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:34.316642 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed471b0-1066-4b75-8d54-697d187a6e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:34.317180 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed471b0-1066-4b75-8d54-697d187a6e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:34.317897 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed471b0-1066-4b75-8d54-697d187a6e6a admin admin] PATH_INFO: `/v3/users/ed0aa142aaf44cfa847beb3b7ed38476` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:34.321840 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:34.322388 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed471b0-1066-4b75-8d54-697d187a6e6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed0aa142aaf44cfa847beb3b7ed38476)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:34.326951 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed471b0-1066-4b75-8d54-697d187a6e6a admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:34.378512 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 824/1653] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:34.389261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d33ee-331a-4ed1-be1f-3a8915172508 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:34.389839 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d33ee-331a-4ed1-be1f-3a8915172508 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:34.390568 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68d33ee-331a-4ed1-be1f-3a8915172508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:34.435553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-b68d33ee-331a-4ed1-be1f-3a8915172508 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:34.437933 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-b68d33ee-331a-4ed1-be1f-3a8915172508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:34.458014 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 825/1654] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:34.471644 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d33ee-331a-4ed1-be1f-3a8915172508 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:34.498366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68d33ee-331a-4ed1-be1f-3a8915172508 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:34.527557 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001b36a-49f4-46ec-a681-d0d71a0b12e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:34.528400 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001b36a-49f4-46ec-a681-d0d71a0b12e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:34.528749 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001b36a-49f4-46ec-a681-d0d71a0b12e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:34.529197 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001b36a-49f4-46ec-a681-d0d71a0b12e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:34.530999 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001b36a-49f4-46ec-a681-d0d71a0b12e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:10:34.532681 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001b36a-49f4-46ec-a681-d0d71a0b12e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:34.534370 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001b36a-49f4-46ec-a681-d0d71a0b12e2 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:34.567881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 826/1655] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:10:34.571413 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167dd90-01c3-47a2-aa31-1e525f6d680e None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:34.572785 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167dd90-01c3-47a2-aa31-1e525f6d680e None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:34.576550 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167dd90-01c3-47a2-aa31-1e525f6d680e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:34.661806 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-e167dd90-01c3-47a2-aa31-1e525f6d680e None None] MFA Rules not processed for user `6db32cb7a31746f7bc3e304a9ccb73b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:34.662971 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-e167dd90-01c3-47a2-aa31-1e525f6d680e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:34.671794 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-6ed471b0-1066-4b75-8d54-697d187a6e6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed0aa142aaf44cfa847beb3b7ed38476'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:34.704508 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-6ed471b0-1066-4b75-8d54-697d187a6e6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed0aa142aaf44cfa847beb3b7ed38476'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:34.774986 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-6ed471b0-1066-4b75-8d54-697d187a6e6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed0aa142aaf44cfa847beb3b7ed38476'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:34.775666 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-6ed471b0-1066-4b75-8d54-697d187a6e6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed0aa142aaf44cfa847beb3b7ed38476'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:34.776726 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-6ed471b0-1066-4b75-8d54-697d187a6e6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed0aa142aaf44cfa847beb3b7ed38476'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:34.822762 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 830/1656] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:10:34 2022] DELETE /identity/v3/users/ed0aa142aaf44cfa847beb3b7ed38476 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:34.822762 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed471b0-1066-4b75-8d54-697d187a6e6a admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:34.825016 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-6ed471b0-1066-4b75-8d54-697d187a6e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:34.880627 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 827/1657] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:34 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:34.886187 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8123ed3-2b60-4217-aa4c-e90f5cb7a53f None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:34.886187 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8123ed3-2b60-4217-aa4c-e90f5cb7a53f None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:34.886187 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8123ed3-2b60-4217-aa4c-e90f5cb7a53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:34.935500 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-b8123ed3-2b60-4217-aa4c-e90f5cb7a53f None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:34.940103 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-b8123ed3-2b60-4217-aa4c-e90f5cb7a53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:35.020147 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed471b0-1066-4b75-8d54-697d187a6e6a admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:35.034214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae55e8-54fc-4d3e-9f90-074002325ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:35.038608 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae55e8-54fc-4d3e-9f90-074002325ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:35.038994 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae55e8-54fc-4d3e-9f90-074002325ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:35.039306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae55e8-54fc-4d3e-9f90-074002325ec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:35.039991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae55e8-54fc-4d3e-9f90-074002325ec9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:35.041941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae55e8-54fc-4d3e-9f90-074002325ec9 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:35.125788 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 828/1658] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:35.187874 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8123ed3-2b60-4217-aa4c-e90f5cb7a53f None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:35.190896 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-b8123ed3-2b60-4217-aa4c-e90f5cb7a53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:35.191432 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 831/1659] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:10:34 2022] POST /identity/v3/projects => generated 365 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:35.193034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae55e8-54fc-4d3e-9f90-074002325ec9 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:35.301311 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae55e8-54fc-4d3e-9f90-074002325ec9 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:35.308511 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c22f9-64ab-493a-b01d-78cfcd1bc684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:35.309250 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c22f9-64ab-493a-b01d-78cfcd1bc684 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:35.310080 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c22f9-64ab-493a-b01d-78cfcd1bc684 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:35.310612 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c22f9-64ab-493a-b01d-78cfcd1bc684 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:35.312002 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c22f9-64ab-493a-b01d-78cfcd1bc684 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:35.315459 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c22f9-64ab-493a-b01d-78cfcd1bc684 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:35.356167 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8123ed3-2b60-4217-aa4c-e90f5cb7a53f None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:35.404103 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 832/1660] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:10:35 2022] POST /identity/v3/users => generated 283 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:35.411137 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c22f9-64ab-493a-b01d-78cfcd1bc684 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:35.444413 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c22f9-64ab-493a-b01d-78cfcd1bc684 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:35.456124 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76500746-25ff-4712-abae-582c8a6d0307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:35.456782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76500746-25ff-4712-abae-582c8a6d0307 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:35.459332 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76500746-25ff-4712-abae-582c8a6d0307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:35.459704 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76500746-25ff-4712-abae-582c8a6d0307 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:35.460391 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76500746-25ff-4712-abae-582c8a6d0307 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:35.466553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76500746-25ff-4712-abae-582c8a6d0307 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:35.484225 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:DELETE=5,keystone:SELECT=95 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:35.497243 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 833/1661] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:35.498271 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76500746-25ff-4712-abae-582c8a6d0307 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:35.500628 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33774214-85e7-42dd-af8c-fe2e5fb5dea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:35.501509 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33774214-85e7-42dd-af8c-fe2e5fb5dea5 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:35.501636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33774214-85e7-42dd-af8c-fe2e5fb5dea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:35.501822 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33774214-85e7-42dd-af8c-fe2e5fb5dea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:35.524821 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76500746-25ff-4712-abae-582c8a6d0307 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:35.529299 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33774214-85e7-42dd-af8c-fe2e5fb5dea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:35.536755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33774214-85e7-42dd-af8c-fe2e5fb5dea5 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:35.540366 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf612b5-e6ff-4fef-8ec0-a92104afced1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:35.541139 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf612b5-e6ff-4fef-8ec0-a92104afced1 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:35.541906 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf612b5-e6ff-4fef-8ec0-a92104afced1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:35.543382 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf612b5-e6ff-4fef-8ec0-a92104afced1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:35.545920 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf612b5-e6ff-4fef-8ec0-a92104afced1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:35.549861 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf612b5-e6ff-4fef-8ec0-a92104afced1 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:35.566572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 829/1662] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:10:35.579960 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33774214-85e7-42dd-af8c-fe2e5fb5dea5 service neutron] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:35.593823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 834/1663] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:35.596496 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33774214-85e7-42dd-af8c-fe2e5fb5dea5 service neutron] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:35.603076 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84316199-02e1-446f-bccc-33acdbf86eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:35.603972 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84316199-02e1-446f-bccc-33acdbf86eef admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:35.605155 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84316199-02e1-446f-bccc-33acdbf86eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:35.605508 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84316199-02e1-446f-bccc-33acdbf86eef admin admin] PATH_INFO: `/v3/projects/319b7b2e668541db9098915550863f14/users/20518eff98f044c48d49d7fd213220e1/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:35.632642 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84316199-02e1-446f-bccc-33acdbf86eef admin admin] RBAC: Authorizing `identity:create_grant(project_id=319b7b2e668541db9098915550863f14, user_id=20518eff98f044c48d49d7fd213220e1, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:35.636107 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84316199-02e1-446f-bccc-33acdbf86eef admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:35.724961 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 830/1664] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:10:35 2022] PUT /identity/v3/projects/319b7b2e668541db9098915550863f14/users/20518eff98f044c48d49d7fd213220e1/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:35.740780 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f817af-69c8-4565-86d6-bd6a2934e013 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:35.741073 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f817af-69c8-4565-86d6-bd6a2934e013 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:35.741351 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f817af-69c8-4565-86d6-bd6a2934e013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:35.822097 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-c5f817af-69c8-4565-86d6-bd6a2934e013 None None] MFA Rules not processed for user `20518eff98f044c48d49d7fd213220e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:35.833771 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-c5f817af-69c8-4565-86d6-bd6a2934e013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:35.870492 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:36.030848 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84316199-02e1-446f-bccc-33acdbf86eef admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:36.031306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 835/1665] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:36.156857 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84316199-02e1-446f-bccc-33acdbf86eef admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:36.162257 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1077082-1534-4541-b3b1-1c8a11bc79bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:36.162892 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1077082-1534-4541-b3b1-1c8a11bc79bf admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:36.163212 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1077082-1534-4541-b3b1-1c8a11bc79bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:36.163492 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1077082-1534-4541-b3b1-1c8a11bc79bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:36.164282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1077082-1534-4541-b3b1-1c8a11bc79bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:36.166305 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1077082-1534-4541-b3b1-1c8a11bc79bf admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:36.326817 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 831/1666] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:10:36 2022] POST /identity/v3/projects => generated 365 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:36.329174 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f817af-69c8-4565-86d6-bd6a2934e013 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:36.344702 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:36.359324 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f817af-69c8-4565-86d6-bd6a2934e013 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:36.472562 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f5da0-2c47-4036-ae7e-8a75b08dafdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:36.473185 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f5da0-2c47-4036-ae7e-8a75b08dafdf admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:36.473987 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f5da0-2c47-4036-ae7e-8a75b08dafdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:36.474335 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f5da0-2c47-4036-ae7e-8a75b08dafdf admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:36.474983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f5da0-2c47-4036-ae7e-8a75b08dafdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:36.477398 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f5da0-2c47-4036-ae7e-8a75b08dafdf admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:36.530820 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1077082-1534-4541-b3b1-1c8a11bc79bf admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:36.533961 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-e1077082-1534-4541-b3b1-1c8a11bc79bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:36.555843 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1077082-1534-4541-b3b1-1c8a11bc79bf admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:36.569991 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d9e90-6f75-47fc-b4ec-bfbb9d368047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:36.571756 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d9e90-6f75-47fc-b4ec-bfbb9d368047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:36.575998 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d9e90-6f75-47fc-b4ec-bfbb9d368047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:36.575998 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d9e90-6f75-47fc-b4ec-bfbb9d368047 admin admin] PATH_INFO: `/v3/projects/ad56daf2c3e044a189e98c5bd9deef71` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:36.575998 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d9e90-6f75-47fc-b4ec-bfbb9d368047 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad56daf2c3e044a189e98c5bd9deef71)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:36.577486 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d9e90-6f75-47fc-b4ec-bfbb9d368047 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:36.602436 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 836/1667] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:10:36 2022] POST /identity/v3/users => generated 289 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:10:36.606751 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f5da0-2c47-4036-ae7e-8a75b08dafdf admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:36.631524 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f5da0-2c47-4036-ae7e-8a75b08dafdf admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:36.650243 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b55d0-1a99-4b96-b194-41a135680c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:36.650921 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b55d0-1a99-4b96-b194-41a135680c27 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:36.651379 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b55d0-1a99-4b96-b194-41a135680c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:36.651680 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38b55d0-1a99-4b96-b194-41a135680c27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:36.652402 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b55d0-1a99-4b96-b194-41a135680c27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:36.654034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38b55d0-1a99-4b96-b194-41a135680c27 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:36.677027 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 837/1668] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:10:36.681091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b55d0-1a99-4b96-b194-41a135680c27 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:36.697481 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38b55d0-1a99-4b96-b194-41a135680c27 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:36.711772 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236deb5-a6e8-4640-b4e8-19affaab289b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:36.712465 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236deb5-a6e8-4640-b4e8-19affaab289b admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:36.712740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236deb5-a6e8-4640-b4e8-19affaab289b admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:36.713053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5236deb5-a6e8-4640-b4e8-19affaab289b admin admin] PATH_INFO: `/v3/projects/04305b0bd25145b69019f82c78178818/users/24803630da08456ab4a2d4b3cb2eba54/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:36.750376 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236deb5-a6e8-4640-b4e8-19affaab289b admin admin] RBAC: Authorizing `identity:create_grant(project_id=04305b0bd25145b69019f82c78178818, user_id=24803630da08456ab4a2d4b3cb2eba54, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:36.755683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5236deb5-a6e8-4640-b4e8-19affaab289b admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:36.768654 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-a65d9e90-6f75-47fc-b4ec-bfbb9d368047 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad56daf2c3e044a189e98c5bd9deef71', 'request_id': 'req-a65d9e90-6f75-47fc-b4ec-bfbb9d368047'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:36.795414 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-a65d9e90-6f75-47fc-b4ec-bfbb9d368047 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad56daf2c3e044a189e98c5bd9deef71', 'request_id': 'req-a65d9e90-6f75-47fc-b4ec-bfbb9d368047'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:36.822298 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-a65d9e90-6f75-47fc-b4ec-bfbb9d368047 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad56daf2c3e044a189e98c5bd9deef71', 'request_id': 'req-a65d9e90-6f75-47fc-b4ec-bfbb9d368047'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:36.844402 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 838/1669] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:10:36 2022] PUT /identity/v3/projects/04305b0bd25145b69019f82c78178818/users/24803630da08456ab4a2d4b3cb2eba54/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:36.848371 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236deb5-a6e8-4640-b4e8-19affaab289b admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:36.941074 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-a65d9e90-6f75-47fc-b4ec-bfbb9d368047 admin admin] The token cache is being invalidate because project ad56daf2c3e044a189e98c5bd9deef71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:10:36.941374 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-a65d9e90-6f75-47fc-b4ec-bfbb9d368047 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:36.943990 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-a65d9e90-6f75-47fc-b4ec-bfbb9d368047 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:36.947161 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 832/1670] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:10:36 2022] DELETE /identity/v3/projects/ad56daf2c3e044a189e98c5bd9deef71 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:36.959141 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e2810-5d82-4eb5-a2a7-1f2ca9cc78fa None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:36.959437 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e2810-5d82-4eb5-a2a7-1f2ca9cc78fa None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:36.959718 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e2810-5d82-4eb5-a2a7-1f2ca9cc78fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:37.050499 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-9e2e2810-5d82-4eb5-a2a7-1f2ca9cc78fa None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:37.050499 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-9e2e2810-5d82-4eb5-a2a7-1f2ca9cc78fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:37.118455 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5236deb5-a6e8-4640-b4e8-19affaab289b admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:37.134459 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e9f46-ba08-4b5f-ac45-e512b15a6c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:37.137483 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e9f46-ba08-4b5f-ac45-e512b15a6c7c admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:37.137938 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e9f46-ba08-4b5f-ac45-e512b15a6c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:37.138889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187e9f46-ba08-4b5f-ac45-e512b15a6c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:37.141051 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e9f46-ba08-4b5f-ac45-e512b15a6c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:37.144442 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187e9f46-ba08-4b5f-ac45-e512b15a6c7c admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:37.171303 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 833/1671] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:37.171303 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8971d-6b16-42b8-9b28-b301111eb18d None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:37.171303 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8971d-6b16-42b8-9b28-b301111eb18d None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:37.171303 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8971d-6b16-42b8-9b28-b301111eb18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:37.187091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 839/1672] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:36 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:10:37.191187 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e9f46-ba08-4b5f-ac45-e512b15a6c7c admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:37.195160 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-187e9f46-ba08-4b5f-ac45-e512b15a6c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:37.205178 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-87b8971d-6b16-42b8-9b28-b301111eb18d None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:37.206529 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-87b8971d-6b16-42b8-9b28-b301111eb18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:37.220026 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 834/1673] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:37.223773 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187e9f46-ba08-4b5f-ac45-e512b15a6c7c admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:37.227305 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8971d-6b16-42b8-9b28-b301111eb18d None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:37.239498 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ffc1f-ef75-40b2-a803-2794bae68596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:37.239498 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ffc1f-ef75-40b2-a803-2794bae68596 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:37.239498 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ffc1f-ef75-40b2-a803-2794bae68596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:37.239498 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ffc1f-ef75-40b2-a803-2794bae68596 admin admin] PATH_INFO: `/v3/projects/04305b0bd25145b69019f82c78178818/users/24803630da08456ab4a2d4b3cb2eba54/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:37.243090 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ffc1f-ef75-40b2-a803-2794bae68596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04305b0bd25145b69019f82c78178818, user_id=24803630da08456ab4a2d4b3cb2eba54, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:37.246036 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ffc1f-ef75-40b2-a803-2794bae68596 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:37.248384 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8971d-6b16-42b8-9b28-b301111eb18d None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:37.279228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 840/1674] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:10:37 2022] PUT /identity/v3/projects/04305b0bd25145b69019f82c78178818/users/24803630da08456ab4a2d4b3cb2eba54/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:10:37.286767 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03caadf7-0312-408d-8614-fd8e0dd6e2e7 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:37.287046 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03caadf7-0312-408d-8614-fd8e0dd6e2e7 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:37.287356 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03caadf7-0312-408d-8614-fd8e0dd6e2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:37.288587 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074803d-20aa-45a6-9064-5c44ca6016d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:37.289382 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074803d-20aa-45a6-9064-5c44ca6016d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:37.290091 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074803d-20aa-45a6-9064-5c44ca6016d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:37.290291 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074803d-20aa-45a6-9064-5c44ca6016d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:37.291181 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5074803d-20aa-45a6-9064-5c44ca6016d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:10:37.291492 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5074803d-20aa-45a6-9064-5c44ca6016d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:37.295255 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5074803d-20aa-45a6-9064-5c44ca6016d9 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:37.333205 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 835/1675] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:10:37.338318 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074803d-20aa-45a6-9064-5c44ca6016d9 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:37.347551 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-03caadf7-0312-408d-8614-fd8e0dd6e2e7 None None] MFA Rules not processed for user `24803630da08456ab4a2d4b3cb2eba54`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:37.349121 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-03caadf7-0312-408d-8614-fd8e0dd6e2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:37.367500 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074803d-20aa-45a6-9064-5c44ca6016d9 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:37.483367 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 841/1676] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:37 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:10:37.487839 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03caadf7-0312-408d-8614-fd8e0dd6e2e7 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:37.489249 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-03caadf7-0312-408d-8614-fd8e0dd6e2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:37.492078 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a432b1-50ee-4349-9e31-218b3f2c9de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:37.492760 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a432b1-50ee-4349-9e31-218b3f2c9de9 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:37.493048 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a432b1-50ee-4349-9e31-218b3f2c9de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:37.493327 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a432b1-50ee-4349-9e31-218b3f2c9de9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:37.494031 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a432b1-50ee-4349-9e31-218b3f2c9de9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:37.496522 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a432b1-50ee-4349-9e31-218b3f2c9de9 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:37.528633 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:37.646350 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 836/1677] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:10:37 2022] POST /identity/v3/projects => generated 371 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:10:37.658878 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a432b1-50ee-4349-9e31-218b3f2c9de9 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:37.661947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03caadf7-0312-408d-8614-fd8e0dd6e2e7 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:37.815292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d486cb40-d9e3-4954-9ead-f1f31b8984ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:37.816737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486cb40-d9e3-4954-9ead-f1f31b8984ac service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:37.819708 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486cb40-d9e3-4954-9ead-f1f31b8984ac service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:37.822753 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d486cb40-d9e3-4954-9ead-f1f31b8984ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:37.852119 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a432b1-50ee-4349-9e31-218b3f2c9de9 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:37.875833 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a8a1d-29d7-4696-8e5a-b38cdc5a7870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:37.877628 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a8a1d-29d7-4696-8e5a-b38cdc5a7870 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:37.877921 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a8a1d-29d7-4696-8e5a-b38cdc5a7870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:37.878200 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a8a1d-29d7-4696-8e5a-b38cdc5a7870 admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:37.878923 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a8a1d-29d7-4696-8e5a-b38cdc5a7870 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:37.882698 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477a8a1d-29d7-4696-8e5a-b38cdc5a7870 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:37.968724 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486cb40-d9e3-4954-9ead-f1f31b8984ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:37.971454 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d486cb40-d9e3-4954-9ead-f1f31b8984ac service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:37.991447 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 837/1678] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:10:37 2022] POST /identity/v3/users => generated 286 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:37.994012 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f15cf8-02b8-4628-a5db-e9e4d87f403b None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:37.994525 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f15cf8-02b8-4628-a5db-e9e4d87f403b None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:37.995958 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f15cf8-02b8-4628-a5db-e9e4d87f403b None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:37.999757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 838/1679] 10.222.0.55 () {54 vars in 921 bytes} [Wed Aug 24 17:10:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:10:38.002009 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f15cf8-02b8-4628-a5db-e9e4d87f403b None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:38.006497 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 842/1680] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:37 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:10:38.018478 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a7892-030b-455b-a386-1856f7cab5a9 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:38.019006 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a7892-030b-455b-a386-1856f7cab5a9 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:38.019434 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437a7892-030b-455b-a386-1856f7cab5a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:38.037884 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f15cf8-02b8-4628-a5db-e9e4d87f403b None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:38.054663 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0ee0d-a274-463b-a154-c5a77fcc32ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:38.058062 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0ee0d-a274-463b-a154-c5a77fcc32ca admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:38.058527 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0ee0d-a274-463b-a154-c5a77fcc32ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:38.059636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0ee0d-a274-463b-a154-c5a77fcc32ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:38.063903 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0ee0d-a274-463b-a154-c5a77fcc32ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:38.072233 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-437a7892-030b-455b-a386-1856f7cab5a9 None None] MFA Rules not processed for user `32ef97356edf406aad9ab5f502bdb0af`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:38.072518 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0ee0d-a274-463b-a154-c5a77fcc32ca admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:38.072624 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-437a7892-030b-455b-a386-1856f7cab5a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:38.098342 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 839/1681] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:38.103230 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0ee0d-a274-463b-a154-c5a77fcc32ca admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:38.131517 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0ee0d-a274-463b-a154-c5a77fcc32ca admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:38.152057 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6db7fb-2c13-4d02-bfa6-3c2b0b51473d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:38.161087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6db7fb-2c13-4d02-bfa6-3c2b0b51473d admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:38.161087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6db7fb-2c13-4d02-bfa6-3c2b0b51473d admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:38.161087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6db7fb-2c13-4d02-bfa6-3c2b0b51473d admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:38.161087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6db7fb-2c13-4d02-bfa6-3c2b0b51473d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:38.161087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6db7fb-2c13-4d02-bfa6-3c2b0b51473d admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:38.203224 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 840/1682] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:38.220057 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6db7fb-2c13-4d02-bfa6-3c2b0b51473d admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:38.251333 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6db7fb-2c13-4d02-bfa6-3c2b0b51473d admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:38.261131 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 843/1683] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Aug 24 17:10:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:38.263869 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc8297-9e4c-460e-a47a-4720b8b31321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:38.265744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc8297-9e4c-460e-a47a-4720b8b31321 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:38.266215 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc8297-9e4c-460e-a47a-4720b8b31321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:38.266662 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc8297-9e4c-460e-a47a-4720b8b31321 admin admin] PATH_INFO: `/v3/projects/a5b5ec3dd5b04f35985942486fbed226/users/010764259ded4986b8f02d164c397706/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:38.306637 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc8297-9e4c-460e-a47a-4720b8b31321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5b5ec3dd5b04f35985942486fbed226, user_id=010764259ded4986b8f02d164c397706, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:38.309660 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dc8297-9e4c-460e-a47a-4720b8b31321 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:38.369033 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a7892-030b-455b-a386-1856f7cab5a9 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:38.383403 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437a7892-030b-455b-a386-1856f7cab5a9 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:38.399186 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5dd713-0a61-4e3e-a82f-555387b99551 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:38.399398 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dd713-0a61-4e3e-a82f-555387b99551 service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:38.402092 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dd713-0a61-4e3e-a82f-555387b99551 service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:38.402092 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dd713-0a61-4e3e-a82f-555387b99551 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:38.409974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-fa5dd713-0a61-4e3e-a82f-555387b99551 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:38.429124 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 841/1684] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:10:38 2022] PUT /identity/v3/projects/a5b5ec3dd5b04f35985942486fbed226/users/010764259ded4986b8f02d164c397706/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:38.441814 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52feaac2-81b5-4c79-9d82-c8a876dcecb4 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:38.441814 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52feaac2-81b5-4c79-9d82-c8a876dcecb4 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:38.442770 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52feaac2-81b5-4c79-9d82-c8a876dcecb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:38.445909 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:38.510354 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-52feaac2-81b5-4c79-9d82-c8a876dcecb4 None None] MFA Rules not processed for user `010764259ded4986b8f02d164c397706`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:38.511856 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-52feaac2-81b5-4c79-9d82-c8a876dcecb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:38.516312 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5dd713-0a61-4e3e-a82f-555387b99551 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:38.517879 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5dd713-0a61-4e3e-a82f-555387b99551 service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:38.529842 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 844/1685] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:10:38.532929 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03251e97-c7db-4e69-8fa7-3cb34fae448b None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:38.538187 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03251e97-c7db-4e69-8fa7-3cb34fae448b None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:38.538187 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03251e97-c7db-4e69-8fa7-3cb34fae448b None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:38.539317 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 845/1686] 10.222.0.55 () {54 vars in 961 bytes} [Wed Aug 24 17:10:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:10:38.540738 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260699a7-47b6-4063-826c-67ee48a9b77e None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:38.541533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260699a7-47b6-4063-826c-67ee48a9b77e None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:38.541997 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260699a7-47b6-4063-826c-67ee48a9b77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:38.575758 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-260699a7-47b6-4063-826c-67ee48a9b77e None None] MFA Rules not processed for user `32ef97356edf406aad9ab5f502bdb0af`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:38.578365 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-260699a7-47b6-4063-826c-67ee48a9b77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:38.630695 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:38.679702 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 842/1687] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:38.689453 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52feaac2-81b5-4c79-9d82-c8a876dcecb4 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:38.772810 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 846/1688] 10.222.0.55 () {58 vars in 1058 bytes} [Wed Aug 24 17:10:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:38.773835 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260699a7-47b6-4063-826c-67ee48a9b77e None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:38.791343 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260699a7-47b6-4063-826c-67ee48a9b77e None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:38.814649 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869887fc-4ab7-44e2-8423-79ece7d3adf3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ef97356edf406aad9ab5f502bdb0af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:38.815468 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869887fc-4ab7-44e2-8423-79ece7d3adf3 service placement] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:38.815763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869887fc-4ab7-44e2-8423-79ece7d3adf3 service placement] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:38.816037 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869887fc-4ab7-44e2-8423-79ece7d3adf3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:38.837104 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869887fc-4ab7-44e2-8423-79ece7d3adf3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:38.841241 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869887fc-4ab7-44e2-8423-79ece7d3adf3 service placement] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:38.870516 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52feaac2-81b5-4c79-9d82-c8a876dcecb4 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:38.886458 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb763bd-6499-42f7-94e7-ef318590d9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:38.887282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb763bd-6499-42f7-94e7-ef318590d9e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:38.887619 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb763bd-6499-42f7-94e7-ef318590d9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:38.887903 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb763bd-6499-42f7-94e7-ef318590d9e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:38.888521 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb763bd-6499-42f7-94e7-ef318590d9e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:38.894489 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb763bd-6499-42f7-94e7-ef318590d9e6 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:38.897052 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 847/1689] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:10:39.026454 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869887fc-4ab7-44e2-8423-79ece7d3adf3 service placement] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:39.027991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-869887fc-4ab7-44e2-8423-79ece7d3adf3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:39.028284 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 843/1690] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:10:38 2022] POST /identity/v3/projects => generated 373 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:10:39.035706 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb763bd-6499-42f7-94e7-ef318590d9e6 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:39.080768 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869887fc-4ab7-44e2-8423-79ece7d3adf3 service placement] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:39.210011 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb763bd-6499-42f7-94e7-ef318590d9e6 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:39.214488 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb3fa48-a792-43db-8254-8ddb59aafbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:39.215476 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3fa48-a792-43db-8254-8ddb59aafbc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:39.215802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3fa48-a792-43db-8254-8ddb59aafbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:39.216080 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb3fa48-a792-43db-8254-8ddb59aafbc3 admin admin] PATH_INFO: `/v3/projects/1638304304f94925ac86f9dda77b8fff` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:39.217403 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb3fa48-a792-43db-8254-8ddb59aafbc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1638304304f94925ac86f9dda77b8fff)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:39.219826 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb3fa48-a792-43db-8254-8ddb59aafbc3 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:39.223627 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cadd2d2-83a8-4532-bb23-0b0f7c177adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:39.224245 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadd2d2-83a8-4532-bb23-0b0f7c177adc admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:39.224522 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadd2d2-83a8-4532-bb23-0b0f7c177adc admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:39.224791 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cadd2d2-83a8-4532-bb23-0b0f7c177adc admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:39.225430 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cadd2d2-83a8-4532-bb23-0b0f7c177adc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:39.227418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cadd2d2-83a8-4532-bb23-0b0f7c177adc admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:39.341929 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 844/1691] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:10:39 2022] POST /identity/v3/users => generated 293 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:10:39.346955 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cadd2d2-83a8-4532-bb23-0b0f7c177adc admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:39.366246 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cadd2d2-83a8-4532-bb23-0b0f7c177adc admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:39.387933 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238d31f-4071-4b39-ae34-fcc036d9f80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:39.388560 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238d31f-4071-4b39-ae34-fcc036d9f80b admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:39.388672 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238d31f-4071-4b39-ae34-fcc036d9f80b admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:39.388983 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6238d31f-4071-4b39-ae34-fcc036d9f80b admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:39.390235 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238d31f-4071-4b39-ae34-fcc036d9f80b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:39.391901 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6238d31f-4071-4b39-ae34-fcc036d9f80b admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:39.413488 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 845/1692] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:39.417550 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238d31f-4071-4b39-ae34-fcc036d9f80b admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:39.418106 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-8eb3fa48-a792-43db-8254-8ddb59aafbc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1638304304f94925ac86f9dda77b8fff', 'request_id': 'req-8eb3fa48-a792-43db-8254-8ddb59aafbc3'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:39.432234 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-8eb3fa48-a792-43db-8254-8ddb59aafbc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1638304304f94925ac86f9dda77b8fff', 'request_id': 'req-8eb3fa48-a792-43db-8254-8ddb59aafbc3'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:39.441441 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6238d31f-4071-4b39-ae34-fcc036d9f80b admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:39.537100 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-8eb3fa48-a792-43db-8254-8ddb59aafbc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1638304304f94925ac86f9dda77b8fff', 'request_id': 'req-8eb3fa48-a792-43db-8254-8ddb59aafbc3'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:39.560060 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-8eb3fa48-a792-43db-8254-8ddb59aafbc3 admin admin] The token cache is being invalidate because project 1638304304f94925ac86f9dda77b8fff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:10:39.560547 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-8eb3fa48-a792-43db-8254-8ddb59aafbc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:39.562098 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-8eb3fa48-a792-43db-8254-8ddb59aafbc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:39.570730 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 848/1693] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:10:39 2022] DELETE /identity/v3/projects/1638304304f94925ac86f9dda77b8fff => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:39.578506 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedeb35e-32e3-4686-87a3-2dab6969e84e None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:39.578957 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedeb35e-32e3-4686-87a3-2dab6969e84e None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:39.584371 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedeb35e-32e3-4686-87a3-2dab6969e84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:39.613167 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b033b-e8c4-4684-838a-c9c9b96761e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:39.613958 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b033b-e8c4-4684-838a-c9c9b96761e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:39.614244 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b033b-e8c4-4684-838a-c9c9b96761e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:39.614518 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b033b-e8c4-4684-838a-c9c9b96761e0 admin admin] PATH_INFO: `/v3/projects/bfb27de84a144d94939d6e11ecc23362/users/c4a4b1cef0644502aff0f02ce79f17ef/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:39.654646 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b033b-e8c4-4684-838a-c9c9b96761e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfb27de84a144d94939d6e11ecc23362, user_id=c4a4b1cef0644502aff0f02ce79f17ef, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:39.659287 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b033b-e8c4-4684-838a-c9c9b96761e0 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:39.661419 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-fedeb35e-32e3-4686-87a3-2dab6969e84e None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:39.662734 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-fedeb35e-32e3-4686-87a3-2dab6969e84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:39.710178 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 849/1694] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:39.716157 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f3edd-f077-46b7-a83d-4e5f45df4cba None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:39.716157 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f3edd-f077-46b7-a83d-4e5f45df4cba None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:39.716157 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f3edd-f077-46b7-a83d-4e5f45df4cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:39.751084 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-923f3edd-f077-46b7-a83d-4e5f45df4cba None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:39.756754 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-923f3edd-f077-46b7-a83d-4e5f45df4cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:39.775033 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 850/1695] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:39.780088 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f3edd-f077-46b7-a83d-4e5f45df4cba None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:39.791959 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 846/1696] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:10:39 2022] PUT /identity/v3/projects/bfb27de84a144d94939d6e11ecc23362/users/c4a4b1cef0644502aff0f02ce79f17ef/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:39.792628 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f3edd-f077-46b7-a83d-4e5f45df4cba None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:39.793034 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b033b-e8c4-4684-838a-c9c9b96761e0 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:39.796720 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-c74b033b-e8c4-4684-838a-c9c9b96761e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:39.884984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095bf95-dc9e-4f0d-be0a-f23a0f00bc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:39.888377 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095bf95-dc9e-4f0d-be0a-f23a0f00bc2b admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:39.888828 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095bf95-dc9e-4f0d-be0a-f23a0f00bc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:39.889923 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095bf95-dc9e-4f0d-be0a-f23a0f00bc2b admin admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:39.892325 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095bf95-dc9e-4f0d-be0a-f23a0f00bc2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:10:39.892920 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095bf95-dc9e-4f0d-be0a-f23a0f00bc2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:39.895711 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095bf95-dc9e-4f0d-be0a-f23a0f00bc2b admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:39.930624 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 851/1697] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:10:39.932074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095bf95-dc9e-4f0d-be0a-f23a0f00bc2b admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:39.958370 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095bf95-dc9e-4f0d-be0a-f23a0f00bc2b admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:39.972883 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65057da-6bb3-4555-9d8d-87cc38524359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:39.973716 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65057da-6bb3-4555-9d8d-87cc38524359 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:39.973997 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65057da-6bb3-4555-9d8d-87cc38524359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:39.974302 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65057da-6bb3-4555-9d8d-87cc38524359 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:39.978402 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65057da-6bb3-4555-9d8d-87cc38524359 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:39.978802 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b033b-e8c4-4684-838a-c9c9b96761e0 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:39.983808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65057da-6bb3-4555-9d8d-87cc38524359 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:39.991730 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cfe46-977e-484c-b56e-2f1856a9c630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:39.995376 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cfe46-977e-484c-b56e-2f1856a9c630 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:39.995819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cfe46-977e-484c-b56e-2f1856a9c630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:39.996082 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3cfe46-977e-484c-b56e-2f1856a9c630 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:39.996831 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3cfe46-977e-484c-b56e-2f1856a9c630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:40.001967 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3cfe46-977e-484c-b56e-2f1856a9c630 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:40.031141 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 847/1698] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:40.033173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cfe46-977e-484c-b56e-2f1856a9c630 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:40.050680 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3cfe46-977e-484c-b56e-2f1856a9c630 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:40.057093 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68dbd48-11e5-4e71-97e4-31ea46f6ed04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:40.057649 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68dbd48-11e5-4e71-97e4-31ea46f6ed04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:40.057932 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68dbd48-11e5-4e71-97e4-31ea46f6ed04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:40.058407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68dbd48-11e5-4e71-97e4-31ea46f6ed04 admin admin] PATH_INFO: `/v3/projects/bfb27de84a144d94939d6e11ecc23362/users/c4a4b1cef0644502aff0f02ce79f17ef/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:40.061522 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68dbd48-11e5-4e71-97e4-31ea46f6ed04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfb27de84a144d94939d6e11ecc23362, user_id=c4a4b1cef0644502aff0f02ce79f17ef, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:40.065115 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68dbd48-11e5-4e71-97e4-31ea46f6ed04 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:40.088012 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 848/1699] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:10:40 2022] PUT /identity/v3/projects/bfb27de84a144d94939d6e11ecc23362/users/c4a4b1cef0644502aff0f02ce79f17ef/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:10:40.092103 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c761671-a5b5-4e8a-81b5-b8c9d1f0c6c8 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:40.093649 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c761671-a5b5-4e8a-81b5-b8c9d1f0c6c8 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:40.093649 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c761671-a5b5-4e8a-81b5-b8c9d1f0c6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:40.137066 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-9c761671-a5b5-4e8a-81b5-b8c9d1f0c6c8 None None] MFA Rules not processed for user `c4a4b1cef0644502aff0f02ce79f17ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:40.137066 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-9c761671-a5b5-4e8a-81b5-b8c9d1f0c6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:40.194345 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 852/1700] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:10:39 2022] POST /identity/v3/projects => generated 371 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:40.196610 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65057da-6bb3-4555-9d8d-87cc38524359 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:40.234874 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:40.344502 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:40.425966 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 849/1701] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:10:40.436678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65057da-6bb3-4555-9d8d-87cc38524359 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:40.443181 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c761671-a5b5-4e8a-81b5-b8c9d1f0c6c8 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:40.444263 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-9c761671-a5b5-4e8a-81b5-b8c9d1f0c6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:40.468577 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e2b28-b792-49f0-857c-e253e48e0aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:40.471363 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e2b28-b792-49f0-857c-e253e48e0aef admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:40.471656 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e2b28-b792-49f0-857c-e253e48e0aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:40.471923 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e2b28-b792-49f0-857c-e253e48e0aef admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:40.476187 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e2b28-b792-49f0-857c-e253e48e0aef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:40.484762 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e2b28-b792-49f0-857c-e253e48e0aef admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:40.598296 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c761671-a5b5-4e8a-81b5-b8c9d1f0c6c8 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:40.643730 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 853/1702] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:10:40 2022] POST /identity/v3/users => generated 286 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:40.644339 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e2b28-b792-49f0-857c-e253e48e0aef admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:40.660429 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e2b28-b792-49f0-857c-e253e48e0aef admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:40.666664 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689b006-77fb-4454-a96a-6fae0b527fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:40.667157 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689b006-77fb-4454-a96a-6fae0b527fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:40.667441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689b006-77fb-4454-a96a-6fae0b527fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:40.667750 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e689b006-77fb-4454-a96a-6fae0b527fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:40.670102 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689b006-77fb-4454-a96a-6fae0b527fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:40.672054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e689b006-77fb-4454-a96a-6fae0b527fc3 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:40.688275 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 854/1703] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:40.692625 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689b006-77fb-4454-a96a-6fae0b527fc3 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:40.708919 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e689b006-77fb-4454-a96a-6fae0b527fc3 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:40.714876 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed53d8a-7fe9-45ed-8b95-e406985c7238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:40.716032 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed53d8a-7fe9-45ed-8b95-e406985c7238 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:40.716455 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed53d8a-7fe9-45ed-8b95-e406985c7238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:40.716730 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed53d8a-7fe9-45ed-8b95-e406985c7238 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:40.717416 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed53d8a-7fe9-45ed-8b95-e406985c7238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:40.720805 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed53d8a-7fe9-45ed-8b95-e406985c7238 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:40.725773 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9fc36-7455-4390-a2d0-043888316455 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:40.726444 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9fc36-7455-4390-a2d0-043888316455 service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:40.726736 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9fc36-7455-4390-a2d0-043888316455 service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:40.727013 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9fc36-7455-4390-a2d0-043888316455 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:40.765871 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 855/1704] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:40.767087 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed53d8a-7fe9-45ed-8b95-e406985c7238 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:40.801855 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed53d8a-7fe9-45ed-8b95-e406985c7238 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:40.821107 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a63d4c5-36b4-4d78-b445-48fe3a031236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:40.827401 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63d4c5-36b4-4d78-b445-48fe3a031236 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:40.849808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63d4c5-36b4-4d78-b445-48fe3a031236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:40.852577 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a63d4c5-36b4-4d78-b445-48fe3a031236 admin admin] PATH_INFO: `/v3/projects/779ab601520b412985a1eafe36e39f07/users/4567aa6d35f9487586500ba3cb34eb79/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:40.876654 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed9fc36-7455-4390-a2d0-043888316455 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:40.878200 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed9fc36-7455-4390-a2d0-043888316455 service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:40.888971 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63d4c5-36b4-4d78-b445-48fe3a031236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=779ab601520b412985a1eafe36e39f07, user_id=4567aa6d35f9487586500ba3cb34eb79, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:40.893256 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a63d4c5-36b4-4d78-b445-48fe3a031236 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:40.912373 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 850/1705] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:10:40.913325 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9fc36-7455-4390-a2d0-043888316455 service cinder] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:40.914686 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-4ed9fc36-7455-4390-a2d0-043888316455 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:40.943849 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9fc36-7455-4390-a2d0-043888316455 service cinder] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:40.954482 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad069900-e3b3-40bb-a354-17631299053b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:40.955153 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad069900-e3b3-40bb-a354-17631299053b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:40.955438 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad069900-e3b3-40bb-a354-17631299053b admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:40.955707 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad069900-e3b3-40bb-a354-17631299053b admin admin] PATH_INFO: `/v3/users/8e7265f14108492191ccc4f6b3bf7548` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:40.957023 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad069900-e3b3-40bb-a354-17631299053b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e7265f14108492191ccc4f6b3bf7548)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:40.959143 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad069900-e3b3-40bb-a354-17631299053b admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:41.027224 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 856/1706] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:10:40 2022] PUT /identity/v3/projects/779ab601520b412985a1eafe36e39f07/users/4567aa6d35f9487586500ba3cb34eb79/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:41.041855 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84256f72-11ce-4bc6-bdf1-99e4905d2637 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:41.041855 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84256f72-11ce-4bc6-bdf1-99e4905d2637 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:41.041855 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84256f72-11ce-4bc6-bdf1-99e4905d2637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:41.138517 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-84256f72-11ce-4bc6-bdf1-99e4905d2637 None None] MFA Rules not processed for user `4567aa6d35f9487586500ba3cb34eb79`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:41.140710 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-84256f72-11ce-4bc6-bdf1-99e4905d2637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:41.208085 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-ad069900-e3b3-40bb-a354-17631299053b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e7265f14108492191ccc4f6b3bf7548'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:41.209088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-ad069900-e3b3-40bb-a354-17631299053b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e7265f14108492191ccc4f6b3bf7548'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:41.224712 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-ad069900-e3b3-40bb-a354-17631299053b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e7265f14108492191ccc4f6b3bf7548'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:41.226360 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-ad069900-e3b3-40bb-a354-17631299053b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e7265f14108492191ccc4f6b3bf7548'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:41.361891 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-ad069900-e3b3-40bb-a354-17631299053b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e7265f14108492191ccc4f6b3bf7548'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:41.368198 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 857/1707] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:41.369425 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84256f72-11ce-4bc6-bdf1-99e4905d2637 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:41.371462 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-84256f72-11ce-4bc6-bdf1-99e4905d2637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:41.401934 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 851/1708] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:10:40 2022] DELETE /identity/v3/users/8e7265f14108492191ccc4f6b3bf7548 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:41.401934 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad069900-e3b3-40bb-a354-17631299053b admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:41.405458 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-ad069900-e3b3-40bb-a354-17631299053b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:41.414939 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:41.541193 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84256f72-11ce-4bc6-bdf1-99e4905d2637 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:41.544787 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad069900-e3b3-40bb-a354-17631299053b admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:41.551034 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89f99c-d3c1-4410-b67f-6f14126b7bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:41.551702 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89f99c-d3c1-4410-b67f-6f14126b7bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:41.552340 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89f99c-d3c1-4410-b67f-6f14126b7bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:41.552620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89f99c-d3c1-4410-b67f-6f14126b7bd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:41.553272 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89f99c-d3c1-4410-b67f-6f14126b7bd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:41.555415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d89f99c-d3c1-4410-b67f-6f14126b7bd2 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:41.574435 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:41.657910 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd5632-0e8e-4888-8fb1-0b9638f1dc05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:41.658777 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd5632-0e8e-4888-8fb1-0b9638f1dc05 service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:41.658895 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd5632-0e8e-4888-8fb1-0b9638f1dc05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:41.659076 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd5632-0e8e-4888-8fb1-0b9638f1dc05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:41.665535 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-c4bd5632-0e8e-4888-8fb1-0b9638f1dc05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:41.693920 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 852/1709] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:10:41 2022] POST /identity/v3/projects => generated 371 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:41.698721 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89f99c-d3c1-4410-b67f-6f14126b7bd2 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:41.837710 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd5632-0e8e-4888-8fb1-0b9638f1dc05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:41.841741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd5632-0e8e-4888-8fb1-0b9638f1dc05 service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:41.879547 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 858/1710] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:41 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:10:41.912481 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d89f99c-d3c1-4410-b67f-6f14126b7bd2 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:41.919173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b49044-829d-4996-a2db-da1887c9c856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:41.919843 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b49044-829d-4996-a2db-da1887c9c856 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:41.920227 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b49044-829d-4996-a2db-da1887c9c856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:41.921084 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b49044-829d-4996-a2db-da1887c9c856 admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:41.922537 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b49044-829d-4996-a2db-da1887c9c856 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:41.925540 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b49044-829d-4996-a2db-da1887c9c856 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:42.084715 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 853/1711] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:10:41 2022] POST /identity/v3/users => generated 292 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:42.085747 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd5632-0e8e-4888-8fb1-0b9638f1dc05 service cinder] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:42.099015 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd5632-0e8e-4888-8fb1-0b9638f1dc05 service cinder] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:42.110193 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52adab84-4770-4739-9c26-aff13499c749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:42.111999 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adab84-4770-4739-9c26-aff13499c749 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:42.114045 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adab84-4770-4739-9c26-aff13499c749 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:42.115968 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adab84-4770-4739-9c26-aff13499c749 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:42.119197 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52adab84-4770-4739-9c26-aff13499c749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:42.129494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52adab84-4770-4739-9c26-aff13499c749 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:42.155834 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b49044-829d-4996-a2db-da1887c9c856 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:42.156240 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 859/1712] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:42.172230 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b49044-829d-4996-a2db-da1887c9c856 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:42.188128 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc13a1-00d0-444f-95c1-e595e3ddf0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:42.188897 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc13a1-00d0-444f-95c1-e595e3ddf0c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:42.191399 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc13a1-00d0-444f-95c1-e595e3ddf0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:42.191698 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcc13a1-00d0-444f-95c1-e595e3ddf0c0 admin admin] PATH_INFO: `/v3/projects/4d129325424c465a89d9bbb5e1a11b5d/users/9d570b44e8384b33b8155315faba76a3/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:42.240184 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc13a1-00d0-444f-95c1-e595e3ddf0c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d129325424c465a89d9bbb5e1a11b5d, user_id=9d570b44e8384b33b8155315faba76a3, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:42.243028 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcc13a1-00d0-444f-95c1-e595e3ddf0c0 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:42.394263 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:42.397406 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 854/1713] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:10:42 2022] PUT /identity/v3/projects/4d129325424c465a89d9bbb5e1a11b5d/users/9d570b44e8384b33b8155315faba76a3/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:42.401376 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52adab84-4770-4739-9c26-aff13499c749 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:42.419848 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52adab84-4770-4739-9c26-aff13499c749 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:42.535387 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:42.562320 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a709e8-acfb-48cd-b786-9954407a3204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:42.564662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a709e8-acfb-48cd-b786-9954407a3204 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:42.566406 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a709e8-acfb-48cd-b786-9954407a3204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:42.566814 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a709e8-acfb-48cd-b786-9954407a3204 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:42.568710 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a709e8-acfb-48cd-b786-9954407a3204 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:42.571723 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a709e8-acfb-48cd-b786-9954407a3204 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:42.606862 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc13a1-00d0-444f-95c1-e595e3ddf0c0 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:42.617500 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 860/1714] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:10:42.621517 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcc13a1-00d0-444f-95c1-e595e3ddf0c0 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:42.630554 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b729ac2-133d-4a7f-8bb6-7186bcd174d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:42.630554 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b729ac2-133d-4a7f-8bb6-7186bcd174d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:42.630554 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b729ac2-133d-4a7f-8bb6-7186bcd174d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:42.630554 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b729ac2-133d-4a7f-8bb6-7186bcd174d8 admin admin] PATH_INFO: `/v3/projects/4d129325424c465a89d9bbb5e1a11b5d/users/9d570b44e8384b33b8155315faba76a3/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:42.631673 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b729ac2-133d-4a7f-8bb6-7186bcd174d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d129325424c465a89d9bbb5e1a11b5d, user_id=9d570b44e8384b33b8155315faba76a3, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:42.634865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b729ac2-133d-4a7f-8bb6-7186bcd174d8 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:42.655225 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 855/1715] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:10:42 2022] PUT /identity/v3/projects/4d129325424c465a89d9bbb5e1a11b5d/users/9d570b44e8384b33b8155315faba76a3/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:42.662175 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36deb3-8f1d-4c5f-a50d-45aa20ff96b6 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:42.662631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36deb3-8f1d-4c5f-a50d-45aa20ff96b6 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:42.662958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a36deb3-8f1d-4c5f-a50d-45aa20ff96b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:42.716648 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-1a36deb3-8f1d-4c5f-a50d-45aa20ff96b6 None None] MFA Rules not processed for user `9d570b44e8384b33b8155315faba76a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:42.914563 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-1a36deb3-8f1d-4c5f-a50d-45aa20ff96b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:42.914563 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 861/1716] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:42.919415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b729ac2-133d-4a7f-8bb6-7186bcd174d8 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:42.921848 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-5b729ac2-133d-4a7f-8bb6-7186bcd174d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:42.977910 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36deb3-8f1d-4c5f-a50d-45aa20ff96b6 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:42.979730 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-1a36deb3-8f1d-4c5f-a50d-45aa20ff96b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:43.042951 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b729ac2-133d-4a7f-8bb6-7186bcd174d8 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:43.051954 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2595636-cea3-4905-99f1-448b22dfdeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:43.053667 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2595636-cea3-4905-99f1-448b22dfdeaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:43.054356 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2595636-cea3-4905-99f1-448b22dfdeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:43.054852 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2595636-cea3-4905-99f1-448b22dfdeaa admin admin] PATH_INFO: `/v3/projects/96a3350f9fd7421fbddddad58c64c939` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:43.057152 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2595636-cea3-4905-99f1-448b22dfdeaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=96a3350f9fd7421fbddddad58c64c939)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:43.067139 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2595636-cea3-4905-99f1-448b22dfdeaa admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:43.214733 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a36deb3-8f1d-4c5f-a50d-45aa20ff96b6 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:43.252302 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-a2595636-cea3-4905-99f1-448b22dfdeaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96a3350f9fd7421fbddddad58c64c939', 'request_id': 'req-a2595636-cea3-4905-99f1-448b22dfdeaa'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:43.273042 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-a2595636-cea3-4905-99f1-448b22dfdeaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96a3350f9fd7421fbddddad58c64c939', 'request_id': 'req-a2595636-cea3-4905-99f1-448b22dfdeaa'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:43.283088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-a2595636-cea3-4905-99f1-448b22dfdeaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96a3350f9fd7421fbddddad58c64c939', 'request_id': 'req-a2595636-cea3-4905-99f1-448b22dfdeaa'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:43.360274 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525de73-7597-4028-9be4-c5e5b91d2aba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:43.363232 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525de73-7597-4028-9be4-c5e5b91d2aba service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:43.363574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525de73-7597-4028-9be4-c5e5b91d2aba service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:43.364146 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0525de73-7597-4028-9be4-c5e5b91d2aba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:43.435444 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-a2595636-cea3-4905-99f1-448b22dfdeaa admin admin] The token cache is being invalidate because project 96a3350f9fd7421fbddddad58c64c939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:10:43.435769 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-a2595636-cea3-4905-99f1-448b22dfdeaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:43.440210 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-a2595636-cea3-4905-99f1-448b22dfdeaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:43.445555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 856/1717] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:10:42 2022] DELETE /identity/v3/projects/96a3350f9fd7421fbddddad58c64c939 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:43.446965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e819107-1dd2-44bb-9f74-91f6fba40b3d None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:43.447287 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e819107-1dd2-44bb-9f74-91f6fba40b3d None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:43.447575 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e819107-1dd2-44bb-9f74-91f6fba40b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:43.518903 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-7e819107-1dd2-44bb-9f74-91f6fba40b3d None None] MFA Rules not processed for user `3659772c227a4a179d30340e9573d556`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:43.518903 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-7e819107-1dd2-44bb-9f74-91f6fba40b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:43.520461 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525de73-7597-4028-9be4-c5e5b91d2aba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:43.523284 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0525de73-7597-4028-9be4-c5e5b91d2aba service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:43.557290 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 862/1718] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:10:43.558738 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525de73-7597-4028-9be4-c5e5b91d2aba service cinder] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:43.575263 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:43.711469 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 857/1719] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:43.717945 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfaab3-903b-4079-80d6-317fc7398f8a None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:43.718597 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfaab3-903b-4079-80d6-317fc7398f8a None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:43.719042 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfaab3-903b-4079-80d6-317fc7398f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:43.749320 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-a0bfaab3-903b-4079-80d6-317fc7398f8a None None] MFA Rules not processed for user `3659772c227a4a179d30340e9573d556`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:43.750748 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-a0bfaab3-903b-4079-80d6-317fc7398f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:43.805387 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 858/1720] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:43.808113 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfaab3-903b-4079-80d6-317fc7398f8a None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:43.812367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-a0bfaab3-903b-4079-80d6-317fc7398f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:43.841274 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0525de73-7597-4028-9be4-c5e5b91d2aba service cinder] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:43.855140 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b5ffe-749d-4a68-bff4-111406f78a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:43.857452 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b5ffe-749d-4a68-bff4-111406f78a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:43.857452 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b5ffe-749d-4a68-bff4-111406f78a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:43.857452 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b5ffe-749d-4a68-bff4-111406f78a6e admin admin] PATH_INFO: `/v3/users/6db32cb7a31746f7bc3e304a9ccb73b7` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:43.867259 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b5ffe-749d-4a68-bff4-111406f78a6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6db32cb7a31746f7bc3e304a9ccb73b7)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:43.879685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b5ffe-749d-4a68-bff4-111406f78a6e admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:44.023602 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfaab3-903b-4079-80d6-317fc7398f8a None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:44.033642 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b895491-0400-477c-b4f4-23b8f53e637d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:44.034965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b895491-0400-477c-b4f4-23b8f53e637d service nova] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:44.035935 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b895491-0400-477c-b4f4-23b8f53e637d service nova] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:44.036467 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b895491-0400-477c-b4f4-23b8f53e637d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:44.047708 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b895491-0400-477c-b4f4-23b8f53e637d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:44.049767 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b895491-0400-477c-b4f4-23b8f53e637d service nova] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:44.128102 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 859/1721] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:43 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:10:44.231499 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-050b5ffe-749d-4a68-bff4-111406f78a6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6db32cb7a31746f7bc3e304a9ccb73b7'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:44.248088 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-050b5ffe-749d-4a68-bff4-111406f78a6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6db32cb7a31746f7bc3e304a9ccb73b7'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:44.391087 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-050b5ffe-749d-4a68-bff4-111406f78a6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6db32cb7a31746f7bc3e304a9ccb73b7'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:44.395920 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-050b5ffe-749d-4a68-bff4-111406f78a6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6db32cb7a31746f7bc3e304a9ccb73b7'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:44.395920 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-050b5ffe-749d-4a68-bff4-111406f78a6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6db32cb7a31746f7bc3e304a9ccb73b7'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:44.456161 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 863/1722] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:10:43 2022] DELETE /identity/v3/users/6db32cb7a31746f7bc3e304a9ccb73b7 => generated 0 bytes in 895 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:44.791296 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:44.832840 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba42ce-706d-47d5-bb1f-ea2ce9e1a499 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:44.838630 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba42ce-706d-47d5-bb1f-ea2ce9e1a499 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:44.838630 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba42ce-706d-47d5-bb1f-ea2ce9e1a499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:44.892821 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-71ba42ce-706d-47d5-bb1f-ea2ce9e1a499 None None] MFA Rules not processed for user `f2e414a711f74b20a0eb0f89bb2bf6f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:44.898858 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-71ba42ce-706d-47d5-bb1f-ea2ce9e1a499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:45.112184 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 860/1723] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:45.142136 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc8e36-a824-4df9-b21f-278c8103b704 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:45.142768 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc8e36-a824-4df9-b21f-278c8103b704 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:45.144460 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dc8e36-a824-4df9-b21f-278c8103b704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:45.167239 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-b0dc8e36-a824-4df9-b21f-278c8103b704 None None] MFA Rules not processed for user `f2e414a711f74b20a0eb0f89bb2bf6f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:45.169129 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-b0dc8e36-a824-4df9-b21f-278c8103b704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:45.185427 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 864/1724] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:45 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:45.191924 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba42ce-706d-47d5-bb1f-ea2ce9e1a499 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:45.193513 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-71ba42ce-706d-47d5-bb1f-ea2ce9e1a499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:45.376412 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c8a53-b4f5-4547-aa0e-e7c799a61c88 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:45.378294 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c8a53-b4f5-4547-aa0e-e7c799a61c88 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:45.378294 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8c8a53-b4f5-4547-aa0e-e7c799a61c88 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:45.379003 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 865/1725] 10.222.0.55 () {54 vars in 912 bytes} [Wed Aug 24 17:10:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:10:45.384731 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c22b8-6ded-468c-98d8-2e1dd696065d None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:45.385016 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c22b8-6ded-468c-98d8-2e1dd696065d None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:45.385294 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c22b8-6ded-468c-98d8-2e1dd696065d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:45.412385 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba42ce-706d-47d5-bb1f-ea2ce9e1a499 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:45.420065 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9bb43-3c63-4f9b-93a5-aa4e38709176 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:45.421219 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9bb43-3c63-4f9b-93a5-aa4e38709176 service nova] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:45.421946 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9bb43-3c63-4f9b-93a5-aa4e38709176 service nova] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:45.421946 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd9bb43-3c63-4f9b-93a5-aa4e38709176 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:45.458695 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9bb43-3c63-4f9b-93a5-aa4e38709176 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:45.462388 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd9bb43-3c63-4f9b-93a5-aa4e38709176 service nova] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:45.487510 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 861/1726] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:10:45.536014 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-077c22b8-6ded-468c-98d8-2e1dd696065d None None] MFA Rules not processed for user `88ce8df89a96460ca046f2972321bceb`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:45.537266 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-077c22b8-6ded-468c-98d8-2e1dd696065d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:45.803806 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 866/1727] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Aug 24 17:10:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:10:45.946764 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9bb43-3c63-4f9b-93a5-aa4e38709176 service nova] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:45.948458 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-efd9bb43-3c63-4f9b-93a5-aa4e38709176 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:45.953552 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:46.034893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c22b8-6ded-468c-98d8-2e1dd696065d None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:46.040692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-077c22b8-6ded-468c-98d8-2e1dd696065d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:46.107672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c22b8-6ded-468c-98d8-2e1dd696065d None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:46.121891 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c8368-300a-49a5-9e37-dc3604ef7b33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:46.158987 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c8368-300a-49a5-9e37-dc3604ef7b33 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:46.160802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c8368-300a-49a5-9e37-dc3604ef7b33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:46.161310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c8368-300a-49a5-9e37-dc3604ef7b33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:46.167400 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd9bb43-3c63-4f9b-93a5-aa4e38709176 service nova] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:46.174225 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c8368-300a-49a5-9e37-dc3604ef7b33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:46.176172 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c8368-300a-49a5-9e37-dc3604ef7b33 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:46.183443 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd63e0-d8de-4086-9f4c-e65a5be0ecbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:46.184010 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd63e0-d8de-4086-9f4c-e65a5be0ecbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:46.184299 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd63e0-d8de-4086-9f4c-e65a5be0ecbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:46.188055 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bd63e0-d8de-4086-9f4c-e65a5be0ecbf admin admin] PATH_INFO: `/v3/projects/19fe2b98c006495cb426b91b2d17933a` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:46.194351 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd63e0-d8de-4086-9f4c-e65a5be0ecbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=19fe2b98c006495cb426b91b2d17933a)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:46.197096 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 867/1728] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:10:46.203712 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bd63e0-d8de-4086-9f4c-e65a5be0ecbf admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:46.334315 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79cb4e-e14a-4702-b0d8-d046b9cdcfe3 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:46.334766 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79cb4e-e14a-4702-b0d8-d046b9cdcfe3 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:46.335229 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79cb4e-e14a-4702-b0d8-d046b9cdcfe3 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:46.336763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 868/1729] 10.222.0.55 () {54 vars in 912 bytes} [Wed Aug 24 17:10:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:10:46.347020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b763876-ea4e-48b8-b443-5ac0b9b924d4 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:46.347657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b763876-ea4e-48b8-b443-5ac0b9b924d4 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:46.348345 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b763876-ea4e-48b8-b443-5ac0b9b924d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:46.403217 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-3b763876-ea4e-48b8-b443-5ac0b9b924d4 None None] MFA Rules not processed for user `88ce8df89a96460ca046f2972321bceb`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:46.405146 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-3b763876-ea4e-48b8-b443-5ac0b9b924d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:46.448021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-f3bd63e0-d8de-4086-9f4c-e65a5be0ecbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19fe2b98c006495cb426b91b2d17933a', 'request_id': 'req-f3bd63e0-d8de-4086-9f4c-e65a5be0ecbf'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:46.495581 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-f3bd63e0-d8de-4086-9f4c-e65a5be0ecbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19fe2b98c006495cb426b91b2d17933a', 'request_id': 'req-f3bd63e0-d8de-4086-9f4c-e65a5be0ecbf'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:46.511952 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-f3bd63e0-d8de-4086-9f4c-e65a5be0ecbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19fe2b98c006495cb426b91b2d17933a', 'request_id': 'req-f3bd63e0-d8de-4086-9f4c-e65a5be0ecbf'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:46.620224 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 869/1730] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Aug 24 17:10:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:46.620453 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-f3bd63e0-d8de-4086-9f4c-e65a5be0ecbf admin admin] The token cache is being invalidate because project 19fe2b98c006495cb426b91b2d17933a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:10:46.620954 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-f3bd63e0-d8de-4086-9f4c-e65a5be0ecbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:46.622281 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-f3bd63e0-d8de-4086-9f4c-e65a5be0ecbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:46.624793 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 862/1731] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:10:45 2022] DELETE /identity/v3/projects/19fe2b98c006495cb426b91b2d17933a => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:46.630069 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f522ab2-9af1-495b-8bdc-91a7e8479e57 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:46.630387 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f522ab2-9af1-495b-8bdc-91a7e8479e57 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:46.630669 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f522ab2-9af1-495b-8bdc-91a7e8479e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:46.645955 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd63e0-d8de-4086-9f4c-e65a5be0ecbf admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:46.647475 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-f3bd63e0-d8de-4086-9f4c-e65a5be0ecbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:46.681090 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bd63e0-d8de-4086-9f4c-e65a5be0ecbf admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:46.693330 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128ded2-365c-4b47-9cc8-195823b9296b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:46.693973 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128ded2-365c-4b47-9cc8-195823b9296b service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:46.694257 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128ded2-365c-4b47-9cc8-195823b9296b service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:46.694531 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c128ded2-365c-4b47-9cc8-195823b9296b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:46.700068 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-c128ded2-365c-4b47-9cc8-195823b9296b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:46.703409 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-3f522ab2-9af1-495b-8bdc-91a7e8479e57 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:46.704661 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-3f522ab2-9af1-495b-8bdc-91a7e8479e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:46.731011 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c128ded2-365c-4b47-9cc8-195823b9296b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:46.738979 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c128ded2-365c-4b47-9cc8-195823b9296b service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:46.769974 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 863/1732] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:10:46.781209 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128ded2-365c-4b47-9cc8-195823b9296b service neutron] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:46.784562 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-c128ded2-365c-4b47-9cc8-195823b9296b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:46.893423 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 870/1733] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:46.905532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a93d2f-637b-4739-9272-f059bca15e79 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:46.906431 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a93d2f-637b-4739-9272-f059bca15e79 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:46.906895 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a93d2f-637b-4739-9272-f059bca15e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:46.936735 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-93a93d2f-637b-4739-9272-f059bca15e79 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:46.937978 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-93a93d2f-637b-4739-9272-f059bca15e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:46.977883 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 871/1734] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:46.984638 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a93d2f-637b-4739-9272-f059bca15e79 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:47.011033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c128ded2-365c-4b47-9cc8-195823b9296b service neutron] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:47.023241 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a93d2f-637b-4739-9272-f059bca15e79 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:47.033322 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773e2ad1-bdd3-48d1-b276-78a22fb65ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:47.033322 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e2ad1-bdd3-48d1-b276-78a22fb65ebe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:47.033322 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e2ad1-bdd3-48d1-b276-78a22fb65ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:47.033322 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773e2ad1-bdd3-48d1-b276-78a22fb65ebe admin admin] PATH_INFO: `/v3/users/4567aa6d35f9487586500ba3cb34eb79` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:47.033830 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e2ad1-bdd3-48d1-b276-78a22fb65ebe admin admin] RBAC: Authorizing `identity:delete_user(user_id=4567aa6d35f9487586500ba3cb34eb79)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:47.035082 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773e2ad1-bdd3-48d1-b276-78a22fb65ebe admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:47.038602 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76305f8-4bba-46e6-8525-2a5b32f9d139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:47.041613 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76305f8-4bba-46e6-8525-2a5b32f9d139 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:47.045412 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76305f8-4bba-46e6-8525-2a5b32f9d139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:47.049209 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76305f8-4bba-46e6-8525-2a5b32f9d139 admin admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:47.050148 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76305f8-4bba-46e6-8525-2a5b32f9d139 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:10:47.050624 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76305f8-4bba-46e6-8525-2a5b32f9d139 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:47.052466 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76305f8-4bba-46e6-8525-2a5b32f9d139 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:47.113561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 872/1735] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:10:47.114782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76305f8-4bba-46e6-8525-2a5b32f9d139 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:47.126439 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:47.136320 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76305f8-4bba-46e6-8525-2a5b32f9d139 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:47.148538 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8e2f7-3821-47d1-b65f-e8d1d4bc3953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:47.149404 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8e2f7-3821-47d1-b65f-e8d1d4bc3953 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:47.150215 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8e2f7-3821-47d1-b65f-e8d1d4bc3953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:47.152351 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8e2f7-3821-47d1-b65f-e8d1d4bc3953 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:47.153332 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8e2f7-3821-47d1-b65f-e8d1d4bc3953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:47.158502 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8e2f7-3821-47d1-b65f-e8d1d4bc3953 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:47.360842 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 873/1736] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:10:47 2022] POST /identity/v3/projects => generated 357 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:47.362662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8e2f7-3821-47d1-b65f-e8d1d4bc3953 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:47.413951 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-773e2ad1-bdd3-48d1-b276-78a22fb65ebe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4567aa6d35f9487586500ba3cb34eb79'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:47.415239 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-773e2ad1-bdd3-48d1-b276-78a22fb65ebe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4567aa6d35f9487586500ba3cb34eb79'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:47.434486 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-773e2ad1-bdd3-48d1-b276-78a22fb65ebe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4567aa6d35f9487586500ba3cb34eb79'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:47.437237 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-773e2ad1-bdd3-48d1-b276-78a22fb65ebe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4567aa6d35f9487586500ba3cb34eb79'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:47.520276 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-773e2ad1-bdd3-48d1-b276-78a22fb65ebe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4567aa6d35f9487586500ba3cb34eb79'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:47.550916 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:47.560602 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8e2f7-3821-47d1-b65f-e8d1d4bc3953 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:47.579524 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 864/1737] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:10:46 2022] DELETE /identity/v3/users/4567aa6d35f9487586500ba3cb34eb79 => generated 0 bytes in 809 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:47.582510 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4abd9d5-7ea4-4a29-96b0-d46bffa20a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:47.584581 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38460a9a-ed3c-424e-a263-a8f399afe1d4 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:47.586085 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38460a9a-ed3c-424e-a263-a8f399afe1d4 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:47.586385 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38460a9a-ed3c-424e-a263-a8f399afe1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:47.586912 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abd9d5-7ea4-4a29-96b0-d46bffa20a87 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:47.588689 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abd9d5-7ea4-4a29-96b0-d46bffa20a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:47.594605 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4abd9d5-7ea4-4a29-96b0-d46bffa20a87 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:47.595803 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4abd9d5-7ea4-4a29-96b0-d46bffa20a87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:47.604379 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4abd9d5-7ea4-4a29-96b0-d46bffa20a87 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:47.670714 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-38460a9a-ed3c-424e-a263-a8f399afe1d4 None None] MFA Rules not processed for user `2cad680ebdab4fd4996f39f2e08eabb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:47.672346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-38460a9a-ed3c-424e-a263-a8f399afe1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:47.791960 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 874/1738] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:10:47 2022] POST /identity/v3/users => generated 279 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:47.793747 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e5fc5-2f6c-4972-9bd5-a167b677bd3c None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:47.795615 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e5fc5-2f6c-4972-9bd5-a167b677bd3c None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:47.797471 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e5fc5-2f6c-4972-9bd5-a167b677bd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:47.850337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-0b0e5fc5-2f6c-4972-9bd5-a167b677bd3c None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:47.852284 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-0b0e5fc5-2f6c-4972-9bd5-a167b677bd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:47.874079 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 865/1739] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:47.875269 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38460a9a-ed3c-424e-a263-a8f399afe1d4 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:47.878894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-38460a9a-ed3c-424e-a263-a8f399afe1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:48.084512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 875/1740] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:48.085420 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e5fc5-2f6c-4972-9bd5-a167b677bd3c None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:48.120118 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-0b0e5fc5-2f6c-4972-9bd5-a167b677bd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:48.162397 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38460a9a-ed3c-424e-a263-a8f399afe1d4 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:48.184145 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222e559-d92a-414b-a78f-f2d12a984d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:48.184809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222e559-d92a-414b-a78f-f2d12a984d59 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:48.185219 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222e559-d92a-414b-a78f-f2d12a984d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:48.185526 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222e559-d92a-414b-a78f-f2d12a984d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:48.186783 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222e559-d92a-414b-a78f-f2d12a984d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:48.188990 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222e559-d92a-414b-a78f-f2d12a984d59 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:48.245387 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 866/1741] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:48.246434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222e559-d92a-414b-a78f-f2d12a984d59 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:48.252694 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-0222e559-d92a-414b-a78f-f2d12a984d59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:48.430272 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:48.438263 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222e559-d92a-414b-a78f-f2d12a984d59 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:48.448602 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b68889-37f9-4efb-849f-a50f66b344a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:48.449465 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b68889-37f9-4efb-849f-a50f66b344a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:48.449839 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b68889-37f9-4efb-849f-a50f66b344a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:48.450206 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b68889-37f9-4efb-849f-a50f66b344a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:48.463064 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e5fc5-2f6c-4972-9bd5-a167b677bd3c None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:48.480371 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28155a1-16df-485a-84a2-9f3a19cf89a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:48.480987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b68889-37f9-4efb-849f-a50f66b344a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:48.481419 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28155a1-16df-485a-84a2-9f3a19cf89a0 service nova] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:48.481846 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28155a1-16df-485a-84a2-9f3a19cf89a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:48.482363 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28155a1-16df-485a-84a2-9f3a19cf89a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:48.484388 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b68889-37f9-4efb-849f-a50f66b344a6 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:48.495894 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28155a1-16df-485a-84a2-9f3a19cf89a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:48.499034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28155a1-16df-485a-84a2-9f3a19cf89a0 service nova] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:48.525889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 876/1742] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:10:48.525889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28155a1-16df-485a-84a2-9f3a19cf89a0 service nova] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:48.528294 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28155a1-16df-485a-84a2-9f3a19cf89a0 service nova] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:48.533879 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b81ab2-1198-4fbe-bf08-f25a6c3ba761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:48.534512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b81ab2-1198-4fbe-bf08-f25a6c3ba761 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:48.534942 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b81ab2-1198-4fbe-bf08-f25a6c3ba761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:48.535258 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b81ab2-1198-4fbe-bf08-f25a6c3ba761 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:48.536093 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b81ab2-1198-4fbe-bf08-f25a6c3ba761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:48.537992 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b81ab2-1198-4fbe-bf08-f25a6c3ba761 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:48.557201 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 867/1743] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:10:48.558224 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b68889-37f9-4efb-849f-a50f66b344a6 service neutron] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:48.566201 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-d7b68889-37f9-4efb-849f-a50f66b344a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:48.574259 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 877/1744] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:48.576301 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b81ab2-1198-4fbe-bf08-f25a6c3ba761 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:48.594581 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-62b81ab2-1198-4fbe-bf08-f25a6c3ba761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:48.842487 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b81ab2-1198-4fbe-bf08-f25a6c3ba761 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:48.854172 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bac18-f0ac-4e4d-a789-5bee00fee902 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ef97356edf406aad9ab5f502bdb0af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:48.855529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bac18-f0ac-4e4d-a789-5bee00fee902 service placement] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:48.856521 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bac18-f0ac-4e4d-a789-5bee00fee902 service placement] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:48.856989 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130bac18-f0ac-4e4d-a789-5bee00fee902 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:48.860582 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b68889-37f9-4efb-849f-a50f66b344a6 service neutron] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:48.860969 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-130bac18-f0ac-4e4d-a789-5bee00fee902 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:48.869986 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4a24db-a7ff-4894-9844-72a6d88ecb79 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ef97356edf406aad9ab5f502bdb0af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:48.870650 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a24db-a7ff-4894-9844-72a6d88ecb79 service placement] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:48.871219 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a24db-a7ff-4894-9844-72a6d88ecb79 service placement] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:48.871594 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a24db-a7ff-4894-9844-72a6d88ecb79 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:48.883997 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a24db-a7ff-4894-9844-72a6d88ecb79 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:48.886166 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4a24db-a7ff-4894-9844-72a6d88ecb79 service placement] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:48.893802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130bac18-f0ac-4e4d-a789-5bee00fee902 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:48.897268 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130bac18-f0ac-4e4d-a789-5bee00fee902 service placement] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:48.901201 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 868/1745] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:10:48.903512 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891d44e-a36c-4d37-b43a-463e353fda1f None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:48.906973 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891d44e-a36c-4d37-b43a-463e353fda1f None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:48.907522 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891d44e-a36c-4d37-b43a-463e353fda1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:48.914387 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 878/1746] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:10:48.915469 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bac18-f0ac-4e4d-a789-5bee00fee902 service placement] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:48.962545 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130bac18-f0ac-4e4d-a789-5bee00fee902 service placement] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:48.967861 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-5891d44e-a36c-4d37-b43a-463e353fda1f None None] MFA Rules not processed for user `9d829f56be8a4000946c6ca93007937c`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:48.974321 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-5891d44e-a36c-4d37-b43a-463e353fda1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:48.980696 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ee190-58b5-4cbb-9b36-f313693ff77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:48.981395 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ee190-58b5-4cbb-9b36-f313693ff77a admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:48.981672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ee190-58b5-4cbb-9b36-f313693ff77a admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:48.981938 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58ee190-58b5-4cbb-9b36-f313693ff77a admin admin] PATH_INFO: `/v3/projects/f8a735f52d794010aadb63bdd1cda4bc/users/45bad4cc72134c47aa45e65810f7997a/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:49.025309 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:49.050151 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ee190-58b5-4cbb-9b36-f313693ff77a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8a735f52d794010aadb63bdd1cda4bc, user_id=45bad4cc72134c47aa45e65810f7997a, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:49.071273 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58ee190-58b5-4cbb-9b36-f313693ff77a admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:49.101158 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 869/1747] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:49.103388 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4080585-8ed6-4d82-b4bc-651ec0f85be5 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:49.103949 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4080585-8ed6-4d82-b4bc-651ec0f85be5 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:49.104520 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4080585-8ed6-4d82-b4bc-651ec0f85be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:49.140859 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-c4080585-8ed6-4d82-b4bc-651ec0f85be5 None None] MFA Rules not processed for user `3659772c227a4a179d30340e9573d556`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:49.142896 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-c4080585-8ed6-4d82-b4bc-651ec0f85be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:49.198207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 879/1748] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:10:48 2022] PUT /identity/v3/projects/f8a735f52d794010aadb63bdd1cda4bc/users/45bad4cc72134c47aa45e65810f7997a/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:49.199659 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ee190-58b5-4cbb-9b36-f313693ff77a admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:49.209606 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-f58ee190-58b5-4cbb-9b36-f313693ff77a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:49.421098 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 870/1749] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:49.423460 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9119ead-8f12-485e-beec-c5564c41ed9b None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:49.430167 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9119ead-8f12-485e-beec-c5564c41ed9b None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:49.430817 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9119ead-8f12-485e-beec-c5564c41ed9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:49.486571 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58ee190-58b5-4cbb-9b36-f313693ff77a admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:49.492085 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:49.527663 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888fc26-b811-48ed-bfc2-9c29885b72e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:49.531921 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888fc26-b811-48ed-bfc2-9c29885b72e6 service nova] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:49.535479 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888fc26-b811-48ed-bfc2-9c29885b72e6 service nova] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:49.535479 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2888fc26-b811-48ed-bfc2-9c29885b72e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:49.550342 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-c9119ead-8f12-485e-beec-c5564c41ed9b None None] MFA Rules not processed for user `45bad4cc72134c47aa45e65810f7997a`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:49.551639 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-c9119ead-8f12-485e-beec-c5564c41ed9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:49.741368 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888fc26-b811-48ed-bfc2-9c29885b72e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:49.741368 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2888fc26-b811-48ed-bfc2-9c29885b72e6 service nova] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:49.784028 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 880/1750] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:49 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:10:49.785279 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888fc26-b811-48ed-bfc2-9c29885b72e6 service nova] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:49.789357 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-2888fc26-b811-48ed-bfc2-9c29885b72e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:49.803143 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 871/1751] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:49.808417 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9119ead-8f12-485e-beec-c5564c41ed9b None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:50.067321 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9119ead-8f12-485e-beec-c5564c41ed9b None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:50.088286 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2888fc26-b811-48ed-bfc2-9c29885b72e6 service nova] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:50.093157 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8555468-2578-438d-8e90-3f66df7a8224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:50.094475 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8555468-2578-438d-8e90-3f66df7a8224 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:50.095222 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8555468-2578-438d-8e90-3f66df7a8224 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:50.095947 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8555468-2578-438d-8e90-3f66df7a8224 admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:50.097563 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8555468-2578-438d-8e90-3f66df7a8224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:50.101946 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8555468-2578-438d-8e90-3f66df7a8224 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:50.116839 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3541b46-434b-45a0-b24e-707eb81920a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:50.117671 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3541b46-434b-45a0-b24e-707eb81920a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:50.119643 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3541b46-434b-45a0-b24e-707eb81920a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:50.120767 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3541b46-434b-45a0-b24e-707eb81920a1 admin admin] PATH_INFO: `/v3/users/20518eff98f044c48d49d7fd213220e1` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:50.127189 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3541b46-434b-45a0-b24e-707eb81920a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20518eff98f044c48d49d7fd213220e1)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:50.137258 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3541b46-434b-45a0-b24e-707eb81920a1 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:50.242011 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 872/1752] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:10:49 2022] POST /identity/v3/projects => generated 357 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:50.247006 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8555468-2578-438d-8e90-3f66df7a8224 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:50.438043 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8555468-2578-438d-8e90-3f66df7a8224 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:50.453188 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151acd2-75b5-4e0c-9c38-561a5da9410d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:50.453873 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151acd2-75b5-4e0c-9c38-561a5da9410d admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:50.454164 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151acd2-75b5-4e0c-9c38-561a5da9410d admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:50.454490 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151acd2-75b5-4e0c-9c38-561a5da9410d admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:50.455085 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151acd2-75b5-4e0c-9c38-561a5da9410d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:50.457106 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151acd2-75b5-4e0c-9c38-561a5da9410d admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:50.515857 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-e3541b46-434b-45a0-b24e-707eb81920a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20518eff98f044c48d49d7fd213220e1'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:50.545378 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-e3541b46-434b-45a0-b24e-707eb81920a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20518eff98f044c48d49d7fd213220e1'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:50.636642 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 873/1753] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:10:50 2022] POST /identity/v3/users => generated 285 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:50.638300 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151acd2-75b5-4e0c-9c38-561a5da9410d admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:50.684864 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151acd2-75b5-4e0c-9c38-561a5da9410d admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:50.709595 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1aa5f7-eff7-4210-84aa-2febc0bb84d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:50.710241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1aa5f7-eff7-4210-84aa-2febc0bb84d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:50.710517 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1aa5f7-eff7-4210-84aa-2febc0bb84d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:50.714372 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1aa5f7-eff7-4210-84aa-2febc0bb84d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:50.714550 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-e3541b46-434b-45a0-b24e-707eb81920a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20518eff98f044c48d49d7fd213220e1'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:50.714755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1aa5f7-eff7-4210-84aa-2febc0bb84d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:50.714904 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-e3541b46-434b-45a0-b24e-707eb81920a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20518eff98f044c48d49d7fd213220e1'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:50.714904 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-e3541b46-434b-45a0-b24e-707eb81920a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20518eff98f044c48d49d7fd213220e1'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:50.715422 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1aa5f7-eff7-4210-84aa-2febc0bb84d4 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:50.753114 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 874/1754] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:50.754444 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1aa5f7-eff7-4210-84aa-2febc0bb84d4 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:50.756312 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-0a1aa5f7-eff7-4210-84aa-2febc0bb84d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:50.782437 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 881/1755] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:10:49 2022] DELETE /identity/v3/users/20518eff98f044c48d49d7fd213220e1 => generated 0 bytes in 997 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:50.786990 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0863798-7a3a-473f-a42c-45e9c1069ed3 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:50.787324 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0863798-7a3a-473f-a42c-45e9c1069ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:50.791519 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0863798-7a3a-473f-a42c-45e9c1069ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:50.798526 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1aa5f7-eff7-4210-84aa-2febc0bb84d4 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:50.880376 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-b0863798-7a3a-473f-a42c-45e9c1069ed3 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:50.883624 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-b0863798-7a3a-473f-a42c-45e9c1069ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:51.001107 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358c2d2-d281-4638-addb-219764546d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:51.002048 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358c2d2-d281-4638-addb-219764546d60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:51.002466 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358c2d2-d281-4638-addb-219764546d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:51.002878 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358c2d2-d281-4638-addb-219764546d60 admin admin] PATH_INFO: `/v3/projects/7ebc46f776e84d77b995651abd50a589/users/35889b17e94a4a849ba395c04b0425f5/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:51.063372 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358c2d2-d281-4638-addb-219764546d60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ebc46f776e84d77b995651abd50a589, user_id=35889b17e94a4a849ba395c04b0425f5, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:51.069742 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358c2d2-d281-4638-addb-219764546d60 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:51.086942 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 882/1756] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:51.094058 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0863798-7a3a-473f-a42c-45e9c1069ed3 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:51.097157 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-b0863798-7a3a-473f-a42c-45e9c1069ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:51.139548 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0863798-7a3a-473f-a42c-45e9c1069ed3 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:51.145069 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46a003-0cd6-497d-bb49-4f6ec28efe15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:51.150677 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46a003-0cd6-497d-bb49-4f6ec28efe15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:51.150677 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46a003-0cd6-497d-bb49-4f6ec28efe15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:51.150677 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b46a003-0cd6-497d-bb49-4f6ec28efe15 admin admin] PATH_INFO: `/v3/projects/779ab601520b412985a1eafe36e39f07` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:51.150677 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46a003-0cd6-497d-bb49-4f6ec28efe15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=779ab601520b412985a1eafe36e39f07)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:51.152624 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b46a003-0cd6-497d-bb49-4f6ec28efe15 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:51.216039 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 875/1757] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:10:50 2022] PUT /identity/v3/projects/7ebc46f776e84d77b995651abd50a589/users/35889b17e94a4a849ba395c04b0425f5/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:51.217809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358c2d2-d281-4638-addb-219764546d60 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:51.240533 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-6358c2d2-d281-4638-addb-219764546d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:51.293557 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-2b46a003-0cd6-497d-bb49-4f6ec28efe15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '779ab601520b412985a1eafe36e39f07', 'request_id': 'req-2b46a003-0cd6-497d-bb49-4f6ec28efe15'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:51.305277 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-2b46a003-0cd6-497d-bb49-4f6ec28efe15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '779ab601520b412985a1eafe36e39f07', 'request_id': 'req-2b46a003-0cd6-497d-bb49-4f6ec28efe15'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:51.425833 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-2b46a003-0cd6-497d-bb49-4f6ec28efe15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '779ab601520b412985a1eafe36e39f07', 'request_id': 'req-2b46a003-0cd6-497d-bb49-4f6ec28efe15'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:51.427637 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:51.448945 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-2b46a003-0cd6-497d-bb49-4f6ec28efe15 admin admin] The token cache is being invalidate because project 779ab601520b412985a1eafe36e39f07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:10:51.449829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-2b46a003-0cd6-497d-bb49-4f6ec28efe15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:51.451792 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-2b46a003-0cd6-497d-bb49-4f6ec28efe15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:51.460818 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 883/1758] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:10:51 2022] DELETE /identity/v3/projects/779ab601520b412985a1eafe36e39f07 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:51.462083 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46a003-0cd6-497d-bb49-4f6ec28efe15 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:51.467959 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-2b46a003-0cd6-497d-bb49-4f6ec28efe15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:51.498503 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358c2d2-d281-4638-addb-219764546d60 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:51.620424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:51.743613 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950283e-f5b7-4e35-8042-305147b78f6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:51.744346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950283e-f5b7-4e35-8042-305147b78f6b service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:51.744632 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950283e-f5b7-4e35-8042-305147b78f6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:51.744948 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950283e-f5b7-4e35-8042-305147b78f6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:51.751871 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-d950283e-f5b7-4e35-8042-305147b78f6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:51.827842 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b46a003-0cd6-497d-bb49-4f6ec28efe15 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:51.849156 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8046f-d0f9-4b36-ba80-717d9cc47b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:51.850218 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8046f-d0f9-4b36-ba80-717d9cc47b64 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:51.850711 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8046f-d0f9-4b36-ba80-717d9cc47b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:51.851426 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8046f-d0f9-4b36-ba80-717d9cc47b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:51.852795 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8046f-d0f9-4b36-ba80-717d9cc47b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:51.857828 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8046f-d0f9-4b36-ba80-717d9cc47b64 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:51.861624 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:51.895369 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 884/1759] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:51.896940 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8046f-d0f9-4b36-ba80-717d9cc47b64 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:51.907139 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-a0c8046f-d0f9-4b36-ba80-717d9cc47b64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:51.967194 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8046f-d0f9-4b36-ba80-717d9cc47b64 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:51.993009 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950283e-f5b7-4e35-8042-305147b78f6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:51.995024 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeca4f9-ecab-4bbd-a71c-ec7b0b8e6994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:51.996131 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950283e-f5b7-4e35-8042-305147b78f6b service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:51.996626 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeca4f9-ecab-4bbd-a71c-ec7b0b8e6994 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:51.999371 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeca4f9-ecab-4bbd-a71c-ec7b0b8e6994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:52.000077 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeca4f9-ecab-4bbd-a71c-ec7b0b8e6994 admin admin] PATH_INFO: `/v3/users/9d570b44e8384b33b8155315faba76a3` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:52.004900 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeca4f9-ecab-4bbd-a71c-ec7b0b8e6994 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d570b44e8384b33b8155315faba76a3)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:52.011559 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 876/1760] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 795 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:10:52.012725 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950283e-f5b7-4e35-8042-305147b78f6b service neutron] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:52.014092 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeca4f9-ecab-4bbd-a71c-ec7b0b8e6994 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:52.026899 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950283e-f5b7-4e35-8042-305147b78f6b service neutron] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:52.039373 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62720ab9-654f-43a4-a261-d8053b24a6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:52.041545 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62720ab9-654f-43a4-a261-d8053b24a6f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:52.041835 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62720ab9-654f-43a4-a261-d8053b24a6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:52.042110 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62720ab9-654f-43a4-a261-d8053b24a6f4 admin admin] PATH_INFO: `/v3/projects/7ebc46f776e84d77b995651abd50a589/users/35889b17e94a4a849ba395c04b0425f5/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:52.048080 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62720ab9-654f-43a4-a261-d8053b24a6f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ebc46f776e84d77b995651abd50a589, user_id=35889b17e94a4a849ba395c04b0425f5, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:52.057153 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62720ab9-654f-43a4-a261-d8053b24a6f4 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:52.099877 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 877/1761] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:10:52 2022] PUT /identity/v3/projects/7ebc46f776e84d77b995651abd50a589/users/35889b17e94a4a849ba395c04b0425f5/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:52.111908 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7635824-a07d-4a26-a764-b7f13a149f07 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:52.112363 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7635824-a07d-4a26-a764-b7f13a149f07 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:52.112858 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7635824-a07d-4a26-a764-b7f13a149f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:52.259267 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-a7635824-a07d-4a26-a764-b7f13a149f07 None None] MFA Rules not processed for user `35889b17e94a4a849ba395c04b0425f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:52.259530 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-a7635824-a07d-4a26-a764-b7f13a149f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:52.383710 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-3eeca4f9-ecab-4bbd-a71c-ec7b0b8e6994 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d570b44e8384b33b8155315faba76a3'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:52.457981 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-3eeca4f9-ecab-4bbd-a71c-ec7b0b8e6994 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d570b44e8384b33b8155315faba76a3'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:52.467743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 878/1762] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:52 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:10:52.491885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7635824-a07d-4a26-a764-b7f13a149f07 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:52.497652 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-a7635824-a07d-4a26-a764-b7f13a149f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:52.561362 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-3eeca4f9-ecab-4bbd-a71c-ec7b0b8e6994 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d570b44e8384b33b8155315faba76a3'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:52.569222 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-3eeca4f9-ecab-4bbd-a71c-ec7b0b8e6994 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d570b44e8384b33b8155315faba76a3'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:52.572277 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-3eeca4f9-ecab-4bbd-a71c-ec7b0b8e6994 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d570b44e8384b33b8155315faba76a3'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:52.643375 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 885/1763] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:10:51 2022] DELETE /identity/v3/users/9d570b44e8384b33b8155315faba76a3 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:52.705731 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7635824-a07d-4a26-a764-b7f13a149f07 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:52.908000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f72170-a8b3-4e9b-9d07-e31e56b36e47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:52.908663 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f72170-a8b3-4e9b-9d07-e31e56b36e47 service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:52.908973 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f72170-a8b3-4e9b-9d07-e31e56b36e47 service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:52.909250 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f72170-a8b3-4e9b-9d07-e31e56b36e47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:52.913344 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-06f72170-a8b3-4e9b-9d07-e31e56b36e47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:53.071233 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:53.084402 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f72170-a8b3-4e9b-9d07-e31e56b36e47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:53.084402 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f72170-a8b3-4e9b-9d07-e31e56b36e47 service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:53.095170 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 879/1764] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:52 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:10:53.438211 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeca4f9-ecab-4bbd-a71c-ec7b0b8e6994 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:53.440487 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-3eeca4f9-ecab-4bbd-a71c-ec7b0b8e6994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:53.454027 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f72170-a8b3-4e9b-9d07-e31e56b36e47 service cinder] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:53.464404 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-06f72170-a8b3-4e9b-9d07-e31e56b36e47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:53.465548 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeca4f9-ecab-4bbd-a71c-ec7b0b8e6994 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:53.491823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cd884-8764-49d4-9017-c6209db03a5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:53.493167 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cd884-8764-49d4-9017-c6209db03a5b service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:53.493167 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cd884-8764-49d4-9017-c6209db03a5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:53.493167 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cd884-8764-49d4-9017-c6209db03a5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:53.504010 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-999cd884-8764-49d4-9017-c6209db03a5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:53.724206 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999cd884-8764-49d4-9017-c6209db03a5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:53.725668 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999cd884-8764-49d4-9017-c6209db03a5b service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:53.751039 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 886/1765] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:53 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:10:53.766713 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f72170-a8b3-4e9b-9d07-e31e56b36e47 service cinder] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:53.784552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0fa98-f490-4eb3-bd0f-e670206da0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:53.785391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0fa98-f490-4eb3-bd0f-e670206da0f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:53.786155 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0fa98-f490-4eb3-bd0f-e670206da0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:53.786870 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b0fa98-f490-4eb3-bd0f-e670206da0f1 admin admin] PATH_INFO: `/v3/projects/319b7b2e668541db9098915550863f14` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:53.789332 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0fa98-f490-4eb3-bd0f-e670206da0f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=319b7b2e668541db9098915550863f14)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:53.797186 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b0fa98-f490-4eb3-bd0f-e670206da0f1 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:54.141556 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-b4b0fa98-f490-4eb3-bd0f-e670206da0f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '319b7b2e668541db9098915550863f14', 'request_id': 'req-b4b0fa98-f490-4eb3-bd0f-e670206da0f1'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:54.155980 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-b4b0fa98-f490-4eb3-bd0f-e670206da0f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '319b7b2e668541db9098915550863f14', 'request_id': 'req-b4b0fa98-f490-4eb3-bd0f-e670206da0f1'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:54.166810 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-b4b0fa98-f490-4eb3-bd0f-e670206da0f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '319b7b2e668541db9098915550863f14', 'request_id': 'req-b4b0fa98-f490-4eb3-bd0f-e670206da0f1'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:54.228201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cd884-8764-49d4-9017-c6209db03a5b service cinder] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:54.229910 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-999cd884-8764-49d4-9017-c6209db03a5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:54.260347 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999cd884-8764-49d4-9017-c6209db03a5b service cinder] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:54.368695 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:54.379645 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-b4b0fa98-f490-4eb3-bd0f-e670206da0f1 admin admin] The token cache is being invalidate because project 319b7b2e668541db9098915550863f14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:10:54.380036 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-b4b0fa98-f490-4eb3-bd0f-e670206da0f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:54.382725 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-b4b0fa98-f490-4eb3-bd0f-e670206da0f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:54.385141 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 880/1766] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:10:53 2022] DELETE /identity/v3/projects/319b7b2e668541db9098915550863f14 => generated 0 bytes in 932 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:54.389247 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0fa98-f490-4eb3-bd0f-e670206da0f1 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:54.391571 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-b4b0fa98-f490-4eb3-bd0f-e670206da0f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:54.395152 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882f79cc-3794-4e0b-af32-16b2ba6f685d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:54.396994 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f79cc-3794-4e0b-af32-16b2ba6f685d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:54.397641 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f79cc-3794-4e0b-af32-16b2ba6f685d admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:54.398872 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f79cc-3794-4e0b-af32-16b2ba6f685d admin admin] PATH_INFO: `/v3/projects/4d129325424c465a89d9bbb5e1a11b5d` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:54.402013 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f79cc-3794-4e0b-af32-16b2ba6f685d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d129325424c465a89d9bbb5e1a11b5d)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:54.410563 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882f79cc-3794-4e0b-af32-16b2ba6f685d admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:54.411681 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b0fa98-f490-4eb3-bd0f-e670206da0f1 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:54.431514 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a4acf-2e87-4be4-ae3d-7d69ffe65d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:54.432180 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a4acf-2e87-4be4-ae3d-7d69ffe65d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:54.432501 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a4acf-2e87-4be4-ae3d-7d69ffe65d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:54.432778 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a4acf-2e87-4be4-ae3d-7d69ffe65d85 admin admin] PATH_INFO: `/v3/users/24803630da08456ab4a2d4b3cb2eba54` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:54.438967 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a4acf-2e87-4be4-ae3d-7d69ffe65d85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24803630da08456ab4a2d4b3cb2eba54)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:54.438967 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a4acf-2e87-4be4-ae3d-7d69ffe65d85 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:54.647380 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-882f79cc-3794-4e0b-af32-16b2ba6f685d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d129325424c465a89d9bbb5e1a11b5d', 'request_id': 'req-882f79cc-3794-4e0b-af32-16b2ba6f685d'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:54.686800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-4b1a4acf-2e87-4be4-ae3d-7d69ffe65d85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24803630da08456ab4a2d4b3cb2eba54'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:54.688300 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-4b1a4acf-2e87-4be4-ae3d-7d69ffe65d85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24803630da08456ab4a2d4b3cb2eba54'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:54.692892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-882f79cc-3794-4e0b-af32-16b2ba6f685d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d129325424c465a89d9bbb5e1a11b5d', 'request_id': 'req-882f79cc-3794-4e0b-af32-16b2ba6f685d'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:54.705240 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-4b1a4acf-2e87-4be4-ae3d-7d69ffe65d85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24803630da08456ab4a2d4b3cb2eba54'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:54.706288 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-4b1a4acf-2e87-4be4-ae3d-7d69ffe65d85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24803630da08456ab4a2d4b3cb2eba54'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:54.813927 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:54.817693 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-882f79cc-3794-4e0b-af32-16b2ba6f685d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d129325424c465a89d9bbb5e1a11b5d', 'request_id': 'req-882f79cc-3794-4e0b-af32-16b2ba6f685d'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:54.836946 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-882f79cc-3794-4e0b-af32-16b2ba6f685d admin admin] The token cache is being invalidate because project 4d129325424c465a89d9bbb5e1a11b5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:10:54.839643 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-882f79cc-3794-4e0b-af32-16b2ba6f685d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:54.845390 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-882f79cc-3794-4e0b-af32-16b2ba6f685d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:54.850325 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 887/1767] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:10:54 2022] DELETE /identity/v3/projects/4d129325424c465a89d9bbb5e1a11b5d => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:54.853512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b13799-ee01-44e4-9ef9-b14bc62450e7 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:54.853809 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b13799-ee01-44e4-9ef9-b14bc62450e7 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:54.854242 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b13799-ee01-44e4-9ef9-b14bc62450e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:54.886152 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-73b13799-ee01-44e4-9ef9-b14bc62450e7 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:54.888005 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-73b13799-ee01-44e4-9ef9-b14bc62450e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:54.905567 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-4b1a4acf-2e87-4be4-ae3d-7d69ffe65d85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24803630da08456ab4a2d4b3cb2eba54'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:10:54.968840 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 881/1768] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:10:54 2022] DELETE /identity/v3/users/24803630da08456ab4a2d4b3cb2eba54 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:10:55.130762 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 888/1769] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:55.140483 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61e4d8-d5bb-46bd-b49f-478a834c26dd None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:55.141312 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61e4d8-d5bb-46bd-b49f-478a834c26dd None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:55.141980 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d61e4d8-d5bb-46bd-b49f-478a834c26dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:55.212429 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-4d61e4d8-d5bb-46bd-b49f-478a834c26dd None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:55.224286 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-4d61e4d8-d5bb-46bd-b49f-478a834c26dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:55.394170 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:55.428439 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 882/1770] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:55.433124 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b13799-ee01-44e4-9ef9-b14bc62450e7 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:55.473823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b13799-ee01-44e4-9ef9-b14bc62450e7 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:55.496543 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad48fa-a1ce-4ede-a783-7d0c4a7d0bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:55.497433 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad48fa-a1ce-4ede-a783-7d0c4a7d0bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:55.498555 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad48fa-a1ce-4ede-a783-7d0c4a7d0bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:55.498555 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bad48fa-a1ce-4ede-a783-7d0c4a7d0bc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:55.498852 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad48fa-a1ce-4ede-a783-7d0c4a7d0bc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:10:55.499250 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad48fa-a1ce-4ede-a783-7d0c4a7d0bc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:55.501075 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bad48fa-a1ce-4ede-a783-7d0c4a7d0bc8 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:55.526003 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 889/1771] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:10:55.530966 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61e4d8-d5bb-46bd-b49f-478a834c26dd None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:55.542574 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d61e4d8-d5bb-46bd-b49f-478a834c26dd None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:55.569408 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff23e6f-981b-4283-9c00-0044d3aa93c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:55.573313 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff23e6f-981b-4283-9c00-0044d3aa93c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:55.573764 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff23e6f-981b-4283-9c00-0044d3aa93c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:55.574557 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff23e6f-981b-4283-9c00-0044d3aa93c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:55.580608 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff23e6f-981b-4283-9c00-0044d3aa93c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:55.587773 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff23e6f-981b-4283-9c00-0044d3aa93c5 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:55.755770 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 883/1772] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:10:55 2022] POST /identity/v3/projects => generated 361 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:55.759752 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad48fa-a1ce-4ede-a783-7d0c4a7d0bc8 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:55.795479 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bad48fa-a1ce-4ede-a783-7d0c4a7d0bc8 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:55.908942 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bdba2-59fa-473a-8ca2-e713ebe43a16 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:55.909736 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bdba2-59fa-473a-8ca2-e713ebe43a16 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:55.913168 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64bdba2-59fa-473a-8ca2-e713ebe43a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:55.984049 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9d263-00a7-4bc0-8f4e-deb33642c480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:55.985408 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9d263-00a7-4bc0-8f4e-deb33642c480 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:55.985868 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9d263-00a7-4bc0-8f4e-deb33642c480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:55.986352 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9d263-00a7-4bc0-8f4e-deb33642c480 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:55.987273 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9d263-00a7-4bc0-8f4e-deb33642c480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:55.989627 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9d263-00a7-4bc0-8f4e-deb33642c480 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:56.040829 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-c64bdba2-59fa-473a-8ca2-e713ebe43a16 None None] MFA Rules not processed for user `ae9fc5f06a0441da80e656fa1e88db5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:56.042787 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-c64bdba2-59fa-473a-8ca2-e713ebe43a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:56.126232 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 890/1773] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:10:55 2022] POST /identity/v3/users => generated 281 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:56.131582 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9d263-00a7-4bc0-8f4e-deb33642c480 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:56.174592 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9d263-00a7-4bc0-8f4e-deb33642c480 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:56.198591 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393db78-d168-4243-aaed-63a5ea67ed64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:56.199378 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393db78-d168-4243-aaed-63a5ea67ed64 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:56.199666 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393db78-d168-4243-aaed-63a5ea67ed64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:56.201224 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393db78-d168-4243-aaed-63a5ea67ed64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:56.203558 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6393db78-d168-4243-aaed-63a5ea67ed64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:56.206359 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 884/1774] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Aug 24 17:10:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:56.206877 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6393db78-d168-4243-aaed-63a5ea67ed64 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:56.242064 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 891/1775] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:56.251194 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bdba2-59fa-473a-8ca2-e713ebe43a16 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:56.275736 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64bdba2-59fa-473a-8ca2-e713ebe43a16 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:56.285898 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70685a95-c1fa-45fe-a35d-dedf1cdadd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:56.287236 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70685a95-c1fa-45fe-a35d-dedf1cdadd9f admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:56.287748 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70685a95-c1fa-45fe-a35d-dedf1cdadd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:56.288218 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70685a95-c1fa-45fe-a35d-dedf1cdadd9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:56.289064 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70685a95-c1fa-45fe-a35d-dedf1cdadd9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:56.291440 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70685a95-c1fa-45fe-a35d-dedf1cdadd9f admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:56.323461 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 885/1776] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:56.326020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393db78-d168-4243-aaed-63a5ea67ed64 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:56.344965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393db78-d168-4243-aaed-63a5ea67ed64 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:56.351681 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b551d58-6442-4921-9b43-59b545bffaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:56.353225 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b551d58-6442-4921-9b43-59b545bffaa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:56.353709 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b551d58-6442-4921-9b43-59b545bffaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:56.354157 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b551d58-6442-4921-9b43-59b545bffaa4 admin admin] PATH_INFO: `/v3/projects/01ac08c470e64e2e915abc988d6c668b/users/901ceda9cc7c4929992e4a3d288be008/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:56.387498 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b551d58-6442-4921-9b43-59b545bffaa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01ac08c470e64e2e915abc988d6c668b, user_id=901ceda9cc7c4929992e4a3d288be008, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:56.392015 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b551d58-6442-4921-9b43-59b545bffaa4 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:56.464636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749685fe-af80-4fd8-8f20-bef76c43a064 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:56.464919 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749685fe-af80-4fd8-8f20-bef76c43a064 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:56.465199 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749685fe-af80-4fd8-8f20-bef76c43a064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:56.505058 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-749685fe-af80-4fd8-8f20-bef76c43a064 None None] MFA Rules not processed for user `2cad680ebdab4fd4996f39f2e08eabb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:56.507254 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-749685fe-af80-4fd8-8f20-bef76c43a064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:56.526767 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:56.536237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 892/1777] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:10:56 2022] PUT /identity/v3/projects/01ac08c470e64e2e915abc988d6c668b/users/901ceda9cc7c4929992e4a3d288be008/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:56.548277 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0df1cd-4fc5-4626-a9dc-22e76404bf0b None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:56.548865 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0df1cd-4fc5-4626-a9dc-22e76404bf0b None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:56.549498 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0df1cd-4fc5-4626-a9dc-22e76404bf0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:56.600018 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-6e0df1cd-4fc5-4626-a9dc-22e76404bf0b None None] MFA Rules not processed for user `901ceda9cc7c4929992e4a3d288be008`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:56.601302 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-6e0df1cd-4fc5-4626-a9dc-22e76404bf0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:56.683598 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 886/1778] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:56.776140 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 893/1779] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:56.782208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749685fe-af80-4fd8-8f20-bef76c43a064 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:56.805312 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749685fe-af80-4fd8-8f20-bef76c43a064 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:56.842954 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0df1cd-4fc5-4626-a9dc-22e76404bf0b None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:56.844800 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-6e0df1cd-4fc5-4626-a9dc-22e76404bf0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:56.941632 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:56.969019 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433ff42-2fc1-4737-b28b-af1b65dddb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:56.969665 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433ff42-2fc1-4737-b28b-af1b65dddb4b admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:56.970721 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433ff42-2fc1-4737-b28b-af1b65dddb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:56.971058 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433ff42-2fc1-4737-b28b-af1b65dddb4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:56.971947 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433ff42-2fc1-4737-b28b-af1b65dddb4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:56.981153 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d433ff42-2fc1-4737-b28b-af1b65dddb4b admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:57.006542 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0df1cd-4fc5-4626-a9dc-22e76404bf0b None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:57.014011 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559ce57-bf46-4d87-bf1f-f1882dc166a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c067bc2d84b741d08ac47e40adae4b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:57.014899 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559ce57-bf46-4d87-bf1f-f1882dc166a3 service swift] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:57.015470 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559ce57-bf46-4d87-bf1f-f1882dc166a3 service swift] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:57.015936 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559ce57-bf46-4d87-bf1f-f1882dc166a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:57.158547 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 887/1780] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:10:56 2022] POST /identity/v3/projects => generated 363 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:57.163857 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433ff42-2fc1-4737-b28b-af1b65dddb4b admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:57.205312 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559ce57-bf46-4d87-bf1f-f1882dc166a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:57.210619 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559ce57-bf46-4d87-bf1f-f1882dc166a3 service swift] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:57.239159 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 894/1781] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Aug 24 17:10:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 17:10:57.396483 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433ff42-2fc1-4737-b28b-af1b65dddb4b admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:57.402789 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd2f65-a03f-4c5a-b211-cf63e2b3afad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:57.403450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd2f65-a03f-4c5a-b211-cf63e2b3afad admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:57.413118 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd2f65-a03f-4c5a-b211-cf63e2b3afad admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:57.413455 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd2f65-a03f-4c5a-b211-cf63e2b3afad admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:57.414754 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd2f65-a03f-4c5a-b211-cf63e2b3afad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:57.416555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd2f65-a03f-4c5a-b211-cf63e2b3afad admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:57.522073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 888/1782] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:10:57 2022] POST /identity/v3/users => generated 288 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:10:57.526790 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559ce57-bf46-4d87-bf1f-f1882dc166a3 service swift] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:57.556335 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559ce57-bf46-4d87-bf1f-f1882dc166a3 service swift] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:57.570451 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403fbd1-2c61-4290-a804-8ad55ee1a008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:57.571095 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403fbd1-2c61-4290-a804-8ad55ee1a008 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:57.571406 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403fbd1-2c61-4290-a804-8ad55ee1a008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:57.571748 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403fbd1-2c61-4290-a804-8ad55ee1a008 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:57.572396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403fbd1-2c61-4290-a804-8ad55ee1a008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:57.574032 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403fbd1-2c61-4290-a804-8ad55ee1a008 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:57.639005 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 895/1783] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:57.649877 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd2f65-a03f-4c5a-b211-cf63e2b3afad admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:57.678111 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd2f65-a03f-4c5a-b211-cf63e2b3afad admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:57.707669 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60f49c-53ea-4856-aaf8-023f663ecdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:57.712883 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60f49c-53ea-4856-aaf8-023f663ecdd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:57.713177 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60f49c-53ea-4856-aaf8-023f663ecdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:57.713491 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a60f49c-53ea-4856-aaf8-023f663ecdd4 admin admin] PATH_INFO: `/v3/projects/7df5d087d26c4816bba2d99f5aad8f2f/users/0cc7f1cbecdb44b4bc8101c6caa5ed3d/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:57.811890 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60f49c-53ea-4856-aaf8-023f663ecdd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7df5d087d26c4816bba2d99f5aad8f2f, user_id=0cc7f1cbecdb44b4bc8101c6caa5ed3d, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:57.819219 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a60f49c-53ea-4856-aaf8-023f663ecdd4 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:57.824790 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:57.992709 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403fbd1-2c61-4290-a804-8ad55ee1a008 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:57.993409 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 889/1784] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:10:57 2022] PUT /identity/v3/projects/7df5d087d26c4816bba2d99f5aad8f2f/users/0cc7f1cbecdb44b4bc8101c6caa5ed3d/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:58.016618 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403fbd1-2c61-4290-a804-8ad55ee1a008 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:58.146310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82abbab-9ce6-4e2b-9f52-d0604c144272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:58.149595 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82abbab-9ce6-4e2b-9f52-d0604c144272 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:58.150211 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82abbab-9ce6-4e2b-9f52-d0604c144272 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:58.152343 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82abbab-9ce6-4e2b-9f52-d0604c144272 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:58.153373 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82abbab-9ce6-4e2b-9f52-d0604c144272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:58.159415 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82abbab-9ce6-4e2b-9f52-d0604c144272 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:58.184441 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60f49c-53ea-4856-aaf8-023f663ecdd4 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:58.184997 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 896/1785] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:10:58.207309 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a60f49c-53ea-4856-aaf8-023f663ecdd4 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:58.223874 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47eeef-15e3-4771-bdf2-fec8f8a530ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:58.227219 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47eeef-15e3-4771-bdf2-fec8f8a530ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:58.229151 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47eeef-15e3-4771-bdf2-fec8f8a530ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:58.229321 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a47eeef-15e3-4771-bdf2-fec8f8a530ea admin admin] PATH_INFO: `/v3/projects/7df5d087d26c4816bba2d99f5aad8f2f/users/0cc7f1cbecdb44b4bc8101c6caa5ed3d/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:58.242938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a47eeef-15e3-4771-bdf2-fec8f8a530ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=7df5d087d26c4816bba2d99f5aad8f2f, user_id=0cc7f1cbecdb44b4bc8101c6caa5ed3d, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:58.300611 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a47eeef-15e3-4771-bdf2-fec8f8a530ea admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:58.323596 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 890/1786] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:10:58 2022] PUT /identity/v3/projects/7df5d087d26c4816bba2d99f5aad8f2f/users/0cc7f1cbecdb44b4bc8101c6caa5ed3d/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:10:58.344518 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393ae4f-73d9-48a8-bd37-5785ce239ff0 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:58.345987 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393ae4f-73d9-48a8-bd37-5785ce239ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:58.346597 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393ae4f-73d9-48a8-bd37-5785ce239ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:58.408079 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-c393ae4f-73d9-48a8-bd37-5785ce239ff0 None None] MFA Rules not processed for user `0cc7f1cbecdb44b4bc8101c6caa5ed3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:10:58.411972 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-c393ae4f-73d9-48a8-bd37-5785ce239ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:58.609328 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 897/1787] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:10:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:10:58.623940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47eeef-15e3-4771-bdf2-fec8f8a530ea admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:58.626482 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-1a47eeef-15e3-4771-bdf2-fec8f8a530ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:58.981400 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a47eeef-15e3-4771-bdf2-fec8f8a530ea admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:58.981400 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c87e83-7d04-42a8-99e0-9043a393ded6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:58.981400 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c87e83-7d04-42a8-99e0-9043a393ded6 service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:58.981400 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c87e83-7d04-42a8-99e0-9043a393ded6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:58.982804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c87e83-7d04-42a8-99e0-9043a393ded6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:58.982804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c87e83-7d04-42a8-99e0-9043a393ded6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:58.982804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c87e83-7d04-42a8-99e0-9043a393ded6 service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:10:58.982804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 891/1788] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:10:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:10:59.715997 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393ae4f-73d9-48a8-bd37-5785ce239ff0 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:10:59.724917 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-c393ae4f-73d9-48a8-bd37-5785ce239ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:10:59.798075 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:10:59.920817 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393ae4f-73d9-48a8-bd37-5785ce239ff0 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:10:59.928875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4539182f-fcd4-4f9a-83b7-3b9a915c9b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:10:59.928875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539182f-fcd4-4f9a-83b7-3b9a915c9b8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:10:59.928875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539182f-fcd4-4f9a-83b7-3b9a915c9b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:10:59.928875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4539182f-fcd4-4f9a-83b7-3b9a915c9b8e admin admin] PATH_INFO: `/v3/projects/04305b0bd25145b69019f82c78178818` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:10:59.930526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4539182f-fcd4-4f9a-83b7-3b9a915c9b8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=04305b0bd25145b69019f82c78178818)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:10:59.933930 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4539182f-fcd4-4f9a-83b7-3b9a915c9b8e admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:00.151045 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-4539182f-fcd4-4f9a-83b7-3b9a915c9b8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04305b0bd25145b69019f82c78178818', 'request_id': 'req-4539182f-fcd4-4f9a-83b7-3b9a915c9b8e'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:00.160879 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-4539182f-fcd4-4f9a-83b7-3b9a915c9b8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04305b0bd25145b69019f82c78178818', 'request_id': 'req-4539182f-fcd4-4f9a-83b7-3b9a915c9b8e'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:00.276051 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:00.407400 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-4539182f-fcd4-4f9a-83b7-3b9a915c9b8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04305b0bd25145b69019f82c78178818', 'request_id': 'req-4539182f-fcd4-4f9a-83b7-3b9a915c9b8e'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:00.448302 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-4539182f-fcd4-4f9a-83b7-3b9a915c9b8e admin admin] The token cache is being invalidate because project 04305b0bd25145b69019f82c78178818 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:11:00.448626 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-4539182f-fcd4-4f9a-83b7-3b9a915c9b8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:00.450249 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-4539182f-fcd4-4f9a-83b7-3b9a915c9b8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:00.457834 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 898/1789] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:10:59 2022] DELETE /identity/v3/projects/04305b0bd25145b69019f82c78178818 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:00.462700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f31804-5bc4-453a-921d-1b7e51c433ff None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:00.463222 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f31804-5bc4-453a-921d-1b7e51c433ff None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:00.463638 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f31804-5bc4-453a-921d-1b7e51c433ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:00.528000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-70f31804-5bc4-453a-921d-1b7e51c433ff None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:00.530259 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-70f31804-5bc4-453a-921d-1b7e51c433ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:00.821349 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 892/1790] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:00.826222 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d50b3-d3ed-4d04-887c-9444cb0b0c40 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:00.826222 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d50b3-d3ed-4d04-887c-9444cb0b0c40 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:00.826222 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d50b3-d3ed-4d04-887c-9444cb0b0c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:00.880717 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-809d50b3-d3ed-4d04-887c-9444cb0b0c40 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:00.882302 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-809d50b3-d3ed-4d04-887c-9444cb0b0c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:00.916100 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 899/1791] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:00.920507 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f31804-5bc4-453a-921d-1b7e51c433ff None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:00.953823 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f31804-5bc4-453a-921d-1b7e51c433ff None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:00.969810 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e75a5eb-9716-4894-a151-f3d61b80855b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:00.989349 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75a5eb-9716-4894-a151-f3d61b80855b admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:00.989349 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75a5eb-9716-4894-a151-f3d61b80855b admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:00.989349 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e75a5eb-9716-4894-a151-f3d61b80855b admin admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:00.990086 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75a5eb-9716-4894-a151-f3d61b80855b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:11:00.990329 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75a5eb-9716-4894-a151-f3d61b80855b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:00.997367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e75a5eb-9716-4894-a151-f3d61b80855b admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:01.019838 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 893/1792] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:11:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:11:01.024074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d50b3-d3ed-4d04-887c-9444cb0b0c40 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:01.040236 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d50b3-d3ed-4d04-887c-9444cb0b0c40 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:01.054459 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cfc5c-fca7-4dc0-bd08-b0d3c2fe8000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:01.055317 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cfc5c-fca7-4dc0-bd08-b0d3c2fe8000 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:01.055729 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cfc5c-fca7-4dc0-bd08-b0d3c2fe8000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:01.056182 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cfc5c-fca7-4dc0-bd08-b0d3c2fe8000 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:01.057195 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5cfc5c-fca7-4dc0-bd08-b0d3c2fe8000 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:01.059551 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5cfc5c-fca7-4dc0-bd08-b0d3c2fe8000 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:01.125649 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:01.128626 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38da6d-aecb-4f72-bb73-4e42d3b7e56e None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:01.129069 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38da6d-aecb-4f72-bb73-4e42d3b7e56e None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:01.129418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd38da6d-aecb-4f72-bb73-4e42d3b7e56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:01.166813 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-cd38da6d-aecb-4f72-bb73-4e42d3b7e56e None None] MFA Rules not processed for user `9d829f56be8a4000946c6ca93007937c`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:01.171637 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-cd38da6d-aecb-4f72-bb73-4e42d3b7e56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:01.234852 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 900/1793] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:11:01 2022] POST /identity/v3/projects => generated 383 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:01.236048 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cfc5c-fca7-4dc0-bd08-b0d3c2fe8000 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:01.507148 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cfc5c-fca7-4dc0-bd08-b0d3c2fe8000 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:01.534203 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 894/1794] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:11:01.534203 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38da6d-aecb-4f72-bb73-4e42d3b7e56e None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:01.540043 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-cd38da6d-aecb-4f72-bb73-4e42d3b7e56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:01.543059 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798c3fe-e60b-4f7e-89ff-199b58789d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:01.580565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798c3fe-e60b-4f7e-89ff-199b58789d87 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:01.580565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798c3fe-e60b-4f7e-89ff-199b58789d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:01.580565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798c3fe-e60b-4f7e-89ff-199b58789d87 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:01.580565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798c3fe-e60b-4f7e-89ff-199b58789d87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:01.580565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798c3fe-e60b-4f7e-89ff-199b58789d87 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:01.581488 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd38da6d-aecb-4f72-bb73-4e42d3b7e56e None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:01.582594 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213ca689-72c4-4bed-a0d2-6e6407ce9a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:01.583470 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ca689-72c4-4bed-a0d2-6e6407ce9a07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:01.583859 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ca689-72c4-4bed-a0d2-6e6407ce9a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:01.584248 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213ca689-72c4-4bed-a0d2-6e6407ce9a07 admin admin] PATH_INFO: `/v3/users/901ceda9cc7c4929992e4a3d288be008` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:01.586418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ca689-72c4-4bed-a0d2-6e6407ce9a07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=901ceda9cc7c4929992e4a3d288be008)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:01.620654 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213ca689-72c4-4bed-a0d2-6e6407ce9a07 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:01.775489 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 901/1795] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:11:01 2022] POST /identity/v3/users => generated 292 bytes in 540 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:01.788216 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b998f-4b50-40cd-ad7c-020d6cd0cf3a None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:01.793231 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b998f-4b50-40cd-ad7c-020d6cd0cf3a None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:01.793231 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b998f-4b50-40cd-ad7c-020d6cd0cf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:01.915496 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-785b998f-4b50-40cd-ad7c-020d6cd0cf3a None None] MFA Rules not processed for user `88ce8df89a96460ca046f2972321bceb`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:01.916755 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-785b998f-4b50-40cd-ad7c-020d6cd0cf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:01.972874 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:01.981248 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-213ca689-72c4-4bed-a0d2-6e6407ce9a07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '901ceda9cc7c4929992e4a3d288be008'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:01.982622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-213ca689-72c4-4bed-a0d2-6e6407ce9a07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '901ceda9cc7c4929992e4a3d288be008'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:02.026062 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-213ca689-72c4-4bed-a0d2-6e6407ce9a07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '901ceda9cc7c4929992e4a3d288be008'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:02.028208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-213ca689-72c4-4bed-a0d2-6e6407ce9a07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '901ceda9cc7c4929992e4a3d288be008'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:02.135041 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-213ca689-72c4-4bed-a0d2-6e6407ce9a07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '901ceda9cc7c4929992e4a3d288be008'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:02.161643 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 902/1796] 10.222.0.47 () {58 vars in 1015 bytes} [Wed Aug 24 17:11:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:02.163181 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b998f-4b50-40cd-ad7c-020d6cd0cf3a None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:02.166366 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-785b998f-4b50-40cd-ad7c-020d6cd0cf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:02.206025 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 895/1797] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:11:01 2022] DELETE /identity/v3/users/901ceda9cc7c4929992e4a3d288be008 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:02.210465 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fba51-23f9-495e-8951-d513a6ff6903 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:02.212024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fba51-23f9-495e-8951-d513a6ff6903 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:02.213493 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b998f-4b50-40cd-ad7c-020d6cd0cf3a None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:02.214086 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fba51-23f9-495e-8951-d513a6ff6903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:02.261864 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-a15fba51-23f9-495e-8951-d513a6ff6903 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:02.265473 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-a15fba51-23f9-495e-8951-d513a6ff6903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:02.390401 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33a466-ba4b-4d55-b140-6b026de29970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:02.394927 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33a466-ba4b-4d55-b140-6b026de29970 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:02.394927 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33a466-ba4b-4d55-b140-6b026de29970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:02.394927 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33a466-ba4b-4d55-b140-6b026de29970 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:02.394927 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33a466-ba4b-4d55-b140-6b026de29970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:02.412250 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33a466-ba4b-4d55-b140-6b026de29970 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:02.457654 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 903/1798] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:02.459170 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33a466-ba4b-4d55-b140-6b026de29970 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:02.464927 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-6a33a466-ba4b-4d55-b140-6b026de29970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:02.489796 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 896/1799] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:02.490930 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fba51-23f9-495e-8951-d513a6ff6903 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:02.494542 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-a15fba51-23f9-495e-8951-d513a6ff6903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:02.609368 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33a466-ba4b-4d55-b140-6b026de29970 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:02.615450 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c77491-0f4a-4afa-8ace-cb644726cdd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:02.616622 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c77491-0f4a-4afa-8ace-cb644726cdd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:02.617010 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c77491-0f4a-4afa-8ace-cb644726cdd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:02.617352 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c77491-0f4a-4afa-8ace-cb644726cdd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:02.632274 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c77491-0f4a-4afa-8ace-cb644726cdd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:02.636336 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c77491-0f4a-4afa-8ace-cb644726cdd5 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:02.648200 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 904/1800] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:11:02.649105 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c77491-0f4a-4afa-8ace-cb644726cdd5 service neutron] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:02.650736 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-44c77491-0f4a-4afa-8ace-cb644726cdd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:02.680755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fba51-23f9-495e-8951-d513a6ff6903 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:02.689635 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c77491-0f4a-4afa-8ace-cb644726cdd5 service neutron] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:02.700869 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0a73f-26a6-4fe9-967a-034d4fd32a09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:02.702037 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358f3ad-f514-4cfa-9b57-d3e9cde95721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:02.702162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0a73f-26a6-4fe9-967a-034d4fd32a09 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:02.702239 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358f3ad-f514-4cfa-9b57-d3e9cde95721 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:02.702328 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0a73f-26a6-4fe9-967a-034d4fd32a09 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:02.702404 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe0a73f-26a6-4fe9-967a-034d4fd32a09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:02.704084 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358f3ad-f514-4cfa-9b57-d3e9cde95721 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:02.704316 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358f3ad-f514-4cfa-9b57-d3e9cde95721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:02.728373 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358f3ad-f514-4cfa-9b57-d3e9cde95721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:02.733130 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358f3ad-f514-4cfa-9b57-d3e9cde95721 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:02.735640 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe0a73f-26a6-4fe9-967a-034d4fd32a09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:02.740064 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe0a73f-26a6-4fe9-967a-034d4fd32a09 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:02.760887 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 905/1801] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:11:02.763174 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358f3ad-f514-4cfa-9b57-d3e9cde95721 service neutron] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:02.798874 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358f3ad-f514-4cfa-9b57-d3e9cde95721 service neutron] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:02.818991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a655e2f-63db-4fe1-935f-4d751134b309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:02.821153 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 897/1802] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:11:02.821279 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a655e2f-63db-4fe1-935f-4d751134b309 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:02.822572 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a655e2f-63db-4fe1-935f-4d751134b309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:02.822864 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a655e2f-63db-4fe1-935f-4d751134b309 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:02.826213 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0a73f-26a6-4fe9-967a-034d4fd32a09 service neutron] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:02.827244 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a655e2f-63db-4fe1-935f-4d751134b309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:02.833429 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a655e2f-63db-4fe1-935f-4d751134b309 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:02.865559 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 906/1803] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:02 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:02.872762 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a655e2f-63db-4fe1-935f-4d751134b309 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:02.873002 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe0a73f-26a6-4fe9-967a-034d4fd32a09 service neutron] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:02.901857 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a950d58-2a64-4d0d-86ed-5ed506db842b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:02.904610 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a950d58-2a64-4d0d-86ed-5ed506db842b service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:02.905080 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a950d58-2a64-4d0d-86ed-5ed506db842b service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:02.905470 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a950d58-2a64-4d0d-86ed-5ed506db842b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:02.907360 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a655e2f-63db-4fe1-935f-4d751134b309 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:02.939274 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d1e3c-f04c-41b5-a91b-111ebb7f8db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:02.940070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d1e3c-f04c-41b5-a91b-111ebb7f8db3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:02.940349 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d1e3c-f04c-41b5-a91b-111ebb7f8db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:02.940607 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15d1e3c-f04c-41b5-a91b-111ebb7f8db3 admin admin] PATH_INFO: `/v3/projects/98d2708645e94814a61f55047baedd0b/users/88afc1de6eef45e8b56e5beea31b34d7/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:02.968256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a950d58-2a64-4d0d-86ed-5ed506db842b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:02.980557 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a950d58-2a64-4d0d-86ed-5ed506db842b service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:03.016813 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d1e3c-f04c-41b5-a91b-111ebb7f8db3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d2708645e94814a61f55047baedd0b, user_id=88afc1de6eef45e8b56e5beea31b34d7, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:03.021104 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 898/1804] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:11:03.024604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15d1e3c-f04c-41b5-a91b-111ebb7f8db3 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:03.123666 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:03.130479 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 907/1805] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:11:02 2022] PUT /identity/v3/projects/98d2708645e94814a61f55047baedd0b/users/88afc1de6eef45e8b56e5beea31b34d7/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:03.144044 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79548e65-5d6d-452e-a494-5514657bda8f None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:03.144331 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79548e65-5d6d-452e-a494-5514657bda8f None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:03.144614 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79548e65-5d6d-452e-a494-5514657bda8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:03.246115 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-79548e65-5d6d-452e-a494-5514657bda8f None None] MFA Rules not processed for user `88afc1de6eef45e8b56e5beea31b34d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:03.248421 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-79548e65-5d6d-452e-a494-5514657bda8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:03.453315 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 899/1806] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:03.470516 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d1e3c-f04c-41b5-a91b-111ebb7f8db3 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:03.474410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-a15d1e3c-f04c-41b5-a91b-111ebb7f8db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:03.648653 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15d1e3c-f04c-41b5-a91b-111ebb7f8db3 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:03.653182 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8400933-786c-4814-8c2a-10d66d19c5ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:03.653470 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8400933-786c-4814-8c2a-10d66d19c5ed service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:03.653741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8400933-786c-4814-8c2a-10d66d19c5ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:03.654013 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8400933-786c-4814-8c2a-10d66d19c5ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:03.683763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8400933-786c-4814-8c2a-10d66d19c5ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:03.690627 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8400933-786c-4814-8c2a-10d66d19c5ed service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:03.711166 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 908/1807] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:11:03.745039 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79548e65-5d6d-452e-a494-5514657bda8f None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:03.897475 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79548e65-5d6d-452e-a494-5514657bda8f None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:03.907129 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cba43f-5809-429f-b386-4c083150cf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:03.908059 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cba43f-5809-429f-b386-4c083150cf6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:03.908562 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cba43f-5809-429f-b386-4c083150cf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:03.909044 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cba43f-5809-429f-b386-4c083150cf6a admin admin] PATH_INFO: `/v3/users/88afc1de6eef45e8b56e5beea31b34d7` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:03.910549 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cba43f-5809-429f-b386-4c083150cf6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=88afc1de6eef45e8b56e5beea31b34d7)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:03.912794 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cba43f-5809-429f-b386-4c083150cf6a admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:04.156567 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:04.200640 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-54cba43f-5809-429f-b386-4c083150cf6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88afc1de6eef45e8b56e5beea31b34d7'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:04.201982 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-54cba43f-5809-429f-b386-4c083150cf6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88afc1de6eef45e8b56e5beea31b34d7'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:04.213767 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-54cba43f-5809-429f-b386-4c083150cf6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88afc1de6eef45e8b56e5beea31b34d7'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:04.214666 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-54cba43f-5809-429f-b386-4c083150cf6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88afc1de6eef45e8b56e5beea31b34d7'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:04.286654 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-54cba43f-5809-429f-b386-4c083150cf6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88afc1de6eef45e8b56e5beea31b34d7'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:04.341630 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 900/1808] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:11:03 2022] DELETE /identity/v3/users/88afc1de6eef45e8b56e5beea31b34d7 => generated 0 bytes in 596 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:04.346706 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad1eae-f26d-4569-a2c0-6e4017fa2082 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:04.350673 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad1eae-f26d-4569-a2c0-6e4017fa2082 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:04.350673 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ad1eae-f26d-4569-a2c0-6e4017fa2082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:04.408093 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-99ad1eae-f26d-4569-a2c0-6e4017fa2082 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:04.432011 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-99ad1eae-f26d-4569-a2c0-6e4017fa2082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:04.626982 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 909/1809] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:04.650640 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cba43f-5809-429f-b386-4c083150cf6a admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:04.652263 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-54cba43f-5809-429f-b386-4c083150cf6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:04.838239 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cba43f-5809-429f-b386-4c083150cf6a admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:04.843562 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a5a69-7a6c-4bd8-b40c-8acb4e1f0eb5 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:04.843833 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a5a69-7a6c-4bd8-b40c-8acb4e1f0eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:04.844166 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a5a69-7a6c-4bd8-b40c-8acb4e1f0eb5 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:04.846341 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 910/1810] 10.222.0.55 () {54 vars in 921 bytes} [Wed Aug 24 17:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:11:04.871918 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961abc2-f104-490d-af46-026619a24f97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:04.880099 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70422030-24f7-4d8a-884e-3b067c92c424 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:04.880390 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70422030-24f7-4d8a-884e-3b067c92c424 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:04.880669 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70422030-24f7-4d8a-884e-3b067c92c424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:04.881996 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961abc2-f104-490d-af46-026619a24f97 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:04.882285 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961abc2-f104-490d-af46-026619a24f97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:04.882560 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2961abc2-f104-490d-af46-026619a24f97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:04.919464 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-70422030-24f7-4d8a-884e-3b067c92c424 None None] MFA Rules not processed for user `28a1c617fc264b118e61f2a97ecb3f39`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:04.920804 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-70422030-24f7-4d8a-884e-3b067c92c424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:04.923742 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961abc2-f104-490d-af46-026619a24f97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:04.925748 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2961abc2-f104-490d-af46-026619a24f97 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:04.964065 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 901/1811] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:11:05.029438 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:05.117246 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 911/1812] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Aug 24 17:11:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:11:05.374432 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961abc2-f104-490d-af46-026619a24f97 service neutron] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:05.377354 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-2961abc2-f104-490d-af46-026619a24f97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:05.411283 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2961abc2-f104-490d-af46-026619a24f97 service neutron] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:05.425063 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6eb96-a3dc-4ee8-9b30-dcb6c075bfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:05.425719 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6eb96-a3dc-4ee8-9b30-dcb6c075bfae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:05.426049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6eb96-a3dc-4ee8-9b30-dcb6c075bfae admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:05.438675 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6eb96-a3dc-4ee8-9b30-dcb6c075bfae admin admin] PATH_INFO: `/v3/projects/01ac08c470e64e2e915abc988d6c668b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:05.440381 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6eb96-a3dc-4ee8-9b30-dcb6c075bfae admin admin] RBAC: Authorizing `identity:delete_project(project_id=01ac08c470e64e2e915abc988d6c668b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:05.445402 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6eb96-a3dc-4ee8-9b30-dcb6c075bfae admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:05.542661 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70422030-24f7-4d8a-884e-3b067c92c424 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:05.550794 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-70422030-24f7-4d8a-884e-3b067c92c424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:05.636919 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70422030-24f7-4d8a-884e-3b067c92c424 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:05.664990 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2a337-2f76-426b-bfcb-1a5627c495df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:05.675840 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2a337-2f76-426b-bfcb-1a5627c495df service nova] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:05.676602 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2a337-2f76-426b-bfcb-1a5627c495df service nova] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:05.677062 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2a337-2f76-426b-bfcb-1a5627c495df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:05.725936 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2a337-2f76-426b-bfcb-1a5627c495df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:05.733504 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2a337-2f76-426b-bfcb-1a5627c495df service nova] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:05.811529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 912/1813] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:11:05.848317 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-9ac6eb96-a3dc-4ee8-9b30-dcb6c075bfae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01ac08c470e64e2e915abc988d6c668b', 'request_id': 'req-9ac6eb96-a3dc-4ee8-9b30-dcb6c075bfae'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:05.864977 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-9ac6eb96-a3dc-4ee8-9b30-dcb6c075bfae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01ac08c470e64e2e915abc988d6c668b', 'request_id': 'req-9ac6eb96-a3dc-4ee8-9b30-dcb6c075bfae'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:05.872511 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf10f27-19ce-4b16-88a7-fba550891cee None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:05.873128 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf10f27-19ce-4b16-88a7-fba550891cee None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:05.873635 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf10f27-19ce-4b16-88a7-fba550891cee None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:05.875982 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 913/1814] 10.222.0.55 () {54 vars in 921 bytes} [Wed Aug 24 17:11:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:11:05.885936 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-9ac6eb96-a3dc-4ee8-9b30-dcb6c075bfae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01ac08c470e64e2e915abc988d6c668b', 'request_id': 'req-9ac6eb96-a3dc-4ee8-9b30-dcb6c075bfae'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:05.892045 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef815b-16ce-4212-8b8f-2aa17914d512 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:05.893353 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef815b-16ce-4212-8b8f-2aa17914d512 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:05.893353 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adef815b-16ce-4212-8b8f-2aa17914d512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:05.917412 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:05.969783 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-adef815b-16ce-4212-8b8f-2aa17914d512 None None] MFA Rules not processed for user `28a1c617fc264b118e61f2a97ecb3f39`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:05.971092 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-adef815b-16ce-4212-8b8f-2aa17914d512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:06.024732 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-9ac6eb96-a3dc-4ee8-9b30-dcb6c075bfae admin admin] The token cache is being invalidate because project 01ac08c470e64e2e915abc988d6c668b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:11:06.025284 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-9ac6eb96-a3dc-4ee8-9b30-dcb6c075bfae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:06.026858 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-9ac6eb96-a3dc-4ee8-9b30-dcb6c075bfae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:06.030394 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 902/1815] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:11:05 2022] DELETE /identity/v3/projects/01ac08c470e64e2e915abc988d6c668b => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:11:06.036000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6eb96-a3dc-4ee8-9b30-dcb6c075bfae admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:06.065159 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-9ac6eb96-a3dc-4ee8-9b30-dcb6c075bfae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:06.374060 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 914/1816] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Aug 24 17:11:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 483 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:11:06.479779 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6eb96-a3dc-4ee8-9b30-dcb6c075bfae admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:06.497486 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55cd49-76bd-4d11-89c9-2bd43315c951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:06.497486 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55cd49-76bd-4d11-89c9-2bd43315c951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:06.497486 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55cd49-76bd-4d11-89c9-2bd43315c951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:06.497486 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd55cd49-76bd-4d11-89c9-2bd43315c951 admin admin] PATH_INFO: `/v3/users/0cc7f1cbecdb44b4bc8101c6caa5ed3d` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:06.501799 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55cd49-76bd-4d11-89c9-2bd43315c951 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cc7f1cbecdb44b4bc8101c6caa5ed3d)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:06.509496 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd55cd49-76bd-4d11-89c9-2bd43315c951 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:06.764155 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:06.780860 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-bd55cd49-76bd-4d11-89c9-2bd43315c951 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cc7f1cbecdb44b4bc8101c6caa5ed3d'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:06.784423 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-bd55cd49-76bd-4d11-89c9-2bd43315c951 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cc7f1cbecdb44b4bc8101c6caa5ed3d'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:06.810089 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-bd55cd49-76bd-4d11-89c9-2bd43315c951 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cc7f1cbecdb44b4bc8101c6caa5ed3d'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:06.816074 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-bd55cd49-76bd-4d11-89c9-2bd43315c951 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cc7f1cbecdb44b4bc8101c6caa5ed3d'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:06.837284 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:06.926474 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-bd55cd49-76bd-4d11-89c9-2bd43315c951 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cc7f1cbecdb44b4bc8101c6caa5ed3d'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:06.961277 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 903/1817] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:11:06 2022] DELETE /identity/v3/users/0cc7f1cbecdb44b4bc8101c6caa5ed3d => generated 0 bytes in 925 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:07.019719 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef815b-16ce-4212-8b8f-2aa17914d512 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:07.021513 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-adef815b-16ce-4212-8b8f-2aa17914d512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:07.044316 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adef815b-16ce-4212-8b8f-2aa17914d512 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:07.198738 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa4046-2e64-4763-aab5-fd4d1efe1daa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:07.201969 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa4046-2e64-4763-aab5-fd4d1efe1daa service nova] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:07.202929 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa4046-2e64-4763-aab5-fd4d1efe1daa service nova] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:07.204557 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa4046-2e64-4763-aab5-fd4d1efe1daa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:07.209230 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-b8aa4046-2e64-4763-aab5-fd4d1efe1daa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:07.228072 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa4046-2e64-4763-aab5-fd4d1efe1daa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:07.230316 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8aa4046-2e64-4763-aab5-fd4d1efe1daa service nova] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:07.288662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 915/1818] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:11:08.378331 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55cd49-76bd-4d11-89c9-2bd43315c951 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:08.380160 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-bd55cd49-76bd-4d11-89c9-2bd43315c951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:08.545872 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd55cd49-76bd-4d11-89c9-2bd43315c951 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:08.567989 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e02c23e-6ad4-48f0-98c7-89b0847eaee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:08.569046 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02c23e-6ad4-48f0-98c7-89b0847eaee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:08.569681 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02c23e-6ad4-48f0-98c7-89b0847eaee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:08.570207 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e02c23e-6ad4-48f0-98c7-89b0847eaee7 admin admin] PATH_INFO: `/v3/projects/98d2708645e94814a61f55047baedd0b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:08.572260 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02c23e-6ad4-48f0-98c7-89b0847eaee7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98d2708645e94814a61f55047baedd0b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:08.575948 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e02c23e-6ad4-48f0-98c7-89b0847eaee7 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:08.704393 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa4046-2e64-4763-aab5-fd4d1efe1daa service nova] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:08.709802 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-b8aa4046-2e64-4763-aab5-fd4d1efe1daa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:08.755629 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa4046-2e64-4763-aab5-fd4d1efe1daa service nova] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:08.764949 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-2e02c23e-6ad4-48f0-98c7-89b0847eaee7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98d2708645e94814a61f55047baedd0b', 'request_id': 'req-2e02c23e-6ad4-48f0-98c7-89b0847eaee7'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:08.796341 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-2e02c23e-6ad4-48f0-98c7-89b0847eaee7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98d2708645e94814a61f55047baedd0b', 'request_id': 'req-2e02c23e-6ad4-48f0-98c7-89b0847eaee7'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:08.836188 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-2e02c23e-6ad4-48f0-98c7-89b0847eaee7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98d2708645e94814a61f55047baedd0b', 'request_id': 'req-2e02c23e-6ad4-48f0-98c7-89b0847eaee7'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:08.967853 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd46654-ea7c-491c-ad3e-cbdeed50059d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:08.969822 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd46654-ea7c-491c-ad3e-cbdeed50059d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:08.971094 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd46654-ea7c-491c-ad3e-cbdeed50059d admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:08.971730 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd46654-ea7c-491c-ad3e-cbdeed50059d admin admin] PATH_INFO: `/v3/projects/7df5d087d26c4816bba2d99f5aad8f2f` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:08.974048 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd46654-ea7c-491c-ad3e-cbdeed50059d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7df5d087d26c4816bba2d99f5aad8f2f)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:08.979273 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd46654-ea7c-491c-ad3e-cbdeed50059d admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:09.043585 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-2e02c23e-6ad4-48f0-98c7-89b0847eaee7 admin admin] The token cache is being invalidate because project 98d2708645e94814a61f55047baedd0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:11:09.044115 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-2e02c23e-6ad4-48f0-98c7-89b0847eaee7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:09.045262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-2e02c23e-6ad4-48f0-98c7-89b0847eaee7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:09.047850 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 904/1819] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:11:08 2022] DELETE /identity/v3/projects/98d2708645e94814a61f55047baedd0b => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:09.052697 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1472d-9234-44c5-9cb1-91b3eaf956fc None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:09.053137 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1472d-9234-44c5-9cb1-91b3eaf956fc None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:09.053596 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae1472d-9234-44c5-9cb1-91b3eaf956fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:09.101131 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-6ae1472d-9234-44c5-9cb1-91b3eaf956fc None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:09.102683 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-6ae1472d-9234-44c5-9cb1-91b3eaf956fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:09.117829 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 905/1820] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:09.135800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc127b0-5e6a-4e24-acf7-a9f9878794c8 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:09.136354 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc127b0-5e6a-4e24-acf7-a9f9878794c8 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:09.137427 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc127b0-5e6a-4e24-acf7-a9f9878794c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:09.256384 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-cdc127b0-5e6a-4e24-acf7-a9f9878794c8 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:09.261788 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-cdc127b0-5e6a-4e24-acf7-a9f9878794c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:09.286060 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-7fd46654-ea7c-491c-ad3e-cbdeed50059d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7df5d087d26c4816bba2d99f5aad8f2f', 'request_id': 'req-7fd46654-ea7c-491c-ad3e-cbdeed50059d'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:09.301931 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-7fd46654-ea7c-491c-ad3e-cbdeed50059d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7df5d087d26c4816bba2d99f5aad8f2f', 'request_id': 'req-7fd46654-ea7c-491c-ad3e-cbdeed50059d'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:09.395518 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-7fd46654-ea7c-491c-ad3e-cbdeed50059d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7df5d087d26c4816bba2d99f5aad8f2f', 'request_id': 'req-7fd46654-ea7c-491c-ad3e-cbdeed50059d'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:09.421652 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:09.472695 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-7fd46654-ea7c-491c-ad3e-cbdeed50059d admin admin] The token cache is being invalidate because project 7df5d087d26c4816bba2d99f5aad8f2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:11:09.472695 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-7fd46654-ea7c-491c-ad3e-cbdeed50059d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:09.472847 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 906/1821] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:09.472917 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-7fd46654-ea7c-491c-ad3e-cbdeed50059d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:09.472991 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc127b0-5e6a-4e24-acf7-a9f9878794c8 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:09.491400 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 916/1822] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:11:08 2022] DELETE /identity/v3/projects/7df5d087d26c4816bba2d99f5aad8f2f => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:09.506572 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1f415-a5a6-40dd-8b05-7b617c19f1fb None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:09.506572 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1f415-a5a6-40dd-8b05-7b617c19f1fb None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:09.506572 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1f415-a5a6-40dd-8b05-7b617c19f1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:09.510494 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc127b0-5e6a-4e24-acf7-a9f9878794c8 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:09.523842 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa6058-c3cf-4e84-bbe3-684b1eda8e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:09.524515 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa6058-c3cf-4e84-bbe3-684b1eda8e50 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:09.525739 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa6058-c3cf-4e84-bbe3-684b1eda8e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:09.526258 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa6058-c3cf-4e84-bbe3-684b1eda8e50 admin admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:09.527503 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa6058-c3cf-4e84-bbe3-684b1eda8e50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:11:09.528063 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa6058-c3cf-4e84-bbe3-684b1eda8e50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:09.530401 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa6058-c3cf-4e84-bbe3-684b1eda8e50 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:09.545880 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 907/1823] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:11:09.550722 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa6058-c3cf-4e84-bbe3-684b1eda8e50 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:09.553400 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-feaa6058-c3cf-4e84-bbe3-684b1eda8e50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:09.574412 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa6058-c3cf-4e84-bbe3-684b1eda8e50 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:09.619992 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ff89d-8b1b-42b0-ac32-a55dc927888a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:09.620900 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ff89d-8b1b-42b0-ac32-a55dc927888a admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:09.623433 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ff89d-8b1b-42b0-ac32-a55dc927888a admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:09.623915 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ff89d-8b1b-42b0-ac32-a55dc927888a admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:09.626359 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ff89d-8b1b-42b0-ac32-a55dc927888a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:09.633208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ff89d-8b1b-42b0-ac32-a55dc927888a admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:09.635142 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-59c1f415-a5a6-40dd-8b05-7b617c19f1fb None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:09.640126 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-59c1f415-a5a6-40dd-8b05-7b617c19f1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:09.676942 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 917/1824] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:09.684767 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae5355-3069-4562-b99a-1b170da271f9 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:09.685192 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae5355-3069-4562-b99a-1b170da271f9 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:09.685568 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae5355-3069-4562-b99a-1b170da271f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:09.733512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-22ae5355-3069-4562-b99a-1b170da271f9 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:09.737313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-22ae5355-3069-4562-b99a-1b170da271f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:09.763984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 918/1825] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:09.768608 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae5355-3069-4562-b99a-1b170da271f9 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:09.785171 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae5355-3069-4562-b99a-1b170da271f9 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:09.815307 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41304e31-f4bc-4e3a-b698-4ff95a9b5a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:09.816693 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41304e31-f4bc-4e3a-b698-4ff95a9b5a78 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:09.817162 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41304e31-f4bc-4e3a-b698-4ff95a9b5a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:09.817534 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41304e31-f4bc-4e3a-b698-4ff95a9b5a78 admin admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:09.818299 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41304e31-f4bc-4e3a-b698-4ff95a9b5a78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:11:09.818881 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41304e31-f4bc-4e3a-b698-4ff95a9b5a78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:09.820746 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41304e31-f4bc-4e3a-b698-4ff95a9b5a78 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:09.851458 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 919/1826] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:11:09.852729 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41304e31-f4bc-4e3a-b698-4ff95a9b5a78 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:09.880551 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41304e31-f4bc-4e3a-b698-4ff95a9b5a78 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:09.888712 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506892f-7cfd-41ab-9693-8f7b013bcfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:09.889672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506892f-7cfd-41ab-9693-8f7b013bcfc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:09.890150 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506892f-7cfd-41ab-9693-8f7b013bcfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:09.890648 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d506892f-7cfd-41ab-9693-8f7b013bcfc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:09.891642 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d506892f-7cfd-41ab-9693-8f7b013bcfc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:09.893852 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d506892f-7cfd-41ab-9693-8f7b013bcfc7 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:09.895208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 908/1827] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:11:09 2022] POST /identity/v3/projects => generated 375 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:11:09.898177 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ff89d-8b1b-42b0-ac32-a55dc927888a admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:09.950461 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:10.029445 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 920/1828] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:11:09 2022] POST /identity/v3/projects => generated 379 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:10.034978 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506892f-7cfd-41ab-9693-8f7b013bcfc7 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:10.061343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ff89d-8b1b-42b0-ac32-a55dc927888a admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:10.179514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d506892f-7cfd-41ab-9693-8f7b013bcfc7 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:10.194589 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144feba-b8b1-47ff-95db-85fb6ec4409c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:10.196350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144feba-b8b1-47ff-95db-85fb6ec4409c admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:10.197343 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144feba-b8b1-47ff-95db-85fb6ec4409c admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:10.199901 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144feba-b8b1-47ff-95db-85fb6ec4409c admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:10.201659 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144feba-b8b1-47ff-95db-85fb6ec4409c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:10.205578 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3f5bd-01bb-4174-bc7a-dab877ae973e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:10.206854 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3f5bd-01bb-4174-bc7a-dab877ae973e admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:10.207389 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144feba-b8b1-47ff-95db-85fb6ec4409c admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:10.209327 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3f5bd-01bb-4174-bc7a-dab877ae973e admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:10.209984 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3f5bd-01bb-4174-bc7a-dab877ae973e admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:10.210684 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3f5bd-01bb-4174-bc7a-dab877ae973e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:10.216432 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d3f5bd-01bb-4174-bc7a-dab877ae973e admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:10.379826 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 921/1829] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:11:10 2022] POST /identity/v3/users => generated 290 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:10.381903 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144feba-b8b1-47ff-95db-85fb6ec4409c admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:10.409858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144feba-b8b1-47ff-95db-85fb6ec4409c admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:10.416497 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:10.416823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddfa33-f0b7-4567-afe2-4fa9fac43d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:10.417509 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddfa33-f0b7-4567-afe2-4fa9fac43d3d admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:10.417796 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddfa33-f0b7-4567-afe2-4fa9fac43d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:10.418073 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddfa33-f0b7-4567-afe2-4fa9fac43d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:10.418878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eddfa33-f0b7-4567-afe2-4fa9fac43d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:10.420963 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eddfa33-f0b7-4567-afe2-4fa9fac43d3d admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:10.436078 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 922/1830] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:10.443831 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddfa33-f0b7-4567-afe2-4fa9fac43d3d admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:10.460334 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 909/1831] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:11:09 2022] POST /identity/v3/users => generated 288 bytes in 556 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:10.466272 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3f5bd-01bb-4174-bc7a-dab877ae973e admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:10.468247 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eddfa33-f0b7-4567-afe2-4fa9fac43d3d admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:10.486283 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11b4c6-4b68-43b9-ba3f-0332443a12cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:10.486655 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11b4c6-4b68-43b9-ba3f-0332443a12cf admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:10.486655 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11b4c6-4b68-43b9-ba3f-0332443a12cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:10.486948 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11b4c6-4b68-43b9-ba3f-0332443a12cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:10.487801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd11b4c6-4b68-43b9-ba3f-0332443a12cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:10.490797 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd11b4c6-4b68-43b9-ba3f-0332443a12cf admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:10.496214 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d3f5bd-01bb-4174-bc7a-dab877ae973e admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:10.505009 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 923/1832] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:11:10.509468 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f00b6d-a246-4f01-9e20-35f72315dafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:10.510045 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11b4c6-4b68-43b9-ba3f-0332443a12cf admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:10.511534 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f00b6d-a246-4f01-9e20-35f72315dafc admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:10.512601 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f00b6d-a246-4f01-9e20-35f72315dafc admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:10.513496 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f00b6d-a246-4f01-9e20-35f72315dafc admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:10.515215 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f00b6d-a246-4f01-9e20-35f72315dafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:10.519012 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f00b6d-a246-4f01-9e20-35f72315dafc admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:10.536746 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11b4c6-4b68-43b9-ba3f-0332443a12cf admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:10.553744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 910/1833] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:11:10.556938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f00b6d-a246-4f01-9e20-35f72315dafc admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:10.564912 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f79b9-d9cb-46f9-a9ce-6ce194374b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:10.567240 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f79b9-d9cb-46f9-a9ce-6ce194374b29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:10.568437 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f79b9-d9cb-46f9-a9ce-6ce194374b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:10.570509 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f79b9-d9cb-46f9-a9ce-6ce194374b29 admin admin] PATH_INFO: `/v3/projects/032f9ab61a58488eac8203422806779d/users/dc879f6be4dc4ba5a210c140d8512e02/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:10.583708 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f00b6d-a246-4f01-9e20-35f72315dafc admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:10.613991 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0895d1-516d-4f5d-8c6a-fff3f2c8313d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:10.616051 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0895d1-516d-4f5d-8c6a-fff3f2c8313d admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:10.617206 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0895d1-516d-4f5d-8c6a-fff3f2c8313d admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:10.621378 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0895d1-516d-4f5d-8c6a-fff3f2c8313d admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:10.621378 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0895d1-516d-4f5d-8c6a-fff3f2c8313d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:10.631302 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0895d1-516d-4f5d-8c6a-fff3f2c8313d admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:10.657700 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f79b9-d9cb-46f9-a9ce-6ce194374b29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=032f9ab61a58488eac8203422806779d, user_id=dc879f6be4dc4ba5a210c140d8512e02, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:10.669710 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f79b9-d9cb-46f9-a9ce-6ce194374b29 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:10.674167 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 911/1834] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:10 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:10.678365 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0895d1-516d-4f5d-8c6a-fff3f2c8313d admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:10.724005 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0895d1-516d-4f5d-8c6a-fff3f2c8313d admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:10.740161 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e9124-4d8a-44fc-a3e4-7498ffd52192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:10.740994 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e9124-4d8a-44fc-a3e4-7498ffd52192 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:10.741391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e9124-4d8a-44fc-a3e4-7498ffd52192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:10.741797 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e9124-4d8a-44fc-a3e4-7498ffd52192 admin admin] PATH_INFO: `/v3/projects/0414600fabd941d6b7cea4e4936f2a42/users/8dcbac9b05704707818ac96802f8f4b1/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:10.767361 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 924/1835] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:11:10 2022] PUT /identity/v3/projects/032f9ab61a58488eac8203422806779d/users/dc879f6be4dc4ba5a210c140d8512e02/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:10.776805 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd51c4c-a51c-4bf3-9526-2f4ea3db89ca None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:10.777459 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd51c4c-a51c-4bf3-9526-2f4ea3db89ca None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:10.778092 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd51c4c-a51c-4bf3-9526-2f4ea3db89ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:10.808577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e9124-4d8a-44fc-a3e4-7498ffd52192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0414600fabd941d6b7cea4e4936f2a42, user_id=8dcbac9b05704707818ac96802f8f4b1, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:10.813611 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e9124-4d8a-44fc-a3e4-7498ffd52192 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:10.841774 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-1dd51c4c-a51c-4bf3-9526-2f4ea3db89ca None None] MFA Rules not processed for user `dc879f6be4dc4ba5a210c140d8512e02`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:10.845918 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-1dd51c4c-a51c-4bf3-9526-2f4ea3db89ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:10.965905 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 912/1836] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:11:10 2022] PUT /identity/v3/projects/0414600fabd941d6b7cea4e4936f2a42/users/8dcbac9b05704707818ac96802f8f4b1/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:10.980552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2e616-27f6-4684-b68b-37acbd6e9074 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:10.981526 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2e616-27f6-4684-b68b-37acbd6e9074 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:10.982286 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a2e616-27f6-4684-b68b-37acbd6e9074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:11.064022 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-33a2e616-27f6-4684-b68b-37acbd6e9074 None None] MFA Rules not processed for user `8dcbac9b05704707818ac96802f8f4b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:11.065767 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-33a2e616-27f6-4684-b68b-37acbd6e9074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:11.119566 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 925/1837] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:11.124137 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd51c4c-a51c-4bf3-9526-2f4ea3db89ca None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:11.259888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 913/1838] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:11:11.261066 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2e616-27f6-4684-b68b-37acbd6e9074 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:11.353279 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd51c4c-a51c-4bf3-9526-2f4ea3db89ca None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:11.423441 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a2e616-27f6-4684-b68b-37acbd6e9074 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:11.437362 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174953f-5a2d-4cd4-93ea-920823281a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:11.438007 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174953f-5a2d-4cd4-93ea-920823281a47 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:11.438336 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174953f-5a2d-4cd4-93ea-920823281a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:11.438562 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174953f-5a2d-4cd4-93ea-920823281a47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:11.439240 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2174953f-5a2d-4cd4-93ea-920823281a47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:11.450917 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2174953f-5a2d-4cd4-93ea-920823281a47 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:11.562301 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfadc5b-daa6-40e5-a30c-a8d71b1b7f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:11.563249 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfadc5b-daa6-40e5-a30c-a8d71b1b7f67 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:11.563817 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfadc5b-daa6-40e5-a30c-a8d71b1b7f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:11.564295 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfadc5b-daa6-40e5-a30c-a8d71b1b7f67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:11.565602 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfadc5b-daa6-40e5-a30c-a8d71b1b7f67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:11.569361 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfadc5b-daa6-40e5-a30c-a8d71b1b7f67 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:11.645243 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 914/1839] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:11:11 2022] POST /identity/v3/projects => generated 375 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:11.651638 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174953f-5a2d-4cd4-93ea-920823281a47 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:11.745467 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 926/1840] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:11:11 2022] POST /identity/v3/projects => generated 377 bytes in 622 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:11:11.751156 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfadc5b-daa6-40e5-a30c-a8d71b1b7f67 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:11.783159 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174953f-5a2d-4cd4-93ea-920823281a47 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:11.843341 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfadc5b-daa6-40e5-a30c-a8d71b1b7f67 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:11.848056 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:11.861506 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621dc42-a2fd-4ea7-b388-4642e6d8e043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:11.864777 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621dc42-a2fd-4ea7-b388-4642e6d8e043 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:11.865063 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621dc42-a2fd-4ea7-b388-4642e6d8e043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:11.865376 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621dc42-a2fd-4ea7-b388-4642e6d8e043 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:11.865994 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621dc42-a2fd-4ea7-b388-4642e6d8e043 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:11.870376 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621dc42-a2fd-4ea7-b388-4642e6d8e043 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:11.903992 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83479a08-cef8-458e-8a88-a2c1ec49972d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:11.904638 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83479a08-cef8-458e-8a88-a2c1ec49972d admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:11.904932 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83479a08-cef8-458e-8a88-a2c1ec49972d admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:11.905208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83479a08-cef8-458e-8a88-a2c1ec49972d admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:11.905967 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83479a08-cef8-458e-8a88-a2c1ec49972d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:11.908496 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83479a08-cef8-458e-8a88-a2c1ec49972d admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:12.028914 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 927/1841] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:11:11 2022] POST /identity/v3/users => generated 289 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:11:12.030674 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621dc42-a2fd-4ea7-b388-4642e6d8e043 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:12.041262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 915/1842] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:11:11 2022] POST /identity/v3/users => generated 294 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:12.044718 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83479a08-cef8-458e-8a88-a2c1ec49972d admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:12.051721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621dc42-a2fd-4ea7-b388-4642e6d8e043 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:12.061478 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc15ee4-b521-42c9-8ac9-6267d92d5bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:12.062109 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc15ee4-b521-42c9-8ac9-6267d92d5bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:12.062387 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc15ee4-b521-42c9-8ac9-6267d92d5bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:12.062657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc15ee4-b521-42c9-8ac9-6267d92d5bb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:12.063362 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc15ee4-b521-42c9-8ac9-6267d92d5bb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:12.070544 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc15ee4-b521-42c9-8ac9-6267d92d5bb7 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:12.073187 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83479a08-cef8-458e-8a88-a2c1ec49972d admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:12.084726 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 928/1843] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:12.085030 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5505e-36e7-4ee7-af0b-12a9f73e46c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:12.085030 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5505e-36e7-4ee7-af0b-12a9f73e46c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:12.086556 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5505e-36e7-4ee7-af0b-12a9f73e46c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:12.087727 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc15ee4-b521-42c9-8ac9-6267d92d5bb7 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:12.088162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d5505e-36e7-4ee7-af0b-12a9f73e46c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:12.089909 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5505e-36e7-4ee7-af0b-12a9f73e46c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:12.094654 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d5505e-36e7-4ee7-af0b-12a9f73e46c1 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:12.116792 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc15ee4-b521-42c9-8ac9-6267d92d5bb7 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:12.122922 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 916/1844] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:12.129255 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5505e-36e7-4ee7-af0b-12a9f73e46c1 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:12.138711 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c63487-3b4e-48b0-a543-fa41490164e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:12.139379 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c63487-3b4e-48b0-a543-fa41490164e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:12.139654 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c63487-3b4e-48b0-a543-fa41490164e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:12.139935 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c63487-3b4e-48b0-a543-fa41490164e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:12.140578 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c63487-3b4e-48b0-a543-fa41490164e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:12.142205 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c63487-3b4e-48b0-a543-fa41490164e0 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:12.158958 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d5505e-36e7-4ee7-af0b-12a9f73e46c1 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:12.166362 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 929/1845] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:11:12.171691 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c63487-3b4e-48b0-a543-fa41490164e0 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:12.178946 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7d737-9bd2-45d2-94e9-7d1d2448abcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:12.179234 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7d737-9bd2-45d2-94e9-7d1d2448abcd admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:12.179360 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7d737-9bd2-45d2-94e9-7d1d2448abcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:12.179641 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea7d737-9bd2-45d2-94e9-7d1d2448abcd admin admin] PATH_INFO: `/v3/projects/f0f56b6e187d47f08e0d7588e8a85b54/users/17fee69d0cb64518b363860f23172d99/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:12.187390 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c63487-3b4e-48b0-a543-fa41490164e0 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:12.194166 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ef500-50a0-4778-9d7d-cebff5b3f321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:12.194951 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ef500-50a0-4778-9d7d-cebff5b3f321 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:12.195270 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ef500-50a0-4778-9d7d-cebff5b3f321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:12.195547 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ef500-50a0-4778-9d7d-cebff5b3f321 admin admin] PATH_INFO: `/v3/projects/f1359a1e8ce54d2186aeeca6c5f05182/users/2a028157ec004952a616f76b218bc8b0/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:12.223240 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7d737-9bd2-45d2-94e9-7d1d2448abcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f56b6e187d47f08e0d7588e8a85b54, user_id=17fee69d0cb64518b363860f23172d99, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:12.224464 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ef500-50a0-4778-9d7d-cebff5b3f321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1359a1e8ce54d2186aeeca6c5f05182, user_id=2a028157ec004952a616f76b218bc8b0, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:12.229291 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea7d737-9bd2-45d2-94e9-7d1d2448abcd admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:12.232201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ef500-50a0-4778-9d7d-cebff5b3f321 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:12.395600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 917/1846] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:11:12 2022] PUT /identity/v3/projects/f0f56b6e187d47f08e0d7588e8a85b54/users/17fee69d0cb64518b363860f23172d99/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:12.399730 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7d737-9bd2-45d2-94e9-7d1d2448abcd admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:12.413218 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 930/1847] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:11:12 2022] PUT /identity/v3/projects/f1359a1e8ce54d2186aeeca6c5f05182/users/2a028157ec004952a616f76b218bc8b0/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:11:12.427315 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d08bb6-ece6-4242-a26c-8800e3120684 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:12.427603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d08bb6-ece6-4242-a26c-8800e3120684 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:12.428060 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d08bb6-ece6-4242-a26c-8800e3120684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:12.486228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-09d08bb6-ece6-4242-a26c-8800e3120684 None None] MFA Rules not processed for user `2a028157ec004952a616f76b218bc8b0`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:12.487634 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-09d08bb6-ece6-4242-a26c-8800e3120684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:12.512703 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea7d737-9bd2-45d2-94e9-7d1d2448abcd admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:12.522169 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09832d22-04ec-451c-9818-82f27d938e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:12.524498 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09832d22-04ec-451c-9818-82f27d938e1c admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:12.532978 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09832d22-04ec-451c-9818-82f27d938e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:12.533404 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09832d22-04ec-451c-9818-82f27d938e1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:12.535785 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09832d22-04ec-451c-9818-82f27d938e1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:12.541377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09832d22-04ec-451c-9818-82f27d938e1c admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:12.560094 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 918/1848] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:12.561199 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09832d22-04ec-451c-9818-82f27d938e1c admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:12.573149 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09832d22-04ec-451c-9818-82f27d938e1c admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:12.580630 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 931/1849] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:12.582956 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae0c6a-6abb-4543-b7f0-3f4f99f1ea18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:12.583955 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae0c6a-6abb-4543-b7f0-3f4f99f1ea18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:12.584186 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae0c6a-6abb-4543-b7f0-3f4f99f1ea18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:12.584459 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae0c6a-6abb-4543-b7f0-3f4f99f1ea18 admin admin] PATH_INFO: `/v3/projects/f0f56b6e187d47f08e0d7588e8a85b54/users/17fee69d0cb64518b363860f23172d99/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:12.584947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d08bb6-ece6-4242-a26c-8800e3120684 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:12.586805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae0c6a-6abb-4543-b7f0-3f4f99f1ea18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f56b6e187d47f08e0d7588e8a85b54, user_id=17fee69d0cb64518b363860f23172d99, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:12.589857 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae0c6a-6abb-4543-b7f0-3f4f99f1ea18 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:12.597912 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d08bb6-ece6-4242-a26c-8800e3120684 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:12.606657 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 919/1850] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:11:12 2022] PUT /identity/v3/projects/f0f56b6e187d47f08e0d7588e8a85b54/users/17fee69d0cb64518b363860f23172d99/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:12.618996 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93e88c-738d-4a24-b67d-794e22a9c3c3 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:12.619522 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93e88c-738d-4a24-b67d-794e22a9c3c3 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:12.619830 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e93e88c-738d-4a24-b67d-794e22a9c3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:12.687978 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-4e93e88c-738d-4a24-b67d-794e22a9c3c3 None None] MFA Rules not processed for user `17fee69d0cb64518b363860f23172d99`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:12.689616 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-4e93e88c-738d-4a24-b67d-794e22a9c3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:12.694325 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799f04b-c195-43d5-9b5c-8e44b2d73e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:12.695678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799f04b-c195-43d5-9b5c-8e44b2d73e32 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:12.696394 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799f04b-c195-43d5-9b5c-8e44b2d73e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:12.697078 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799f04b-c195-43d5-9b5c-8e44b2d73e32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:12.698156 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799f04b-c195-43d5-9b5c-8e44b2d73e32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:12.701656 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799f04b-c195-43d5-9b5c-8e44b2d73e32 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:12.789379 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 920/1851] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:12.798727 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93e88c-738d-4a24-b67d-794e22a9c3c3 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:12.801801 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-4e93e88c-738d-4a24-b67d-794e22a9c3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:12.836977 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 932/1852] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:11:12 2022] POST /identity/v3/projects => generated 379 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:11:12.839168 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799f04b-c195-43d5-9b5c-8e44b2d73e32 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:12.898797 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e93e88c-738d-4a24-b67d-794e22a9c3c3 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:12.983527 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799f04b-c195-43d5-9b5c-8e44b2d73e32 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:12.983527 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa66b45-5420-4b88-aac7-54efffc89e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:12.983527 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa66b45-5420-4b88-aac7-54efffc89e54 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:12.983527 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa66b45-5420-4b88-aac7-54efffc89e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:12.984224 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa66b45-5420-4b88-aac7-54efffc89e54 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:12.984224 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa66b45-5420-4b88-aac7-54efffc89e54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:12.985144 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa66b45-5420-4b88-aac7-54efffc89e54 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:12.987590 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d31e2-0830-4785-814d-e5bb97349fe6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:12.987590 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d31e2-0830-4785-814d-e5bb97349fe6 service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:12.987590 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d31e2-0830-4785-814d-e5bb97349fe6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:12.987590 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1d31e2-0830-4785-814d-e5bb97349fe6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:13.074241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d31e2-0830-4785-814d-e5bb97349fe6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:13.076419 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1d31e2-0830-4785-814d-e5bb97349fe6 service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:13.086982 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 921/1853] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:11:13.104210 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:13.111299 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 933/1854] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:11:12 2022] POST /identity/v3/users => generated 296 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:13.116001 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d31e2-0830-4785-814d-e5bb97349fe6 service cinder] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:13.128657 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1d31e2-0830-4785-814d-e5bb97349fe6 service cinder] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:13.135013 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4eb0ff-3029-4de1-92e3-7b92011e1080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:13.135842 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4eb0ff-3029-4de1-92e3-7b92011e1080 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:13.136128 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4eb0ff-3029-4de1-92e3-7b92011e1080 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:13.136828 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4eb0ff-3029-4de1-92e3-7b92011e1080 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:13.137712 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4eb0ff-3029-4de1-92e3-7b92011e1080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:13.139634 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4eb0ff-3029-4de1-92e3-7b92011e1080 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:13.156921 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 922/1855] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:11:13.158859 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa66b45-5420-4b88-aac7-54efffc89e54 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:13.172441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa66b45-5420-4b88-aac7-54efffc89e54 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:13.178141 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48338a4a-2d19-4b3f-86b7-a00d06b6ff84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:13.178827 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48338a4a-2d19-4b3f-86b7-a00d06b6ff84 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:13.179134 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48338a4a-2d19-4b3f-86b7-a00d06b6ff84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:13.181917 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48338a4a-2d19-4b3f-86b7-a00d06b6ff84 admin admin] PATH_INFO: `/v3/projects/1e70a25e10d9407d9aeebff673da53cb/users/a12809bb73e64a54ba8920a5ad3fbb07/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:13.197507 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48338a4a-2d19-4b3f-86b7-a00d06b6ff84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e70a25e10d9407d9aeebff673da53cb, user_id=a12809bb73e64a54ba8920a5ad3fbb07, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:13.200952 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48338a4a-2d19-4b3f-86b7-a00d06b6ff84 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:13.287039 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 934/1856] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:11:13 2022] PUT /identity/v3/projects/1e70a25e10d9407d9aeebff673da53cb/users/a12809bb73e64a54ba8920a5ad3fbb07/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:11:13.292029 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4eb0ff-3029-4de1-92e3-7b92011e1080 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:13.306582 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4eb0ff-3029-4de1-92e3-7b92011e1080 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:13.424888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9c2e2-8cd0-4427-bd06-5871b7327ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:13.425582 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9c2e2-8cd0-4427-bd06-5871b7327ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:13.425908 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9c2e2-8cd0-4427-bd06-5871b7327ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:13.426189 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9c2e2-8cd0-4427-bd06-5871b7327ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:13.428269 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9c2e2-8cd0-4427-bd06-5871b7327ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:13.428876 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba9c2e2-8cd0-4427-bd06-5871b7327ea8 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:13.441684 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 923/1857] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:11:13.446736 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48338a4a-2d19-4b3f-86b7-a00d06b6ff84 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:13.463795 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48338a4a-2d19-4b3f-86b7-a00d06b6ff84 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:13.471549 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc2d96-78db-4d5e-99fe-d975939fd61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:13.472333 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc2d96-78db-4d5e-99fe-d975939fd61c admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:13.472807 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc2d96-78db-4d5e-99fe-d975939fd61c admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:13.473574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdc2d96-78db-4d5e-99fe-d975939fd61c admin admin] PATH_INFO: `/v3/projects/1e70a25e10d9407d9aeebff673da53cb/users/a12809bb73e64a54ba8920a5ad3fbb07/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:13.476010 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc2d96-78db-4d5e-99fe-d975939fd61c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e70a25e10d9407d9aeebff673da53cb, user_id=a12809bb73e64a54ba8920a5ad3fbb07, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:13.479443 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdc2d96-78db-4d5e-99fe-d975939fd61c admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:13.503386 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 935/1858] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:11:13 2022] PUT /identity/v3/projects/1e70a25e10d9407d9aeebff673da53cb/users/a12809bb73e64a54ba8920a5ad3fbb07/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:13.504835 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a52c41-f16b-4509-9337-9917d760a9cc None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:13.505211 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a52c41-f16b-4509-9337-9917d760a9cc None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:13.514941 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a52c41-f16b-4509-9337-9917d760a9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:13.539338 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-82a52c41-f16b-4509-9337-9917d760a9cc None None] MFA Rules not processed for user `a12809bb73e64a54ba8920a5ad3fbb07`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:13.540613 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-82a52c41-f16b-4509-9337-9917d760a9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:13.621166 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 924/1859] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:13 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:13.677616 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc2d96-78db-4d5e-99fe-d975939fd61c admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:13.680534 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-3fdc2d96-78db-4d5e-99fe-d975939fd61c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:13.752615 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdc2d96-78db-4d5e-99fe-d975939fd61c admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:13.756792 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ac6fb-dea9-4b62-9a02-1e3ac78f1f65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:13.757453 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ac6fb-dea9-4b62-9a02-1e3ac78f1f65 service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:13.757982 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ac6fb-dea9-4b62-9a02-1e3ac78f1f65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:13.758318 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ac6fb-dea9-4b62-9a02-1e3ac78f1f65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:13.770056 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ac6fb-dea9-4b62-9a02-1e3ac78f1f65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:13.771639 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4ac6fb-dea9-4b62-9a02-1e3ac78f1f65 service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:13.783437 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 936/1860] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:13 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:11:13.796012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:13.954343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a52c41-f16b-4509-9337-9917d760a9cc None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:13.964347 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a52c41-f16b-4509-9337-9917d760a9cc None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:13.969125 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f270b5a6-4ade-4c1b-aa63-c085a6e725e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:13.970259 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270b5a6-4ade-4c1b-aa63-c085a6e725e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:13.970259 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270b5a6-4ade-4c1b-aa63-c085a6e725e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:13.970434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f270b5a6-4ade-4c1b-aa63-c085a6e725e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:14.047636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270b5a6-4ade-4c1b-aa63-c085a6e725e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:14.053652 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f270b5a6-4ade-4c1b-aa63-c085a6e725e8 service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:14.080670 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 925/1861] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:13 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:11:14.892479 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:15.788224 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:17.013839 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ac6fb-dea9-4b62-9a02-1e3ac78f1f65 service cinder] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:17.161648 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ac6fb-dea9-4b62-9a02-1e3ac78f1f65 service cinder] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:17.166091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29117908-c303-48ca-a796-bef41be39afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:17.167218 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29117908-c303-48ca-a796-bef41be39afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:17.167701 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29117908-c303-48ca-a796-bef41be39afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:17.168731 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29117908-c303-48ca-a796-bef41be39afd admin admin] PATH_INFO: `/v3/users/8dcbac9b05704707818ac96802f8f4b1` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:17.171308 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29117908-c303-48ca-a796-bef41be39afd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dcbac9b05704707818ac96802f8f4b1)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:17.174156 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29117908-c303-48ca-a796-bef41be39afd admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:17.184297 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:17.425745 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-29117908-c303-48ca-a796-bef41be39afd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dcbac9b05704707818ac96802f8f4b1'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:17.437804 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-29117908-c303-48ca-a796-bef41be39afd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dcbac9b05704707818ac96802f8f4b1'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:17.521655 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-29117908-c303-48ca-a796-bef41be39afd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dcbac9b05704707818ac96802f8f4b1'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:17.522631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-29117908-c303-48ca-a796-bef41be39afd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dcbac9b05704707818ac96802f8f4b1'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:17.523949 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-29117908-c303-48ca-a796-bef41be39afd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dcbac9b05704707818ac96802f8f4b1'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:17.561768 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 937/1862] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:11:17 2022] DELETE /identity/v3/users/8dcbac9b05704707818ac96802f8f4b1 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:17.568696 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c513b3-0d28-43f7-b03c-4f6307d5a692 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:17.569579 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c513b3-0d28-43f7-b03c-4f6307d5a692 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:17.569955 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c513b3-0d28-43f7-b03c-4f6307d5a692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:17.592791 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-c9c513b3-0d28-43f7-b03c-4f6307d5a692 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:17.595197 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-c9c513b3-0d28-43f7-b03c-4f6307d5a692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:17.661995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 926/1863] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:17.672022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29117908-c303-48ca-a796-bef41be39afd admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:17.673553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-29117908-c303-48ca-a796-bef41be39afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:17.736609 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29117908-c303-48ca-a796-bef41be39afd admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:17.740353 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1143c4-2bea-46ca-b61e-1f71371e249b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:17.741261 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1143c4-2bea-46ca-b61e-1f71371e249b service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:17.741261 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1143c4-2bea-46ca-b61e-1f71371e249b service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:17.741547 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1143c4-2bea-46ca-b61e-1f71371e249b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:17.752176 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1143c4-2bea-46ca-b61e-1f71371e249b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:17.753642 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1143c4-2bea-46ca-b61e-1f71371e249b service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:17.767457 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 938/1864] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:11:18.273539 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c513b3-0d28-43f7-b03c-4f6307d5a692 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:18.279598 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-c9c513b3-0d28-43f7-b03c-4f6307d5a692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:18.299996 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c513b3-0d28-43f7-b03c-4f6307d5a692 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:18.325161 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc880d-d84f-41ae-85ca-322233e36c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:18.326181 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc880d-d84f-41ae-85ca-322233e36c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:18.326485 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc880d-d84f-41ae-85ca-322233e36c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:18.326745 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc880d-d84f-41ae-85ca-322233e36c5f admin admin] PATH_INFO: `/v3/projects/0414600fabd941d6b7cea4e4936f2a42` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:18.328128 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc880d-d84f-41ae-85ca-322233e36c5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0414600fabd941d6b7cea4e4936f2a42)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:18.330159 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc880d-d84f-41ae-85ca-322233e36c5f admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:18.523933 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-1bbc880d-d84f-41ae-85ca-322233e36c5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0414600fabd941d6b7cea4e4936f2a42', 'request_id': 'req-1bbc880d-d84f-41ae-85ca-322233e36c5f'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:18.531290 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-1bbc880d-d84f-41ae-85ca-322233e36c5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0414600fabd941d6b7cea4e4936f2a42', 'request_id': 'req-1bbc880d-d84f-41ae-85ca-322233e36c5f'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:18.537750 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-1bbc880d-d84f-41ae-85ca-322233e36c5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0414600fabd941d6b7cea4e4936f2a42', 'request_id': 'req-1bbc880d-d84f-41ae-85ca-322233e36c5f'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:18.668749 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-1bbc880d-d84f-41ae-85ca-322233e36c5f admin admin] The token cache is being invalidate because project 0414600fabd941d6b7cea4e4936f2a42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:11:18.669933 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-1bbc880d-d84f-41ae-85ca-322233e36c5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:18.670669 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-1bbc880d-d84f-41ae-85ca-322233e36c5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:18.675395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 927/1865] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:11:18 2022] DELETE /identity/v3/projects/0414600fabd941d6b7cea4e4936f2a42 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:18.676721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1143c4-2bea-46ca-b61e-1f71371e249b service neutron] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:18.697875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1143c4-2bea-46ca-b61e-1f71371e249b service neutron] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:18.709327 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:18.775603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be6a87e-35f6-4ab1-a54a-cac17c214177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:18.776250 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6a87e-35f6-4ab1-a54a-cac17c214177 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:18.776531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6a87e-35f6-4ab1-a54a-cac17c214177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:18.776807 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be6a87e-35f6-4ab1-a54a-cac17c214177 admin admin] PATH_INFO: `/v3/users/17fee69d0cb64518b363860f23172d99` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:18.778144 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6a87e-35f6-4ab1-a54a-cac17c214177 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17fee69d0cb64518b363860f23172d99)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:18.780180 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be6a87e-35f6-4ab1-a54a-cac17c214177 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:18.861524 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789a209-97fe-48c7-bb28-aaec5cd532e2 None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:18.861893 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789a209-97fe-48c7-bb28-aaec5cd532e2 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:18.862124 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789a209-97fe-48c7-bb28-aaec5cd532e2 None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:18.863542 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 928/1866] 10.222.0.55 () {54 vars in 921 bytes} [Wed Aug 24 17:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:11:18.875018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf68710-3cbe-428e-b1ce-32a541b67cd3 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:18.875018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf68710-3cbe-428e-b1ce-32a541b67cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:18.875272 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf68710-3cbe-428e-b1ce-32a541b67cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:18.897809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-bcf68710-3cbe-428e-b1ce-32a541b67cd3 None None] MFA Rules not processed for user `28a1c617fc264b118e61f2a97ecb3f39`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:18.899002 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-bcf68710-3cbe-428e-b1ce-32a541b67cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:18.976982 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 929/1867] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Aug 24 17:11:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:18.990234 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf68710-3cbe-428e-b1ce-32a541b67cd3 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:18.991900 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-bcf68710-3cbe-428e-b1ce-32a541b67cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:19.005815 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf68710-3cbe-428e-b1ce-32a541b67cd3 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:19.011925 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bcb1f2-8644-4863-958b-feff2904a13a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:19.012656 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcb1f2-8644-4863-958b-feff2904a13a service nova] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:19.012934 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcb1f2-8644-4863-958b-feff2904a13a service nova] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:19.013205 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bcb1f2-8644-4863-958b-feff2904a13a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:19.024412 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bcb1f2-8644-4863-958b-feff2904a13a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:19.026212 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bcb1f2-8644-4863-958b-feff2904a13a service nova] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:19.037818 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 930/1868] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:11:19.142213 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0be6a87e-35f6-4ab1-a54a-cac17c214177 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17fee69d0cb64518b363860f23172d99'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:19.149688 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0be6a87e-35f6-4ab1-a54a-cac17c214177 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17fee69d0cb64518b363860f23172d99'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:19.275926 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0be6a87e-35f6-4ab1-a54a-cac17c214177 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17fee69d0cb64518b363860f23172d99'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:19.276501 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0be6a87e-35f6-4ab1-a54a-cac17c214177 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17fee69d0cb64518b363860f23172d99'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:19.277186 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0be6a87e-35f6-4ab1-a54a-cac17c214177 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17fee69d0cb64518b363860f23172d99'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:19.309450 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 939/1869] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:11:18 2022] DELETE /identity/v3/users/17fee69d0cb64518b363860f23172d99 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:19.357263 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bcb1f2-8644-4863-958b-feff2904a13a service nova] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:19.357263 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-e8bcb1f2-8644-4863-958b-feff2904a13a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:19.370802 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bcb1f2-8644-4863-958b-feff2904a13a service nova] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:19.467377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c32c7f-515d-4646-9c57-f56e49acd140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:19.468191 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c32c7f-515d-4646-9c57-f56e49acd140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:19.468472 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c32c7f-515d-4646-9c57-f56e49acd140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:19.469312 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c32c7f-515d-4646-9c57-f56e49acd140 admin admin] PATH_INFO: `/v3/users/dc879f6be4dc4ba5a210c140d8512e02` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:19.471303 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c32c7f-515d-4646-9c57-f56e49acd140 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc879f6be4dc4ba5a210c140d8512e02)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:19.473584 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c32c7f-515d-4646-9c57-f56e49acd140 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:19.707966 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-e8c32c7f-515d-4646-9c57-f56e49acd140 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc879f6be4dc4ba5a210c140d8512e02'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:19.709846 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-e8c32c7f-515d-4646-9c57-f56e49acd140 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc879f6be4dc4ba5a210c140d8512e02'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:19.721594 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-e8c32c7f-515d-4646-9c57-f56e49acd140 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc879f6be4dc4ba5a210c140d8512e02'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:19.722591 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-e8c32c7f-515d-4646-9c57-f56e49acd140 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc879f6be4dc4ba5a210c140d8512e02'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:19.832774 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-e8c32c7f-515d-4646-9c57-f56e49acd140 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc879f6be4dc4ba5a210c140d8512e02'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:19.879917 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 931/1870] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:11:19 2022] DELETE /identity/v3/users/dc879f6be4dc4ba5a210c140d8512e02 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:19.885830 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93426d58-cfd4-40b9-a64f-fb2cb83f093f None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:19.885830 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93426d58-cfd4-40b9-a64f-fb2cb83f093f None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:19.886406 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93426d58-cfd4-40b9-a64f-fb2cb83f093f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:19.930990 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-93426d58-cfd4-40b9-a64f-fb2cb83f093f None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:19.930990 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-93426d58-cfd4-40b9-a64f-fb2cb83f093f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:20.001218 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 940/1871] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:20.011587 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c32c7f-515d-4646-9c57-f56e49acd140 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:20.013458 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-e8c32c7f-515d-4646-9c57-f56e49acd140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:20.075335 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c32c7f-515d-4646-9c57-f56e49acd140 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:20.078952 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ea43b-d425-497d-9f9f-de802ebb8c34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:20.079607 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ea43b-d425-497d-9f9f-de802ebb8c34 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:20.079886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ea43b-d425-497d-9f9f-de802ebb8c34 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:20.080154 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ea43b-d425-497d-9f9f-de802ebb8c34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:20.090445 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ea43b-d425-497d-9f9f-de802ebb8c34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:20.092133 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ea43b-d425-497d-9f9f-de802ebb8c34 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:20.103983 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 932/1872] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:11:20.454698 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93426d58-cfd4-40b9-a64f-fb2cb83f093f None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:20.455852 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-93426d58-cfd4-40b9-a64f-fb2cb83f093f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:20.469381 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93426d58-cfd4-40b9-a64f-fb2cb83f093f None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:20.478635 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde65cbb-680e-41c0-84c3-654ee4ba6240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:20.480442 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde65cbb-680e-41c0-84c3-654ee4ba6240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:20.480442 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde65cbb-680e-41c0-84c3-654ee4ba6240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:20.480442 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde65cbb-680e-41c0-84c3-654ee4ba6240 admin admin] PATH_INFO: `/v3/projects/f0f56b6e187d47f08e0d7588e8a85b54` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:20.482788 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde65cbb-680e-41c0-84c3-654ee4ba6240 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0f56b6e187d47f08e0d7588e8a85b54)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:20.484247 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde65cbb-680e-41c0-84c3-654ee4ba6240 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:20.537622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ea43b-d425-497d-9f9f-de802ebb8c34 service neutron] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:20.539303 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-b72ea43b-d425-497d-9f9f-de802ebb8c34 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:20.554876 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ea43b-d425-497d-9f9f-de802ebb8c34 service neutron] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:20.560203 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4db762-398b-4473-9136-64edab0bcfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:20.560673 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4db762-398b-4473-9136-64edab0bcfe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:20.561004 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4db762-398b-4473-9136-64edab0bcfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:20.561902 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4db762-398b-4473-9136-64edab0bcfe9 admin admin] PATH_INFO: `/v3/users/45bad4cc72134c47aa45e65810f7997a` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:20.563160 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4db762-398b-4473-9136-64edab0bcfe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45bad4cc72134c47aa45e65810f7997a)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:20.565155 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4db762-398b-4473-9136-64edab0bcfe9 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:20.674950 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-fde65cbb-680e-41c0-84c3-654ee4ba6240 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0f56b6e187d47f08e0d7588e8a85b54', 'request_id': 'req-fde65cbb-680e-41c0-84c3-654ee4ba6240'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:20.680236 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-fde65cbb-680e-41c0-84c3-654ee4ba6240 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0f56b6e187d47f08e0d7588e8a85b54', 'request_id': 'req-fde65cbb-680e-41c0-84c3-654ee4ba6240'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:20.726108 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:20.788866 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-fde65cbb-680e-41c0-84c3-654ee4ba6240 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0f56b6e187d47f08e0d7588e8a85b54', 'request_id': 'req-fde65cbb-680e-41c0-84c3-654ee4ba6240'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:20.803515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-fde65cbb-680e-41c0-84c3-654ee4ba6240 admin admin] The token cache is being invalidate because project f0f56b6e187d47f08e0d7588e8a85b54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:11:20.809780 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-fde65cbb-680e-41c0-84c3-654ee4ba6240 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:20.809780 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-fde65cbb-680e-41c0-84c3-654ee4ba6240 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:20.809780 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 941/1873] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:11:20 2022] DELETE /identity/v3/projects/f0f56b6e187d47f08e0d7588e8a85b54 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:20.809780 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde65cbb-680e-41c0-84c3-654ee4ba6240 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:20.811709 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-fde65cbb-680e-41c0-84c3-654ee4ba6240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:20.884209 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde65cbb-680e-41c0-84c3-654ee4ba6240 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:20.890611 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e79967-99f3-405f-9fbc-092191c5f4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:20.891306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e79967-99f3-405f-9fbc-092191c5f4cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:20.891578 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e79967-99f3-405f-9fbc-092191c5f4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:20.891884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e79967-99f3-405f-9fbc-092191c5f4cf admin admin] PATH_INFO: `/v3/projects/032f9ab61a58488eac8203422806779d` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:20.893173 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e79967-99f3-405f-9fbc-092191c5f4cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=032f9ab61a58488eac8203422806779d)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:20.895642 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e79967-99f3-405f-9fbc-092191c5f4cf admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:20.898166 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-fe4db762-398b-4473-9136-64edab0bcfe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45bad4cc72134c47aa45e65810f7997a'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:20.899459 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-fe4db762-398b-4473-9136-64edab0bcfe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45bad4cc72134c47aa45e65810f7997a'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:20.909644 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-fe4db762-398b-4473-9136-64edab0bcfe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45bad4cc72134c47aa45e65810f7997a'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:20.910640 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-fe4db762-398b-4473-9136-64edab0bcfe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45bad4cc72134c47aa45e65810f7997a'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:21.023668 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-fe4db762-398b-4473-9136-64edab0bcfe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45bad4cc72134c47aa45e65810f7997a'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:21.042701 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 933/1874] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:11:20 2022] DELETE /identity/v3/users/45bad4cc72134c47aa45e65810f7997a => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:11:21.047498 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30657886-615c-4865-bd3e-3b1fb04bd230 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:21.047965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30657886-615c-4865-bd3e-3b1fb04bd230 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:21.048241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30657886-615c-4865-bd3e-3b1fb04bd230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:21.083404 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-05e79967-99f3-405f-9fbc-092191c5f4cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '032f9ab61a58488eac8203422806779d', 'request_id': 'req-05e79967-99f3-405f-9fbc-092191c5f4cf'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:21.088151 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-30657886-615c-4865-bd3e-3b1fb04bd230 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:21.089458 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-30657886-615c-4865-bd3e-3b1fb04bd230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:21.090242 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-05e79967-99f3-405f-9fbc-092191c5f4cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '032f9ab61a58488eac8203422806779d', 'request_id': 'req-05e79967-99f3-405f-9fbc-092191c5f4cf'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:21.160483 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 934/1875] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:21.160483 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986122cc-cf71-41d1-80dd-d61ca7b14b70 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:21.160483 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986122cc-cf71-41d1-80dd-d61ca7b14b70 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:21.160483 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986122cc-cf71-41d1-80dd-d61ca7b14b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:21.161104 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-05e79967-99f3-405f-9fbc-092191c5f4cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '032f9ab61a58488eac8203422806779d', 'request_id': 'req-05e79967-99f3-405f-9fbc-092191c5f4cf'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:21.176008 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-05e79967-99f3-405f-9fbc-092191c5f4cf admin admin] The token cache is being invalidate because project 032f9ab61a58488eac8203422806779d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:11:21.176309 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-05e79967-99f3-405f-9fbc-092191c5f4cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:21.183079 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-05e79967-99f3-405f-9fbc-092191c5f4cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:21.185658 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 942/1876] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:11:20 2022] DELETE /identity/v3/projects/032f9ab61a58488eac8203422806779d => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:21.187263 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa3c5a-fd87-4b16-9784-6de63468156d None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:21.187716 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa3c5a-fd87-4b16-9784-6de63468156d None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:21.189035 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa3c5a-fd87-4b16-9784-6de63468156d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:21.189991 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-986122cc-cf71-41d1-80dd-d61ca7b14b70 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:21.191452 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-986122cc-cf71-41d1-80dd-d61ca7b14b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:21.215175 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 935/1877] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:21.216644 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986122cc-cf71-41d1-80dd-d61ca7b14b70 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:21.218358 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-986122cc-cf71-41d1-80dd-d61ca7b14b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:21.219674 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-4baa3c5a-fd87-4b16-9784-6de63468156d None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:21.221081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-4baa3c5a-fd87-4b16-9784-6de63468156d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:21.230226 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 943/1878] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:21.234680 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa3c5a-fd87-4b16-9784-6de63468156d None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:21.236281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-4baa3c5a-fd87-4b16-9784-6de63468156d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:21.240358 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986122cc-cf71-41d1-80dd-d61ca7b14b70 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:21.247474 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e606c-2a7e-4985-b427-f39eba8308e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:21.248132 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e606c-2a7e-4985-b427-f39eba8308e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:21.248416 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e606c-2a7e-4985-b427-f39eba8308e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:21.248691 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0e606c-2a7e-4985-b427-f39eba8308e7 admin admin] PATH_INFO: `/v3/users/2a028157ec004952a616f76b218bc8b0` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:21.250086 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e606c-2a7e-4985-b427-f39eba8308e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a028157ec004952a616f76b218bc8b0)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:21.252721 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0e606c-2a7e-4985-b427-f39eba8308e7 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:21.338347 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa3c5a-fd87-4b16-9784-6de63468156d None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:21.342686 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7bf4d-cdd6-4bc7-8bf3-d48301a76c65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:21.343325 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7bf4d-cdd6-4bc7-8bf3-d48301a76c65 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:21.343600 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7bf4d-cdd6-4bc7-8bf3-d48301a76c65 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:21.343894 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7bf4d-cdd6-4bc7-8bf3-d48301a76c65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:21.353989 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7bf4d-cdd6-4bc7-8bf3-d48301a76c65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:21.355668 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e7bf4d-cdd6-4bc7-8bf3-d48301a76c65 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:21.367057 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 944/1879] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:11:21.367877 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7bf4d-cdd6-4bc7-8bf3-d48301a76c65 service neutron] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:21.377549 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e7bf4d-cdd6-4bc7-8bf3-d48301a76c65 service neutron] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:21.384393 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c7428-ccb7-4af5-8d07-9a49fb234cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:21.384932 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c7428-ccb7-4af5-8d07-9a49fb234cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:21.385369 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c7428-ccb7-4af5-8d07-9a49fb234cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:21.385589 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3c7428-ccb7-4af5-8d07-9a49fb234cc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:21.386531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c7428-ccb7-4af5-8d07-9a49fb234cc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:11:21.386654 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c7428-ccb7-4af5-8d07-9a49fb234cc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:21.389025 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3c7428-ccb7-4af5-8d07-9a49fb234cc4 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:21.407040 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 945/1880] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:11:21.411620 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c7428-ccb7-4af5-8d07-9a49fb234cc4 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:21.437333 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3c7428-ccb7-4af5-8d07-9a49fb234cc4 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:21.451953 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa9017f-c6a3-47c7-986b-ee94c1a34d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:21.453170 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9017f-c6a3-47c7-986b-ee94c1a34d2d admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:21.453530 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9017f-c6a3-47c7-986b-ee94c1a34d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:21.456260 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa9017f-c6a3-47c7-986b-ee94c1a34d2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:21.457342 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa9017f-c6a3-47c7-986b-ee94c1a34d2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:21.459916 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa9017f-c6a3-47c7-986b-ee94c1a34d2d admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:21.515066 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-1e0e606c-2a7e-4985-b427-f39eba8308e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a028157ec004952a616f76b218bc8b0'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:21.520294 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-1e0e606c-2a7e-4985-b427-f39eba8308e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a028157ec004952a616f76b218bc8b0'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:21.544200 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-1e0e606c-2a7e-4985-b427-f39eba8308e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a028157ec004952a616f76b218bc8b0'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:21.545037 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-1e0e606c-2a7e-4985-b427-f39eba8308e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a028157ec004952a616f76b218bc8b0'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:21.576033 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 946/1881] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:11:21 2022] POST /identity/v3/projects => generated 373 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:21.580087 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa9017f-c6a3-47c7-986b-ee94c1a34d2d admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:21.588060 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-dfa9017f-c6a3-47c7-986b-ee94c1a34d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:21.640695 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-1e0e606c-2a7e-4985-b427-f39eba8308e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a028157ec004952a616f76b218bc8b0'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:21.683485 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 936/1882] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:11:21 2022] DELETE /identity/v3/users/2a028157ec004952a616f76b218bc8b0 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:21.735407 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa9017f-c6a3-47c7-986b-ee94c1a34d2d admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:21.817503 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2829824-8bbe-4639-ac03-f757be8fd86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:21.818194 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2829824-8bbe-4639-ac03-f757be8fd86e admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:21.818929 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2829824-8bbe-4639-ac03-f757be8fd86e admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:21.819243 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2829824-8bbe-4639-ac03-f757be8fd86e admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:21.820135 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2829824-8bbe-4639-ac03-f757be8fd86e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:21.822996 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2829824-8bbe-4639-ac03-f757be8fd86e admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:21.976954 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 947/1883] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:11:21 2022] POST /identity/v3/users => generated 287 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:11:21.981811 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e606c-2a7e-4985-b427-f39eba8308e7 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:21.992925 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0e606c-2a7e-4985-b427-f39eba8308e7 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:21.997911 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30615c-c4df-45a3-bbfd-7aac3bc39e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:21.998889 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30615c-c4df-45a3-bbfd-7aac3bc39e3d admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:21.999224 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30615c-c4df-45a3-bbfd-7aac3bc39e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:22.009119 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30615c-c4df-45a3-bbfd-7aac3bc39e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:22.009119 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30615c-c4df-45a3-bbfd-7aac3bc39e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:22.009119 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30615c-c4df-45a3-bbfd-7aac3bc39e3d admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:22.013125 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 937/1884] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:22.017852 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2829824-8bbe-4639-ac03-f757be8fd86e admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:22.030063 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2829824-8bbe-4639-ac03-f757be8fd86e admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:22.035386 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d91631-e004-404d-96a8-97cfd2b02012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:22.036177 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d91631-e004-404d-96a8-97cfd2b02012 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:22.036486 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d91631-e004-404d-96a8-97cfd2b02012 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:22.037046 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d91631-e004-404d-96a8-97cfd2b02012 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:22.037702 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d91631-e004-404d-96a8-97cfd2b02012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:22.039663 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d91631-e004-404d-96a8-97cfd2b02012 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:22.060312 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 948/1885] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:22.065695 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30615c-c4df-45a3-bbfd-7aac3bc39e3d admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:22.082766 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30615c-c4df-45a3-bbfd-7aac3bc39e3d admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:22.088571 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6745a82-568b-463e-b92f-61b439a8751b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:22.089471 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6745a82-568b-463e-b92f-61b439a8751b admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:22.090252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6745a82-568b-463e-b92f-61b439a8751b admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:22.090680 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6745a82-568b-463e-b92f-61b439a8751b admin admin] PATH_INFO: `/v3/projects/e1a1b8e8290c41debdf30235e9edf5d2/users/043bfb5019f74d8a993b81a3037932bc/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:22.107882 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6745a82-568b-463e-b92f-61b439a8751b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a1b8e8290c41debdf30235e9edf5d2, user_id=043bfb5019f74d8a993b81a3037932bc, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:22.111629 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6745a82-568b-463e-b92f-61b439a8751b admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:22.115733 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:22.204518 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d91631-e004-404d-96a8-97cfd2b02012 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:22.206622 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-53d91631-e004-404d-96a8-97cfd2b02012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:22.220871 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d91631-e004-404d-96a8-97cfd2b02012 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:22.226626 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05ae3a-0f5d-44d2-84ec-ad6d88f9d544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:22.227322 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05ae3a-0f5d-44d2-84ec-ad6d88f9d544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:22.232465 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05ae3a-0f5d-44d2-84ec-ad6d88f9d544 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:22.232465 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb05ae3a-0f5d-44d2-84ec-ad6d88f9d544 admin admin] PATH_INFO: `/v3/projects/f8a735f52d794010aadb63bdd1cda4bc` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:22.232465 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05ae3a-0f5d-44d2-84ec-ad6d88f9d544 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8a735f52d794010aadb63bdd1cda4bc)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:22.232465 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb05ae3a-0f5d-44d2-84ec-ad6d88f9d544 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:22.244460 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 938/1886] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:11:22 2022] PUT /identity/v3/projects/e1a1b8e8290c41debdf30235e9edf5d2/users/043bfb5019f74d8a993b81a3037932bc/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:22.256059 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113c02c-62a6-44d5-8ea5-8dcd2c1bffc0 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:22.256646 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113c02c-62a6-44d5-8ea5-8dcd2c1bffc0 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:22.261266 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3113c02c-62a6-44d5-8ea5-8dcd2c1bffc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:22.345378 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-3113c02c-62a6-44d5-8ea5-8dcd2c1bffc0 None None] MFA Rules not processed for user `043bfb5019f74d8a993b81a3037932bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:22.347684 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-3113c02c-62a6-44d5-8ea5-8dcd2c1bffc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:22.374902 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-fb05ae3a-0f5d-44d2-84ec-ad6d88f9d544 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8a735f52d794010aadb63bdd1cda4bc', 'request_id': 'req-fb05ae3a-0f5d-44d2-84ec-ad6d88f9d544'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:22.384833 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-fb05ae3a-0f5d-44d2-84ec-ad6d88f9d544 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8a735f52d794010aadb63bdd1cda4bc', 'request_id': 'req-fb05ae3a-0f5d-44d2-84ec-ad6d88f9d544'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:22.469330 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-fb05ae3a-0f5d-44d2-84ec-ad6d88f9d544 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8a735f52d794010aadb63bdd1cda4bc', 'request_id': 'req-fb05ae3a-0f5d-44d2-84ec-ad6d88f9d544'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:22.482275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 939/1887] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:11:22.483523 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113c02c-62a6-44d5-8ea5-8dcd2c1bffc0 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:22.484981 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-3113c02c-62a6-44d5-8ea5-8dcd2c1bffc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:22.485860 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-fb05ae3a-0f5d-44d2-84ec-ad6d88f9d544 admin admin] The token cache is being invalidate because project f8a735f52d794010aadb63bdd1cda4bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:11:22.486494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-fb05ae3a-0f5d-44d2-84ec-ad6d88f9d544 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:22.487567 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-fb05ae3a-0f5d-44d2-84ec-ad6d88f9d544 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:22.490067 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 949/1888] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:11:22 2022] DELETE /identity/v3/projects/f8a735f52d794010aadb63bdd1cda4bc => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:11:22.493869 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05ae3a-0f5d-44d2-84ec-ad6d88f9d544 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:22.497967 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-fb05ae3a-0f5d-44d2-84ec-ad6d88f9d544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:22.558625 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb05ae3a-0f5d-44d2-84ec-ad6d88f9d544 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:22.563193 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3d766-5a54-4b88-928e-5cb6a93410cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:22.563844 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3d766-5a54-4b88-928e-5cb6a93410cd service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:22.564313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3d766-5a54-4b88-928e-5cb6a93410cd service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:22.564763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3d766-5a54-4b88-928e-5cb6a93410cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:22.566694 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-0ae3d766-5a54-4b88-928e-5cb6a93410cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:22.570697 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3113c02c-62a6-44d5-8ea5-8dcd2c1bffc0 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:22.575757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f667b-ceee-4929-9f15-914e9589b079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:22.576475 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f667b-ceee-4929-9f15-914e9589b079 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:22.576783 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f667b-ceee-4929-9f15-914e9589b079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:22.577027 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27f667b-ceee-4929-9f15-914e9589b079 admin admin] PATH_INFO: `/v3/projects/f1359a1e8ce54d2186aeeca6c5f05182` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:22.578402 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f667b-ceee-4929-9f15-914e9589b079 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1359a1e8ce54d2186aeeca6c5f05182)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:22.578674 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3d766-5a54-4b88-928e-5cb6a93410cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:22.580183 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3d766-5a54-4b88-928e-5cb6a93410cd service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:22.580292 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27f667b-ceee-4929-9f15-914e9589b079 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:22.591068 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 950/1889] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:11:22.591928 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3d766-5a54-4b88-928e-5cb6a93410cd service cinder] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:22.593670 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-0ae3d766-5a54-4b88-928e-5cb6a93410cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:22.616249 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3d766-5a54-4b88-928e-5cb6a93410cd service cinder] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:22.621779 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2d4e4-5b2d-49e1-9e8c-6a1ec0f97956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:22.633603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2d4e4-5b2d-49e1-9e8c-6a1ec0f97956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:22.633603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2d4e4-5b2d-49e1-9e8c-6a1ec0f97956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:22.633603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc2d4e4-5b2d-49e1-9e8c-6a1ec0f97956 admin admin] PATH_INFO: `/v3/users/35889b17e94a4a849ba395c04b0425f5` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:22.633603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2d4e4-5b2d-49e1-9e8c-6a1ec0f97956 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35889b17e94a4a849ba395c04b0425f5)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:22.633603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc2d4e4-5b2d-49e1-9e8c-6a1ec0f97956 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:22.762966 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-a27f667b-ceee-4929-9f15-914e9589b079 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1359a1e8ce54d2186aeeca6c5f05182', 'request_id': 'req-a27f667b-ceee-4929-9f15-914e9589b079'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:22.771541 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-a27f667b-ceee-4929-9f15-914e9589b079 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1359a1e8ce54d2186aeeca6c5f05182', 'request_id': 'req-a27f667b-ceee-4929-9f15-914e9589b079'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:22.779907 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-a27f667b-ceee-4929-9f15-914e9589b079 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1359a1e8ce54d2186aeeca6c5f05182', 'request_id': 'req-a27f667b-ceee-4929-9f15-914e9589b079'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:22.883744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-a27f667b-ceee-4929-9f15-914e9589b079 admin admin] The token cache is being invalidate because project f1359a1e8ce54d2186aeeca6c5f05182 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:11:22.884379 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-a27f667b-ceee-4929-9f15-914e9589b079 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:22.885137 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-a27f667b-ceee-4929-9f15-914e9589b079 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:22.891155 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 940/1890] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:11:22 2022] DELETE /identity/v3/projects/f1359a1e8ce54d2186aeeca6c5f05182 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:22.892684 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f667b-ceee-4929-9f15-914e9589b079 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:22.894423 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-a27f667b-ceee-4929-9f15-914e9589b079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:22.894783 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-cdc2d4e4-5b2d-49e1-9e8c-6a1ec0f97956 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35889b17e94a4a849ba395c04b0425f5'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:22.903660 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-cdc2d4e4-5b2d-49e1-9e8c-6a1ec0f97956 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35889b17e94a4a849ba395c04b0425f5'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:22.978883 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27f667b-ceee-4929-9f15-914e9589b079 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:22.984166 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a758683-0af9-4e42-8853-11144d713871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:22.984909 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a758683-0af9-4e42-8853-11144d713871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:22.985155 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a758683-0af9-4e42-8853-11144d713871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:22.985405 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a758683-0af9-4e42-8853-11144d713871 admin admin] PATH_INFO: `/v3/users/a12809bb73e64a54ba8920a5ad3fbb07` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:22.986659 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a758683-0af9-4e42-8853-11144d713871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a12809bb73e64a54ba8920a5ad3fbb07)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:22.988831 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a758683-0af9-4e42-8853-11144d713871 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:23.023214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-cdc2d4e4-5b2d-49e1-9e8c-6a1ec0f97956 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35889b17e94a4a849ba395c04b0425f5'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:23.023844 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-cdc2d4e4-5b2d-49e1-9e8c-6a1ec0f97956 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35889b17e94a4a849ba395c04b0425f5'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:23.024458 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-cdc2d4e4-5b2d-49e1-9e8c-6a1ec0f97956 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35889b17e94a4a849ba395c04b0425f5'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:23.044176 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 951/1891] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:11:22 2022] DELETE /identity/v3/users/35889b17e94a4a849ba395c04b0425f5 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:23.140435 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-4a758683-0af9-4e42-8853-11144d713871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a12809bb73e64a54ba8920a5ad3fbb07'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:23.141113 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-4a758683-0af9-4e42-8853-11144d713871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a12809bb73e64a54ba8920a5ad3fbb07'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:23.149121 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-4a758683-0af9-4e42-8853-11144d713871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a12809bb73e64a54ba8920a5ad3fbb07'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:23.149923 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-4a758683-0af9-4e42-8853-11144d713871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a12809bb73e64a54ba8920a5ad3fbb07'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:23.233881 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:23.296939 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-4a758683-0af9-4e42-8853-11144d713871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a12809bb73e64a54ba8920a5ad3fbb07'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:23.323097 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 941/1892] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:11:22 2022] DELETE /identity/v3/users/a12809bb73e64a54ba8920a5ad3fbb07 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:11:23.659416 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2d4e4-5b2d-49e1-9e8c-6a1ec0f97956 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:23.661286 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-cdc2d4e4-5b2d-49e1-9e8c-6a1ec0f97956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:23.785935 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc2d4e4-5b2d-49e1-9e8c-6a1ec0f97956 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:23.850594 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52723da-ebc3-4f8c-8097-934d44f759c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:23.851341 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52723da-ebc3-4f8c-8097-934d44f759c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:23.851619 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52723da-ebc3-4f8c-8097-934d44f759c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:23.851891 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52723da-ebc3-4f8c-8097-934d44f759c1 admin admin] PATH_INFO: `/v3/projects/7ebc46f776e84d77b995651abd50a589` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:23.853132 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52723da-ebc3-4f8c-8097-934d44f759c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ebc46f776e84d77b995651abd50a589)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:23.855261 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52723da-ebc3-4f8c-8097-934d44f759c1 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:24.036446 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a758683-0af9-4e42-8853-11144d713871 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:24.038021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-4a758683-0af9-4e42-8853-11144d713871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:24.050165 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-e52723da-ebc3-4f8c-8097-934d44f759c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ebc46f776e84d77b995651abd50a589', 'request_id': 'req-e52723da-ebc3-4f8c-8097-934d44f759c1'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:24.055821 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a758683-0af9-4e42-8853-11144d713871 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:24.056400 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-e52723da-ebc3-4f8c-8097-934d44f759c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ebc46f776e84d77b995651abd50a589', 'request_id': 'req-e52723da-ebc3-4f8c-8097-934d44f759c1'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:24.153653 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c87512-7516-4793-893b-1f25b82be844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:24.154429 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c87512-7516-4793-893b-1f25b82be844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:24.154768 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c87512-7516-4793-893b-1f25b82be844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:24.154926 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-e52723da-ebc3-4f8c-8097-934d44f759c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ebc46f776e84d77b995651abd50a589', 'request_id': 'req-e52723da-ebc3-4f8c-8097-934d44f759c1'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:24.158115 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c87512-7516-4793-893b-1f25b82be844 admin admin] PATH_INFO: `/v3/projects/1e70a25e10d9407d9aeebff673da53cb` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:24.158115 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c87512-7516-4793-893b-1f25b82be844 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e70a25e10d9407d9aeebff673da53cb)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:24.159196 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c87512-7516-4793-893b-1f25b82be844 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:24.173031 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-e52723da-ebc3-4f8c-8097-934d44f759c1 admin admin] The token cache is being invalidate because project 7ebc46f776e84d77b995651abd50a589 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:11:24.173566 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-e52723da-ebc3-4f8c-8097-934d44f759c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:24.174471 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-e52723da-ebc3-4f8c-8097-934d44f759c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:24.176669 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 952/1893] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:11:23 2022] DELETE /identity/v3/projects/7ebc46f776e84d77b995651abd50a589 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:24.182005 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b08f99-45d5-4963-ab63-f0ad813f8490 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:24.185726 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b08f99-45d5-4963-ab63-f0ad813f8490 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:24.185726 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b08f99-45d5-4963-ab63-f0ad813f8490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:24.216846 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-94b08f99-45d5-4963-ab63-f0ad813f8490 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:24.218469 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-94b08f99-45d5-4963-ab63-f0ad813f8490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:24.228829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 953/1894] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:24.237202 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df26f5-e7e6-448b-a8f3-da698b47dbe5 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:24.237855 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df26f5-e7e6-448b-a8f3-da698b47dbe5 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:24.237855 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df26f5-e7e6-448b-a8f3-da698b47dbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:24.262261 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-07df26f5-e7e6-448b-a8f3-da698b47dbe5 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:24.263849 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-07df26f5-e7e6-448b-a8f3-da698b47dbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:24.274576 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 954/1895] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:11:24.283224 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df26f5-e7e6-448b-a8f3-da698b47dbe5 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:24.294046 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df26f5-e7e6-448b-a8f3-da698b47dbe5 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:24.299394 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d4bb7-f2db-4ffc-ac59-996844579478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:24.300016 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d4bb7-f2db-4ffc-ac59-996844579478 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:24.300301 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d4bb7-f2db-4ffc-ac59-996844579478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:24.300589 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d4bb7-f2db-4ffc-ac59-996844579478 admin admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:24.301323 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d4bb7-f2db-4ffc-ac59-996844579478 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:11:24.301607 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d4bb7-f2db-4ffc-ac59-996844579478 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:24.303352 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d4bb7-f2db-4ffc-ac59-996844579478 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:24.319793 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 955/1896] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:11:24.320705 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d4bb7-f2db-4ffc-ac59-996844579478 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:24.331868 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d4bb7-f2db-4ffc-ac59-996844579478 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:24.372865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-a7c87512-7516-4793-893b-1f25b82be844 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e70a25e10d9407d9aeebff673da53cb', 'request_id': 'req-a7c87512-7516-4793-893b-1f25b82be844'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:24.382631 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-a7c87512-7516-4793-893b-1f25b82be844 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e70a25e10d9407d9aeebff673da53cb', 'request_id': 'req-a7c87512-7516-4793-893b-1f25b82be844'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:24.392339 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-a7c87512-7516-4793-893b-1f25b82be844 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e70a25e10d9407d9aeebff673da53cb', 'request_id': 'req-a7c87512-7516-4793-893b-1f25b82be844'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:24.417152 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec41fc8-7f23-4588-bc4e-298dfb7ef659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:24.417772 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec41fc8-7f23-4588-bc4e-298dfb7ef659 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:24.418160 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec41fc8-7f23-4588-bc4e-298dfb7ef659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:24.418773 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec41fc8-7f23-4588-bc4e-298dfb7ef659 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:24.419433 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec41fc8-7f23-4588-bc4e-298dfb7ef659 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:24.437415 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec41fc8-7f23-4588-bc4e-298dfb7ef659 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:24.519776 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-a7c87512-7516-4793-893b-1f25b82be844 admin admin] The token cache is being invalidate because project 1e70a25e10d9407d9aeebff673da53cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:11:24.520072 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-a7c87512-7516-4793-893b-1f25b82be844 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:24.520734 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-a7c87512-7516-4793-893b-1f25b82be844 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:24.522560 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 942/1897] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:11:24 2022] DELETE /identity/v3/projects/1e70a25e10d9407d9aeebff673da53cb => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:11:24.534064 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a6971-d27d-456a-b862-98d8b3fba3f6 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:24.534353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a6971-d27d-456a-b862-98d8b3fba3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:24.534707 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a6971-d27d-456a-b862-98d8b3fba3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:24.551243 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:24.556467 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-9a5a6971-d27d-456a-b862-98d8b3fba3f6 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:24.558358 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-9a5a6971-d27d-456a-b862-98d8b3fba3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:24.558496 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 956/1898] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:11:24 2022] POST /identity/v3/projects => generated 365 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:24.562550 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec41fc8-7f23-4588-bc4e-298dfb7ef659 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:24.564339 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-7ec41fc8-7f23-4588-bc4e-298dfb7ef659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:24.629409 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 943/1899] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:24.656392 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf8e69-032a-4958-8726-ec9146f3a4ec None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:24.656392 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf8e69-032a-4958-8726-ec9146f3a4ec None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:24.656392 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf8e69-032a-4958-8726-ec9146f3a4ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:24.730070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-6dbf8e69-032a-4958-8726-ec9146f3a4ec None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:24.731899 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-6dbf8e69-032a-4958-8726-ec9146f3a4ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:24.745418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec41fc8-7f23-4588-bc4e-298dfb7ef659 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:24.751533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42895ead-c39a-4470-8a69-d9a06ae6a50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:24.752328 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42895ead-c39a-4470-8a69-d9a06ae6a50a admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:24.752619 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42895ead-c39a-4470-8a69-d9a06ae6a50a admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:24.753033 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42895ead-c39a-4470-8a69-d9a06ae6a50a admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:24.754403 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42895ead-c39a-4470-8a69-d9a06ae6a50a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:24.756760 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42895ead-c39a-4470-8a69-d9a06ae6a50a admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:24.766849 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 944/1900] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:24.771302 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf8e69-032a-4958-8726-ec9146f3a4ec None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:24.785424 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf8e69-032a-4958-8726-ec9146f3a4ec None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:24.791386 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8b5fc-29a3-4b4a-80a2-045c8863e1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:24.792974 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8b5fc-29a3-4b4a-80a2-045c8863e1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:24.793814 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8b5fc-29a3-4b4a-80a2-045c8863e1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:24.794094 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8b5fc-29a3-4b4a-80a2-045c8863e1e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:24.794864 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8b5fc-29a3-4b4a-80a2-045c8863e1e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:11:24.795246 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8b5fc-29a3-4b4a-80a2-045c8863e1e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:24.798516 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8b5fc-29a3-4b4a-80a2-045c8863e1e2 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:24.834490 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 945/1901] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:11:24.838669 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8b5fc-29a3-4b4a-80a2-045c8863e1e2 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:24.862886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8b5fc-29a3-4b4a-80a2-045c8863e1e2 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:24.879445 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab358aa-589d-438f-8c40-df2091c6ecd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:24.880075 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab358aa-589d-438f-8c40-df2091c6ecd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:24.880356 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab358aa-589d-438f-8c40-df2091c6ecd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:24.880632 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab358aa-589d-438f-8c40-df2091c6ecd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:24.881271 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab358aa-589d-438f-8c40-df2091c6ecd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:24.883498 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab358aa-589d-438f-8c40-df2091c6ecd9 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:24.919450 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 957/1902] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:11:24 2022] POST /identity/v3/users => generated 283 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:11:24.923234 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42895ead-c39a-4470-8a69-d9a06ae6a50a admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:24.935047 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42895ead-c39a-4470-8a69-d9a06ae6a50a admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:24.951763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca669aa5-ecdb-42af-af17-1418d9ddacf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:24.951763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca669aa5-ecdb-42af-af17-1418d9ddacf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:24.951763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca669aa5-ecdb-42af-af17-1418d9ddacf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:24.951763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca669aa5-ecdb-42af-af17-1418d9ddacf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:24.952099 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca669aa5-ecdb-42af-af17-1418d9ddacf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:24.952099 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca669aa5-ecdb-42af-af17-1418d9ddacf0 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:24.958080 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 958/1903] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:24.962000 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca669aa5-ecdb-42af-af17-1418d9ddacf0 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:24.975282 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca669aa5-ecdb-42af-af17-1418d9ddacf0 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:24.987003 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3da468-732a-4b8c-875a-7480035f8ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:24.987910 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3da468-732a-4b8c-875a-7480035f8ffd admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:24.988946 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3da468-732a-4b8c-875a-7480035f8ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:24.988946 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3da468-732a-4b8c-875a-7480035f8ffd admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:24.990390 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3da468-732a-4b8c-875a-7480035f8ffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:24.992303 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3da468-732a-4b8c-875a-7480035f8ffd admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:25.010616 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 959/1904] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:11:25.016284 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3da468-732a-4b8c-875a-7480035f8ffd admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:25.028223 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3da468-732a-4b8c-875a-7480035f8ffd admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:25.033822 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a436c-27e4-4b7e-84b6-ce82c77332ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:25.034543 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 946/1905] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:11:24 2022] POST /identity/v3/projects => generated 369 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:25.035215 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a436c-27e4-4b7e-84b6-ce82c77332ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:25.035564 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a436c-27e4-4b7e-84b6-ce82c77332ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:25.035842 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a436c-27e4-4b7e-84b6-ce82c77332ef admin admin] PATH_INFO: `/v3/projects/92a93a22af9f4c06a571c32504afbf0a/users/0adca1e4ee71464b8ae788e1087e6e20/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:25.038434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab358aa-589d-438f-8c40-df2091c6ecd9 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:25.053478 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a436c-27e4-4b7e-84b6-ce82c77332ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=92a93a22af9f4c06a571c32504afbf0a, user_id=0adca1e4ee71464b8ae788e1087e6e20, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:25.057743 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a436c-27e4-4b7e-84b6-ce82c77332ef admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:25.120561 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab358aa-589d-438f-8c40-df2091c6ecd9 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:25.126261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d99b4-af88-482b-8987-e35f9b9628ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:25.126880 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d99b4-af88-482b-8987-e35f9b9628ee admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:25.127252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d99b4-af88-482b-8987-e35f9b9628ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:25.127469 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d99b4-af88-482b-8987-e35f9b9628ee admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:25.128105 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d99b4-af88-482b-8987-e35f9b9628ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:25.130112 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d99b4-af88-482b-8987-e35f9b9628ee admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:25.167635 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 960/1906] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:11:25 2022] PUT /identity/v3/projects/92a93a22af9f4c06a571c32504afbf0a/users/0adca1e4ee71464b8ae788e1087e6e20/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:25.179491 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7cff5-9399-4923-87ac-80b3ef526583 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:25.180259 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7cff5-9399-4923-87ac-80b3ef526583 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:25.180826 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7cff5-9399-4923-87ac-80b3ef526583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:25.221702 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-f6d7cff5-9399-4923-87ac-80b3ef526583 None None] MFA Rules not processed for user `0adca1e4ee71464b8ae788e1087e6e20`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:25.223372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-f6d7cff5-9399-4923-87ac-80b3ef526583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:25.242286 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 947/1907] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:11:25 2022] POST /identity/v3/users => generated 285 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:11:25.246068 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d99b4-af88-482b-8987-e35f9b9628ee admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:25.280200 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d99b4-af88-482b-8987-e35f9b9628ee admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:25.299441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 961/1908] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:25.303639 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7cff5-9399-4923-87ac-80b3ef526583 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:25.379089 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7cff5-9399-4923-87ac-80b3ef526583 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:25.385956 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4e777-2d1f-4318-b890-1f466fb5d97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:25.388963 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4e777-2d1f-4318-b890-1f466fb5d97a admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:25.389487 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4e777-2d1f-4318-b890-1f466fb5d97a admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:25.389771 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4e777-2d1f-4318-b890-1f466fb5d97a admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:25.390436 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4e777-2d1f-4318-b890-1f466fb5d97a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:25.393316 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef4e777-2d1f-4318-b890-1f466fb5d97a admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:25.399726 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305129c-751a-4bd8-90d7-9793cbe44ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:25.400559 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305129c-751a-4bd8-90d7-9793cbe44ccf admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:25.400850 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305129c-751a-4bd8-90d7-9793cbe44ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:25.401129 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7305129c-751a-4bd8-90d7-9793cbe44ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:25.401891 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305129c-751a-4bd8-90d7-9793cbe44ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:25.403676 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7305129c-751a-4bd8-90d7-9793cbe44ccf admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:25.419776 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 948/1909] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:25.441292 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305129c-751a-4bd8-90d7-9793cbe44ccf admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:25.467145 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7305129c-751a-4bd8-90d7-9793cbe44ccf admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:25.472496 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03523a40-f1cb-4eb7-8bc9-0156bcfdab2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:25.473182 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03523a40-f1cb-4eb7-8bc9-0156bcfdab2f admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:25.473465 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03523a40-f1cb-4eb7-8bc9-0156bcfdab2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:25.473787 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03523a40-f1cb-4eb7-8bc9-0156bcfdab2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:25.474498 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03523a40-f1cb-4eb7-8bc9-0156bcfdab2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:25.476217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03523a40-f1cb-4eb7-8bc9-0156bcfdab2f admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:25.492599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 949/1910] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:25.493803 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03523a40-f1cb-4eb7-8bc9-0156bcfdab2f admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:25.504777 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03523a40-f1cb-4eb7-8bc9-0156bcfdab2f admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:25.510998 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b409ed-a081-41a2-ac27-c17122982c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:25.512665 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b409ed-a081-41a2-ac27-c17122982c27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:25.513041 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b409ed-a081-41a2-ac27-c17122982c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:25.513487 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b409ed-a081-41a2-ac27-c17122982c27 admin admin] PATH_INFO: `/v3/projects/ee9b493d10294e85b0efda4744b9b9dd/users/27e79047e49e4efbbf6b70f2120e5b53/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:25.552183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b409ed-a081-41a2-ac27-c17122982c27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee9b493d10294e85b0efda4744b9b9dd, user_id=27e79047e49e4efbbf6b70f2120e5b53, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:25.552183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b409ed-a081-41a2-ac27-c17122982c27 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:26.282172 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 962/1911] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:11:25 2022] POST /identity/v3/projects => generated 363 bytes in 979 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:11:26.286411 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4e777-2d1f-4318-b890-1f466fb5d97a admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:26.353945 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4e777-2d1f-4318-b890-1f466fb5d97a admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:26.359789 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44d970-ed5e-4d24-a64c-bf35c4eee380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:26.360276 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44d970-ed5e-4d24-a64c-bf35c4eee380 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:26.360550 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44d970-ed5e-4d24-a64c-bf35c4eee380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:26.360817 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44d970-ed5e-4d24-a64c-bf35c4eee380 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:26.361445 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44d970-ed5e-4d24-a64c-bf35c4eee380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:26.363428 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44d970-ed5e-4d24-a64c-bf35c4eee380 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:26.673603 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 950/1912] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:11:25 2022] PUT /identity/v3/projects/ee9b493d10294e85b0efda4744b9b9dd/users/27e79047e49e4efbbf6b70f2120e5b53/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 1180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:26.685680 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4dbde2-e649-4105-9ff3-b6935844dbcc None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:26.686071 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4dbde2-e649-4105-9ff3-b6935844dbcc None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:26.686449 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4dbde2-e649-4105-9ff3-b6935844dbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:26.740888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-8d4dbde2-e649-4105-9ff3-b6935844dbcc None None] MFA Rules not processed for user `27e79047e49e4efbbf6b70f2120e5b53`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:26.742177 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-8d4dbde2-e649-4105-9ff3-b6935844dbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:26.804137 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 963/1913] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:11:26 2022] POST /identity/v3/users => generated 288 bytes in 518 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:26.807997 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44d970-ed5e-4d24-a64c-bf35c4eee380 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:26.826517 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44d970-ed5e-4d24-a64c-bf35c4eee380 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:26.870593 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 951/1914] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:26.883575 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4dbde2-e649-4105-9ff3-b6935844dbcc None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:26.883575 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-8d4dbde2-e649-4105-9ff3-b6935844dbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:26.886438 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:26.944736 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578e682-76fa-4d86-854f-712b152987d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:26.945358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578e682-76fa-4d86-854f-712b152987d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:26.946494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578e682-76fa-4d86-854f-712b152987d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:26.946494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2578e682-76fa-4d86-854f-712b152987d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:26.947576 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578e682-76fa-4d86-854f-712b152987d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:26.949757 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2578e682-76fa-4d86-854f-712b152987d5 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:26.962143 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 964/1915] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:26 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:26.966888 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578e682-76fa-4d86-854f-712b152987d5 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:26.977560 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2578e682-76fa-4d86-854f-712b152987d5 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:26.994809 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf415f8e-165d-46cf-932e-129884c75f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:26.995634 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf415f8e-165d-46cf-932e-129884c75f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:26.995989 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf415f8e-165d-46cf-932e-129884c75f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:26.996339 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf415f8e-165d-46cf-932e-129884c75f2f admin admin] PATH_INFO: `/v3/projects/b8edf28822a1401d849f966f7e1dc785/users/b925801793744b9cba3de0d4f446f180/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:27.013522 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf415f8e-165d-46cf-932e-129884c75f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8edf28822a1401d849f966f7e1dc785, user_id=b925801793744b9cba3de0d4f446f180, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:27.016316 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf415f8e-165d-46cf-932e-129884c75f2f admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:27.024033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4dbde2-e649-4105-9ff3-b6935844dbcc None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:27.027736 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d45a4-296c-48bc-9fef-f35eedd034e8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6aad0e9f5f4a0b9578a31082e726cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:27.028842 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d45a4-296c-48bc-9fef-f35eedd034e8 service glance] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:27.029285 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d45a4-296c-48bc-9fef-f35eedd034e8 service glance] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:27.029714 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d45a4-296c-48bc-9fef-f35eedd034e8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:27.038486 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d45a4-296c-48bc-9fef-f35eedd034e8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:27.039965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d45a4-296c-48bc-9fef-f35eedd034e8 service glance] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:27.049859 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 952/1916] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:26 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:11:27.125176 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 965/1917] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:11:26 2022] PUT /identity/v3/projects/b8edf28822a1401d849f966f7e1dc785/users/b925801793744b9cba3de0d4f446f180/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:27.126809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d45a4-296c-48bc-9fef-f35eedd034e8 service glance] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:27.139528 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d45a4-296c-48bc-9fef-f35eedd034e8 service glance] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:27.211096 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b06bd5-d83d-48c3-bdee-26b46552fd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:27.212134 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b06bd5-d83d-48c3-bdee-26b46552fd5c admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:27.212420 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b06bd5-d83d-48c3-bdee-26b46552fd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:27.212801 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b06bd5-d83d-48c3-bdee-26b46552fd5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:27.213730 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b06bd5-d83d-48c3-bdee-26b46552fd5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:27.216796 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b06bd5-d83d-48c3-bdee-26b46552fd5c admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:27.273500 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 953/1918] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:27.277446 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf415f8e-165d-46cf-932e-129884c75f2f admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:27.302597 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf415f8e-165d-46cf-932e-129884c75f2f admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:27.312737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce7856-6f81-4e05-8cb4-0f5b0dac7c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:27.313591 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce7856-6f81-4e05-8cb4-0f5b0dac7c4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:27.314081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce7856-6f81-4e05-8cb4-0f5b0dac7c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:27.314502 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce7856-6f81-4e05-8cb4-0f5b0dac7c4b admin admin] PATH_INFO: `/v3/projects/b8edf28822a1401d849f966f7e1dc785/users/b925801793744b9cba3de0d4f446f180/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:27.316657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce7856-6f81-4e05-8cb4-0f5b0dac7c4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8edf28822a1401d849f966f7e1dc785, user_id=b925801793744b9cba3de0d4f446f180, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:27.319844 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce7856-6f81-4e05-8cb4-0f5b0dac7c4b admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:27.346080 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 966/1919] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:11:27 2022] PUT /identity/v3/projects/b8edf28822a1401d849f966f7e1dc785/users/b925801793744b9cba3de0d4f446f180/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:27.349119 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eecfd1-5f1f-48b8-ba72-f5ebded3ba69 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:27.349519 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eecfd1-5f1f-48b8-ba72-f5ebded3ba69 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:27.349806 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eecfd1-5f1f-48b8-ba72-f5ebded3ba69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:27.412589 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-15eecfd1-5f1f-48b8-ba72-f5ebded3ba69 None None] MFA Rules not processed for user `b925801793744b9cba3de0d4f446f180`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:27.414000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-15eecfd1-5f1f-48b8-ba72-f5ebded3ba69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:27.551163 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 954/1920] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:27 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:27.684113 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce7856-6f81-4e05-8cb4-0f5b0dac7c4b admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:27.686150 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-72ce7856-6f81-4e05-8cb4-0f5b0dac7c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:27.819849 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce7856-6f81-4e05-8cb4-0f5b0dac7c4b admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:27.826144 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55acbe5-6bf4-4fde-a46e-57204834aab5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:27.826721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55acbe5-6bf4-4fde-a46e-57204834aab5 service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:27.827040 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55acbe5-6bf4-4fde-a46e-57204834aab5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:27.827466 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55acbe5-6bf4-4fde-a46e-57204834aab5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:27.838843 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55acbe5-6bf4-4fde-a46e-57204834aab5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:27.840358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55acbe5-6bf4-4fde-a46e-57204834aab5 service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:27.877270 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 967/1921] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:11:28.047433 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:28.595546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eecfd1-5f1f-48b8-ba72-f5ebded3ba69 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:28.611133 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eecfd1-5f1f-48b8-ba72-f5ebded3ba69 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:28.615743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192a106c-d80c-4b2c-bcfb-bbbc55934b7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:28.616605 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a106c-d80c-4b2c-bcfb-bbbc55934b7e service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:28.617093 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a106c-d80c-4b2c-bcfb-bbbc55934b7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:28.617734 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a106c-d80c-4b2c-bcfb-bbbc55934b7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:28.689967 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a106c-d80c-4b2c-bcfb-bbbc55934b7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:28.691462 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192a106c-d80c-4b2c-bcfb-bbbc55934b7e service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:28.701501 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 955/1922] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:11:29.146199 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:29.915307 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:30.683406 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55acbe5-6bf4-4fde-a46e-57204834aab5 service cinder] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:30.688323 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-f55acbe5-6bf4-4fde-a46e-57204834aab5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:30.790870 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55acbe5-6bf4-4fde-a46e-57204834aab5 service cinder] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:30.796635 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df856e77-903b-4333-a4ea-899985bc498a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:30.797393 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df856e77-903b-4333-a4ea-899985bc498a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:30.797761 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df856e77-903b-4333-a4ea-899985bc498a admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:30.798113 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df856e77-903b-4333-a4ea-899985bc498a admin admin] PATH_INFO: `/v3/users/043bfb5019f74d8a993b81a3037932bc` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:30.800107 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df856e77-903b-4333-a4ea-899985bc498a admin admin] RBAC: Authorizing `identity:delete_user(user_id=043bfb5019f74d8a993b81a3037932bc)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:30.803706 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df856e77-903b-4333-a4ea-899985bc498a admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:31.108392 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-df856e77-903b-4333-a4ea-899985bc498a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '043bfb5019f74d8a993b81a3037932bc'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:31.119910 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-df856e77-903b-4333-a4ea-899985bc498a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '043bfb5019f74d8a993b81a3037932bc'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:31.205031 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-df856e77-903b-4333-a4ea-899985bc498a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '043bfb5019f74d8a993b81a3037932bc'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:31.205676 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-df856e77-903b-4333-a4ea-899985bc498a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '043bfb5019f74d8a993b81a3037932bc'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:31.206297 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-df856e77-903b-4333-a4ea-899985bc498a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '043bfb5019f74d8a993b81a3037932bc'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:31.225087 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 968/1923] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:11:30 2022] DELETE /identity/v3/users/043bfb5019f74d8a993b81a3037932bc => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:31.229778 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95360acc-9135-41f7-bf23-920e0b12c3e3 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:31.230320 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95360acc-9135-41f7-bf23-920e0b12c3e3 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:31.230320 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95360acc-9135-41f7-bf23-920e0b12c3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:31.250405 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-95360acc-9135-41f7-bf23-920e0b12c3e3 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:31.251863 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-95360acc-9135-41f7-bf23-920e0b12c3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:31.320248 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 956/1924] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:31.331444 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df856e77-903b-4333-a4ea-899985bc498a admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:31.332860 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-df856e77-903b-4333-a4ea-899985bc498a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:31.398941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df856e77-903b-4333-a4ea-899985bc498a admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:31.404437 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f52962-0043-417c-8075-b31de34e6cc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:31.405943 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f52962-0043-417c-8075-b31de34e6cc3 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:31.406225 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f52962-0043-417c-8075-b31de34e6cc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:31.406525 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f52962-0043-417c-8075-b31de34e6cc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:31.417053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f52962-0043-417c-8075-b31de34e6cc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:31.418618 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f52962-0043-417c-8075-b31de34e6cc3 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:31.429256 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 969/1925] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:11:31.870298 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95360acc-9135-41f7-bf23-920e0b12c3e3 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:31.873753 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-95360acc-9135-41f7-bf23-920e0b12c3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:31.885561 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95360acc-9135-41f7-bf23-920e0b12c3e3 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:31.890488 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6062f2-8854-4c82-bf6d-17c54a2adda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:31.891149 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6062f2-8854-4c82-bf6d-17c54a2adda0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:31.891598 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6062f2-8854-4c82-bf6d-17c54a2adda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:31.891879 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6062f2-8854-4c82-bf6d-17c54a2adda0 admin admin] PATH_INFO: `/v3/projects/e1a1b8e8290c41debdf30235e9edf5d2` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:31.893028 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6062f2-8854-4c82-bf6d-17c54a2adda0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1a1b8e8290c41debdf30235e9edf5d2)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:31.895027 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6062f2-8854-4c82-bf6d-17c54a2adda0 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:31.922231 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:32.019218 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-5d6062f2-8854-4c82-bf6d-17c54a2adda0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1a1b8e8290c41debdf30235e9edf5d2', 'request_id': 'req-5d6062f2-8854-4c82-bf6d-17c54a2adda0'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:32.024682 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-5d6062f2-8854-4c82-bf6d-17c54a2adda0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1a1b8e8290c41debdf30235e9edf5d2', 'request_id': 'req-5d6062f2-8854-4c82-bf6d-17c54a2adda0'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:32.031687 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-5d6062f2-8854-4c82-bf6d-17c54a2adda0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1a1b8e8290c41debdf30235e9edf5d2', 'request_id': 'req-5d6062f2-8854-4c82-bf6d-17c54a2adda0'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:32.131255 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-5d6062f2-8854-4c82-bf6d-17c54a2adda0 admin admin] The token cache is being invalidate because project e1a1b8e8290c41debdf30235e9edf5d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:11:32.131469 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-5d6062f2-8854-4c82-bf6d-17c54a2adda0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:32.132091 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-5d6062f2-8854-4c82-bf6d-17c54a2adda0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:32.133832 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 957/1926] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:11:31 2022] DELETE /identity/v3/projects/e1a1b8e8290c41debdf30235e9edf5d2 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:32.145979 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d2310-132d-4fdc-935f-db44b4620083 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:32.146484 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d2310-132d-4fdc-935f-db44b4620083 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:32.146570 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45d2310-132d-4fdc-935f-db44b4620083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:32.166268 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-c45d2310-132d-4fdc-935f-db44b4620083 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:32.167500 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-c45d2310-132d-4fdc-935f-db44b4620083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:32.240813 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 970/1927] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:32.246604 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4a98d-c0ca-4809-ac6a-56a4402413f1 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:32.247213 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4a98d-c0ca-4809-ac6a-56a4402413f1 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:32.247549 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df4a98d-c0ca-4809-ac6a-56a4402413f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:32.269886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-7df4a98d-c0ca-4809-ac6a-56a4402413f1 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:32.271059 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-7df4a98d-c0ca-4809-ac6a-56a4402413f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:32.281019 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 958/1928] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:32.285389 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d2310-132d-4fdc-935f-db44b4620083 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:32.299247 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45d2310-132d-4fdc-935f-db44b4620083 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:32.304040 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829405a-5ad2-49c7-a8b9-290359b60dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:32.304647 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829405a-5ad2-49c7-a8b9-290359b60dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:32.304925 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829405a-5ad2-49c7-a8b9-290359b60dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:32.305195 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829405a-5ad2-49c7-a8b9-290359b60dc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:32.305837 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829405a-5ad2-49c7-a8b9-290359b60dc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:11:32.306325 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829405a-5ad2-49c7-a8b9-290359b60dc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:32.307995 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829405a-5ad2-49c7-a8b9-290359b60dc2 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:32.320307 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 971/1929] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:11:32.324837 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4a98d-c0ca-4809-ac6a-56a4402413f1 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:32.334934 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df4a98d-c0ca-4809-ac6a-56a4402413f1 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:32.340004 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a03b5-e77e-4690-9747-f342437f8af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:32.340617 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a03b5-e77e-4690-9747-f342437f8af2 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:32.342936 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a03b5-e77e-4690-9747-f342437f8af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:32.343271 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a03b5-e77e-4690-9747-f342437f8af2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:32.344056 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a03b5-e77e-4690-9747-f342437f8af2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:32.345990 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a03b5-e77e-4690-9747-f342437f8af2 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:32.417967 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 959/1930] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:11:32 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:32.426247 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829405a-5ad2-49c7-a8b9-290359b60dc2 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:32.436138 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:32.443488 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829405a-5ad2-49c7-a8b9-290359b60dc2 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:32.528453 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34286a52-7db9-486b-8efe-d1bd0456a15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:32.529947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34286a52-7db9-486b-8efe-d1bd0456a15b admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:32.530327 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34286a52-7db9-486b-8efe-d1bd0456a15b admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:32.530711 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34286a52-7db9-486b-8efe-d1bd0456a15b admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:32.531495 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34286a52-7db9-486b-8efe-d1bd0456a15b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:32.533636 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34286a52-7db9-486b-8efe-d1bd0456a15b admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:32.619413 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 972/1931] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:11:32 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:11:32.625029 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a03b5-e77e-4690-9747-f342437f8af2 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:32.636375 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a03b5-e77e-4690-9747-f342437f8af2 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:32.653167 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247824a7-c023-43c6-b691-d7bb5fd1cbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:32.654499 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247824a7-c023-43c6-b691-d7bb5fd1cbf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:32.655006 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247824a7-c023-43c6-b691-d7bb5fd1cbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:32.655394 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247824a7-c023-43c6-b691-d7bb5fd1cbf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:32.656378 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247824a7-c023-43c6-b691-d7bb5fd1cbf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:32.658989 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247824a7-c023-43c6-b691-d7bb5fd1cbf3 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:32.683339 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 960/1932] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:32.685031 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34286a52-7db9-486b-8efe-d1bd0456a15b admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:32.697097 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34286a52-7db9-486b-8efe-d1bd0456a15b admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:32.704530 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c89d39-1b80-432c-b2a7-1dc5f4ad0257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:32.705157 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c89d39-1b80-432c-b2a7-1dc5f4ad0257 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:32.705501 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c89d39-1b80-432c-b2a7-1dc5f4ad0257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:32.705787 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c89d39-1b80-432c-b2a7-1dc5f4ad0257 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:32.706501 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c89d39-1b80-432c-b2a7-1dc5f4ad0257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:32.708118 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c89d39-1b80-432c-b2a7-1dc5f4ad0257 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:32.720314 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 973/1933] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:32.725009 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247824a7-c023-43c6-b691-d7bb5fd1cbf3 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:32.737312 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247824a7-c023-43c6-b691-d7bb5fd1cbf3 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:32.742118 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ad99a-0cdb-4e7d-a7fa-82028c0b6a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:32.742785 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ad99a-0cdb-4e7d-a7fa-82028c0b6a74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:32.743353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ad99a-0cdb-4e7d-a7fa-82028c0b6a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:32.743825 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ad99a-0cdb-4e7d-a7fa-82028c0b6a74 admin admin] PATH_INFO: `/v3/projects/0137f8139154473494a0f44a19c12fe4/users/c9ec83b3e92f4b39ba47ed3f66399f49/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:32.763600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ad99a-0cdb-4e7d-a7fa-82028c0b6a74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0137f8139154473494a0f44a19c12fe4, user_id=c9ec83b3e92f4b39ba47ed3f66399f49, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:32.766502 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ad99a-0cdb-4e7d-a7fa-82028c0b6a74 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:32.826767 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 961/1934] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:11:32 2022] PUT /identity/v3/projects/0137f8139154473494a0f44a19c12fe4/users/c9ec83b3e92f4b39ba47ed3f66399f49/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:32.838274 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f76d52-4f51-4895-99ab-37fce37239bd None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:32.838555 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f76d52-4f51-4895-99ab-37fce37239bd None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:32.838833 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f76d52-4f51-4895-99ab-37fce37239bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:32.875443 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-42f76d52-4f51-4895-99ab-37fce37239bd None None] MFA Rules not processed for user `c9ec83b3e92f4b39ba47ed3f66399f49`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:32.876930 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-42f76d52-4f51-4895-99ab-37fce37239bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:32.955992 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 974/1935] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:11:32.964340 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ad99a-0cdb-4e7d-a7fa-82028c0b6a74 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:32.966711 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-f77ad99a-0cdb-4e7d-a7fa-82028c0b6a74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:33.043774 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ad99a-0cdb-4e7d-a7fa-82028c0b6a74 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:33.047702 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51fb6e4-f324-4702-bcfc-8f4671a70fcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:33.048322 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fb6e4-f324-4702-bcfc-8f4671a70fcb service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:33.048604 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fb6e4-f324-4702-bcfc-8f4671a70fcb service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:33.048878 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fb6e4-f324-4702-bcfc-8f4671a70fcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:33.060784 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51fb6e4-f324-4702-bcfc-8f4671a70fcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:33.062301 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51fb6e4-f324-4702-bcfc-8f4671a70fcb service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:33.073070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 962/1936] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:11:33.823220 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:34.519993 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:34.839338 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f76d52-4f51-4895-99ab-37fce37239bd None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:34.840834 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-42f76d52-4f51-4895-99ab-37fce37239bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:34.913494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f76d52-4f51-4895-99ab-37fce37239bd None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:34.918105 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab83a3a-7e02-42ce-af47-e27ddd411530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:34.919534 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab83a3a-7e02-42ce-af47-e27ddd411530 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:34.919814 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab83a3a-7e02-42ce-af47-e27ddd411530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:34.920144 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab83a3a-7e02-42ce-af47-e27ddd411530 admin admin] PATH_INFO: `/v3/users/010764259ded4986b8f02d164c397706` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:34.921326 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab83a3a-7e02-42ce-af47-e27ddd411530 admin admin] RBAC: Authorizing `identity:delete_user(user_id=010764259ded4986b8f02d164c397706)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:34.923393 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab83a3a-7e02-42ce-af47-e27ddd411530 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:35.219832 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-4ab83a3a-7e02-42ce-af47-e27ddd411530 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '010764259ded4986b8f02d164c397706'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:35.227137 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-4ab83a3a-7e02-42ce-af47-e27ddd411530 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '010764259ded4986b8f02d164c397706'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:35.343282 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-4ab83a3a-7e02-42ce-af47-e27ddd411530 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '010764259ded4986b8f02d164c397706'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:35.344451 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-4ab83a3a-7e02-42ce-af47-e27ddd411530 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '010764259ded4986b8f02d164c397706'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:35.346239 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-4ab83a3a-7e02-42ce-af47-e27ddd411530 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '010764259ded4986b8f02d164c397706'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:35.369345 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 975/1937] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:11:34 2022] DELETE /identity/v3/users/010764259ded4986b8f02d164c397706 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:11:35.373966 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb1bdb-7461-4d56-88a8-bce9cbe243c4 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:35.376331 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb1bdb-7461-4d56-88a8-bce9cbe243c4 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:35.376786 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb1bdb-7461-4d56-88a8-bce9cbe243c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:35.398970 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-d6bb1bdb-7461-4d56-88a8-bce9cbe243c4 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:35.400911 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-d6bb1bdb-7461-4d56-88a8-bce9cbe243c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:35.484774 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 963/1938] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:11:35.495697 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab83a3a-7e02-42ce-af47-e27ddd411530 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:35.497212 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-4ab83a3a-7e02-42ce-af47-e27ddd411530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:35.561330 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab83a3a-7e02-42ce-af47-e27ddd411530 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:35.565274 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90c06f-6796-4502-afce-1b381239b056 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:35.565924 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90c06f-6796-4502-afce-1b381239b056 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:35.566221 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90c06f-6796-4502-afce-1b381239b056 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:35.566474 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90c06f-6796-4502-afce-1b381239b056 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:35.576807 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90c06f-6796-4502-afce-1b381239b056 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:35.578414 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90c06f-6796-4502-afce-1b381239b056 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:35.588515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 976/1939] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:11:35.931703 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:36.007789 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb1bdb-7461-4d56-88a8-bce9cbe243c4 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:36.009928 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-d6bb1bdb-7461-4d56-88a8-bce9cbe243c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:36.023200 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb1bdb-7461-4d56-88a8-bce9cbe243c4 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:36.028247 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818c139-54b5-4a07-bdbf-22876fad4d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:36.029160 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818c139-54b5-4a07-bdbf-22876fad4d58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:36.029629 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818c139-54b5-4a07-bdbf-22876fad4d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:36.029910 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818c139-54b5-4a07-bdbf-22876fad4d58 admin admin] PATH_INFO: `/v3/projects/a5b5ec3dd5b04f35985942486fbed226` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:36.031073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818c139-54b5-4a07-bdbf-22876fad4d58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5b5ec3dd5b04f35985942486fbed226)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:36.044960 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818c139-54b5-4a07-bdbf-22876fad4d58 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:36.189649 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-1818c139-54b5-4a07-bdbf-22876fad4d58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5b5ec3dd5b04f35985942486fbed226', 'request_id': 'req-1818c139-54b5-4a07-bdbf-22876fad4d58'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:36.195072 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-1818c139-54b5-4a07-bdbf-22876fad4d58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5b5ec3dd5b04f35985942486fbed226', 'request_id': 'req-1818c139-54b5-4a07-bdbf-22876fad4d58'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:36.202299 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-1818c139-54b5-4a07-bdbf-22876fad4d58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5b5ec3dd5b04f35985942486fbed226', 'request_id': 'req-1818c139-54b5-4a07-bdbf-22876fad4d58'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:36.277297 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-1818c139-54b5-4a07-bdbf-22876fad4d58 admin admin] The token cache is being invalidate because project a5b5ec3dd5b04f35985942486fbed226 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:11:36.281462 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-1818c139-54b5-4a07-bdbf-22876fad4d58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:36.281462 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-1818c139-54b5-4a07-bdbf-22876fad4d58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:36.281462 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 964/1940] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:11:36 2022] DELETE /identity/v3/projects/a5b5ec3dd5b04f35985942486fbed226 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:36.284667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90c06f-6796-4502-afce-1b381239b056 service neutron] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:36.298747 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90c06f-6796-4502-afce-1b381239b056 service neutron] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:36.357906 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47623cb-1529-4d0a-a096-7984051fa518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:36.358593 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47623cb-1529-4d0a-a096-7984051fa518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:36.358872 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47623cb-1529-4d0a-a096-7984051fa518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:36.359169 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47623cb-1529-4d0a-a096-7984051fa518 admin admin] PATH_INFO: `/v3/users/c4a4b1cef0644502aff0f02ce79f17ef` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:36.360330 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47623cb-1529-4d0a-a096-7984051fa518 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4a4b1cef0644502aff0f02ce79f17ef)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:36.362235 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47623cb-1529-4d0a-a096-7984051fa518 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:36.388687 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:36.520809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818c139-54b5-4a07-bdbf-22876fad4d58 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:36.522562 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-1818c139-54b5-4a07-bdbf-22876fad4d58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:36.537004 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818c139-54b5-4a07-bdbf-22876fad4d58 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:36.541736 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9fd2d-2f72-426e-857c-a6392e31e93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:36.542413 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9fd2d-2f72-426e-857c-a6392e31e93f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:36.542684 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9fd2d-2f72-426e-857c-a6392e31e93f admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:36.542951 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c9fd2d-2f72-426e-857c-a6392e31e93f admin admin] PATH_INFO: `/v3/users/c9ec83b3e92f4b39ba47ed3f66399f49` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:36.548030 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9fd2d-2f72-426e-857c-a6392e31e93f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9ec83b3e92f4b39ba47ed3f66399f49)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:36.548030 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c9fd2d-2f72-426e-857c-a6392e31e93f admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:36.629966 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-e47623cb-1529-4d0a-a096-7984051fa518 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4a4b1cef0644502aff0f02ce79f17ef'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:36.637929 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-e47623cb-1529-4d0a-a096-7984051fa518 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4a4b1cef0644502aff0f02ce79f17ef'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:36.713974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-e47623cb-1529-4d0a-a096-7984051fa518 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4a4b1cef0644502aff0f02ce79f17ef'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:36.714719 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-e47623cb-1529-4d0a-a096-7984051fa518 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4a4b1cef0644502aff0f02ce79f17ef'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:36.715412 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-e47623cb-1529-4d0a-a096-7984051fa518 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4a4b1cef0644502aff0f02ce79f17ef'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:36.735421 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 977/1941] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:11:36 2022] DELETE /identity/v3/users/c4a4b1cef0644502aff0f02ce79f17ef => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:36.787913 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-66c9fd2d-2f72-426e-857c-a6392e31e93f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9ec83b3e92f4b39ba47ed3f66399f49'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:36.788606 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-66c9fd2d-2f72-426e-857c-a6392e31e93f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9ec83b3e92f4b39ba47ed3f66399f49'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:36.795978 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-66c9fd2d-2f72-426e-857c-a6392e31e93f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9ec83b3e92f4b39ba47ed3f66399f49'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:36.796849 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-66c9fd2d-2f72-426e-857c-a6392e31e93f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9ec83b3e92f4b39ba47ed3f66399f49'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:36.879159 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-66c9fd2d-2f72-426e-857c-a6392e31e93f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9ec83b3e92f4b39ba47ed3f66399f49'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:36.897925 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 965/1942] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:11:36 2022] DELETE /identity/v3/users/c9ec83b3e92f4b39ba47ed3f66399f49 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:11:36.902733 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8433b3-8602-4a6f-9e18-e3b46f68aa31 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:36.903025 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8433b3-8602-4a6f-9e18-e3b46f68aa31 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:36.903416 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8433b3-8602-4a6f-9e18-e3b46f68aa31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:36.926162 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-aa8433b3-8602-4a6f-9e18-e3b46f68aa31 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:36.927513 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-aa8433b3-8602-4a6f-9e18-e3b46f68aa31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:36.994664 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 978/1943] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:37.005603 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9fd2d-2f72-426e-857c-a6392e31e93f admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:37.007314 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-66c9fd2d-2f72-426e-857c-a6392e31e93f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:37.072961 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c9fd2d-2f72-426e-857c-a6392e31e93f admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:37.080554 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a9945-d12a-4ff5-afe7-9ca148bc2530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:37.080554 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a9945-d12a-4ff5-afe7-9ca148bc2530 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:37.080554 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a9945-d12a-4ff5-afe7-9ca148bc2530 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:37.080883 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a9945-d12a-4ff5-afe7-9ca148bc2530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:37.091677 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a9945-d12a-4ff5-afe7-9ca148bc2530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:37.095980 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a9945-d12a-4ff5-afe7-9ca148bc2530 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:37.103616 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 966/1944] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:11:37.242848 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8433b3-8602-4a6f-9e18-e3b46f68aa31 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:37.244168 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-aa8433b3-8602-4a6f-9e18-e3b46f68aa31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:37.261706 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8433b3-8602-4a6f-9e18-e3b46f68aa31 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:37.267406 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba78701-f8d1-4856-beba-a2c46915dbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:37.268072 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba78701-f8d1-4856-beba-a2c46915dbeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:37.268495 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba78701-f8d1-4856-beba-a2c46915dbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:37.268783 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba78701-f8d1-4856-beba-a2c46915dbeb admin admin] PATH_INFO: `/v3/projects/bfb27de84a144d94939d6e11ecc23362` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:37.269978 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba78701-f8d1-4856-beba-a2c46915dbeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfb27de84a144d94939d6e11ecc23362)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:37.271984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba78701-f8d1-4856-beba-a2c46915dbeb admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:37.425742 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-2ba78701-f8d1-4856-beba-a2c46915dbeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfb27de84a144d94939d6e11ecc23362', 'request_id': 'req-2ba78701-f8d1-4856-beba-a2c46915dbeb'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:37.432300 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-2ba78701-f8d1-4856-beba-a2c46915dbeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfb27de84a144d94939d6e11ecc23362', 'request_id': 'req-2ba78701-f8d1-4856-beba-a2c46915dbeb'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:37.547984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-2ba78701-f8d1-4856-beba-a2c46915dbeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfb27de84a144d94939d6e11ecc23362', 'request_id': 'req-2ba78701-f8d1-4856-beba-a2c46915dbeb'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:37.548357 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:37.560208 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-2ba78701-f8d1-4856-beba-a2c46915dbeb admin admin] The token cache is being invalidate because project bfb27de84a144d94939d6e11ecc23362 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:11:37.560642 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-2ba78701-f8d1-4856-beba-a2c46915dbeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:37.561499 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-2ba78701-f8d1-4856-beba-a2c46915dbeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:37.563160 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 979/1945] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:11:37 2022] DELETE /identity/v3/projects/bfb27de84a144d94939d6e11ecc23362 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:11:37.568122 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe82119-59de-4cbb-a427-188a49dd0c4f None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:37.568428 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe82119-59de-4cbb-a427-188a49dd0c4f None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:37.568699 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe82119-59de-4cbb-a427-188a49dd0c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:37.589544 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-7fe82119-59de-4cbb-a427-188a49dd0c4f None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:37.590758 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-7fe82119-59de-4cbb-a427-188a49dd0c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:37.663279 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 967/1946] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:37.672120 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b469c8b-47af-40af-ae4b-e4c5b515877a None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:37.672651 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b469c8b-47af-40af-ae4b-e4c5b515877a None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:37.672876 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b469c8b-47af-40af-ae4b-e4c5b515877a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:37.694612 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-0b469c8b-47af-40af-ae4b-e4c5b515877a None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:37.695952 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-0b469c8b-47af-40af-ae4b-e4c5b515877a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:37.704765 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 980/1947] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:11:37.709777 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe82119-59de-4cbb-a427-188a49dd0c4f None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:37.722002 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe82119-59de-4cbb-a427-188a49dd0c4f None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:37.727460 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e4b45-2d29-41e8-9e86-317391f46897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:37.728397 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e4b45-2d29-41e8-9e86-317391f46897 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:37.728741 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e4b45-2d29-41e8-9e86-317391f46897 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:37.729083 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725e4b45-2d29-41e8-9e86-317391f46897 admin admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:37.729841 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e4b45-2d29-41e8-9e86-317391f46897 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:11:37.730178 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e4b45-2d29-41e8-9e86-317391f46897 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:37.732567 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725e4b45-2d29-41e8-9e86-317391f46897 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:37.732779 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:37.748023 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 968/1948] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:11:37.751944 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b469c8b-47af-40af-ae4b-e4c5b515877a None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:37.770912 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b469c8b-47af-40af-ae4b-e4c5b515877a None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:37.776213 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512eac5-674d-4541-9ec8-9948cc90d8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:37.776880 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512eac5-674d-4541-9ec8-9948cc90d8e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:37.777158 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512eac5-674d-4541-9ec8-9948cc90d8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:37.777428 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512eac5-674d-4541-9ec8-9948cc90d8e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:37.778063 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512eac5-674d-4541-9ec8-9948cc90d8e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:37.780503 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512eac5-674d-4541-9ec8-9948cc90d8e1 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:37.889576 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 981/1949] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:11:37 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:37.894429 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e4b45-2d29-41e8-9e86-317391f46897 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:37.914159 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725e4b45-2d29-41e8-9e86-317391f46897 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:38.008878 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d10e1-d703-463a-a073-d7b5427f85a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:38.010007 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d10e1-d703-463a-a073-d7b5427f85a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:38.010357 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d10e1-d703-463a-a073-d7b5427f85a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:38.010700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d10e1-d703-463a-a073-d7b5427f85a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:38.011732 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d10e1-d703-463a-a073-d7b5427f85a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:38.016227 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d10e1-d703-463a-a073-d7b5427f85a7 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:38.051167 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512eac5-674d-4541-9ec8-9948cc90d8e1 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:38.051676 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-8512eac5-674d-4541-9ec8-9948cc90d8e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:38.066135 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512eac5-674d-4541-9ec8-9948cc90d8e1 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:38.074794 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb43f51-af6b-450d-8e91-f9ca5fecc318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:38.077689 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb43f51-af6b-450d-8e91-f9ca5fecc318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:38.078038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb43f51-af6b-450d-8e91-f9ca5fecc318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:38.078381 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb43f51-af6b-450d-8e91-f9ca5fecc318 admin admin] PATH_INFO: `/v3/projects/0137f8139154473494a0f44a19c12fe4` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:38.079995 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb43f51-af6b-450d-8e91-f9ca5fecc318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0137f8139154473494a0f44a19c12fe4)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:38.086749 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb43f51-af6b-450d-8e91-f9ca5fecc318 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:38.150671 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 969/1950] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:11:37 2022] POST /identity/v3/users => generated 287 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:38.156676 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d10e1-d703-463a-a073-d7b5427f85a7 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:38.190209 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d10e1-d703-463a-a073-d7b5427f85a7 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:38.196361 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03149db-22be-49ce-a76e-a4b25c7c1e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:38.197174 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03149db-22be-49ce-a76e-a4b25c7c1e00 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:38.197787 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03149db-22be-49ce-a76e-a4b25c7c1e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:38.198126 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03149db-22be-49ce-a76e-a4b25c7c1e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:38.198876 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03149db-22be-49ce-a76e-a4b25c7c1e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:38.200794 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03149db-22be-49ce-a76e-a4b25c7c1e00 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:38.234319 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 970/1951] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:38.235479 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03149db-22be-49ce-a76e-a4b25c7c1e00 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:38.246609 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03149db-22be-49ce-a76e-a4b25c7c1e00 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:38.268767 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-8fb43f51-af6b-450d-8e91-f9ca5fecc318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0137f8139154473494a0f44a19c12fe4', 'request_id': 'req-8fb43f51-af6b-450d-8e91-f9ca5fecc318'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:38.275924 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-8fb43f51-af6b-450d-8e91-f9ca5fecc318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0137f8139154473494a0f44a19c12fe4', 'request_id': 'req-8fb43f51-af6b-450d-8e91-f9ca5fecc318'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:38.328561 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf4ceb-6a31-4c3e-8e93-d9cd85894fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:38.329154 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf4ceb-6a31-4c3e-8e93-d9cd85894fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:38.329436 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf4ceb-6a31-4c3e-8e93-d9cd85894fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:38.329707 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf4ceb-6a31-4c3e-8e93-d9cd85894fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:38.330354 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf4ceb-6a31-4c3e-8e93-d9cd85894fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:38.331992 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf4ceb-6a31-4c3e-8e93-d9cd85894fa9 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:38.342424 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 971/1952] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:38.346616 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf4ceb-6a31-4c3e-8e93-d9cd85894fa9 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:38.357646 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf4ceb-6a31-4c3e-8e93-d9cd85894fa9 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:38.362940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bbfb63-3a18-4e4e-8553-9438a6a73fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:38.364367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbfb63-3a18-4e4e-8553-9438a6a73fa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:38.364753 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbfb63-3a18-4e4e-8553-9438a6a73fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:38.365029 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bbfb63-3a18-4e4e-8553-9438a6a73fa0 admin admin] PATH_INFO: `/v3/projects/5f9b37e60ffe477db6539a53bc9f3144/users/f829ea9b22e543309a39ade2d7c5bf98/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:38.365708 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-8fb43f51-af6b-450d-8e91-f9ca5fecc318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0137f8139154473494a0f44a19c12fe4', 'request_id': 'req-8fb43f51-af6b-450d-8e91-f9ca5fecc318'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:38.384792 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-8fb43f51-af6b-450d-8e91-f9ca5fecc318 admin admin] The token cache is being invalidate because project 0137f8139154473494a0f44a19c12fe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:11:38.385299 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-8fb43f51-af6b-450d-8e91-f9ca5fecc318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:38.386463 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-8fb43f51-af6b-450d-8e91-f9ca5fecc318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:38.389338 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bbfb63-3a18-4e4e-8553-9438a6a73fa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f9b37e60ffe477db6539a53bc9f3144, user_id=f829ea9b22e543309a39ade2d7c5bf98, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:38.390727 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 982/1953] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:11:38 2022] DELETE /identity/v3/projects/0137f8139154473494a0f44a19c12fe4 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:11:38.397066 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bbfb63-3a18-4e4e-8553-9438a6a73fa0 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:38.406721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0a76d-48ea-4d20-aa8d-ce9eaff4d2da None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:38.407009 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0a76d-48ea-4d20-aa8d-ce9eaff4d2da None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:38.407315 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b0a76d-48ea-4d20-aa8d-ce9eaff4d2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:38.428720 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-e5b0a76d-48ea-4d20-aa8d-ce9eaff4d2da None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:38.429941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-e5b0a76d-48ea-4d20-aa8d-ce9eaff4d2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:38.438751 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 983/1954] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:38.447633 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c3ba4-ec0f-4a2b-b0ee-8d6057bb761c None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:38.447915 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c3ba4-ec0f-4a2b-b0ee-8d6057bb761c None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:38.448193 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c3ba4-ec0f-4a2b-b0ee-8d6057bb761c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:38.469659 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-765c3ba4-ec0f-4a2b-b0ee-8d6057bb761c None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:38.470909 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-765c3ba4-ec0f-4a2b-b0ee-8d6057bb761c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:38.480788 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 984/1955] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:11:38.488473 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c3ba4-ec0f-4a2b-b0ee-8d6057bb761c None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:38.500591 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c3ba4-ec0f-4a2b-b0ee-8d6057bb761c None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:38.505629 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d8ab5-e1d8-4ac8-95e5-d7777a977596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:38.506299 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d8ab5-e1d8-4ac8-95e5-d7777a977596 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:38.506723 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d8ab5-e1d8-4ac8-95e5-d7777a977596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:38.507002 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d8ab5-e1d8-4ac8-95e5-d7777a977596 admin admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:38.507712 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d8ab5-e1d8-4ac8-95e5-d7777a977596 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:11:38.508270 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d8ab5-e1d8-4ac8-95e5-d7777a977596 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:38.509894 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8d8ab5-e1d8-4ac8-95e5-d7777a977596 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:38.530426 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 985/1956] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:11:38.533000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 972/1957] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:11:38 2022] PUT /identity/v3/projects/5f9b37e60ffe477db6539a53bc9f3144/users/f829ea9b22e543309a39ade2d7c5bf98/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:11:38.534667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d8ab5-e1d8-4ac8-95e5-d7777a977596 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:38.552746 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d8ab5-e1d8-4ac8-95e5-d7777a977596 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:38.557507 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d66daa-9b28-4b7c-9776-c049689661eb None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:38.558013 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d66daa-9b28-4b7c-9776-c049689661eb None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:38.558385 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d66daa-9b28-4b7c-9776-c049689661eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:38.579230 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:38.604258 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-f8d66daa-9b28-4b7c-9776-c049689661eb None None] MFA Rules not processed for user `f829ea9b22e543309a39ade2d7c5bf98`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:38.607234 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-f8d66daa-9b28-4b7c-9776-c049689661eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:38.662531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce347a5b-df9e-421a-94e0-b7ce32647620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:38.663978 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce347a5b-df9e-421a-94e0-b7ce32647620 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:38.664425 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce347a5b-df9e-421a-94e0-b7ce32647620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:38.664844 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce347a5b-df9e-421a-94e0-b7ce32647620 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:38.673045 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce347a5b-df9e-421a-94e0-b7ce32647620 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:38.673045 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce347a5b-df9e-421a-94e0-b7ce32647620 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:38.714708 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 973/1958] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:38.720130 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d66daa-9b28-4b7c-9776-c049689661eb None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:38.721753 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-f8d66daa-9b28-4b7c-9776-c049689661eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:38.736345 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d66daa-9b28-4b7c-9776-c049689661eb None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:38.741054 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d61ec-f62a-4d34-beb7-2ed68ccaa4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:38.741856 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d61ec-f62a-4d34-beb7-2ed68ccaa4d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:38.742186 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d61ec-f62a-4d34-beb7-2ed68ccaa4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:38.742391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d61ec-f62a-4d34-beb7-2ed68ccaa4d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:38.743031 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d61ec-f62a-4d34-beb7-2ed68ccaa4d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:38.744996 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d61ec-f62a-4d34-beb7-2ed68ccaa4d9 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:38.798900 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 986/1959] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:11:38 2022] POST /identity/v3/projects => generated 389 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:38.804916 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce347a5b-df9e-421a-94e0-b7ce32647620 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:38.870394 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce347a5b-df9e-421a-94e0-b7ce32647620 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:38.877396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f88514-f506-438d-945d-37a14b4e5221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:38.878013 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f88514-f506-438d-945d-37a14b4e5221 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:38.878295 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f88514-f506-438d-945d-37a14b4e5221 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:38.878567 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f88514-f506-438d-945d-37a14b4e5221 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:38.879269 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f88514-f506-438d-945d-37a14b4e5221 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:38.881272 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f88514-f506-438d-945d-37a14b4e5221 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:38.886029 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 974/1960] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:11:38 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:38.886029 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d61ec-f62a-4d34-beb7-2ed68ccaa4d9 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:38.887877 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-ff2d61ec-f62a-4d34-beb7-2ed68ccaa4d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:38.958419 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d61ec-f62a-4d34-beb7-2ed68ccaa4d9 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:38.963282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df1b92-9a3e-442a-b5fa-ff9f28ced491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:38.963924 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df1b92-9a3e-442a-b5fa-ff9f28ced491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:38.964217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df1b92-9a3e-442a-b5fa-ff9f28ced491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:38.964469 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df1b92-9a3e-442a-b5fa-ff9f28ced491 admin admin] PATH_INFO: `/v3/users/0adca1e4ee71464b8ae788e1087e6e20` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:38.965617 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df1b92-9a3e-442a-b5fa-ff9f28ced491 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0adca1e4ee71464b8ae788e1087e6e20)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:38.968377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df1b92-9a3e-442a-b5fa-ff9f28ced491 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:39.022540 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 987/1961] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:11:38 2022] POST /identity/v3/users => generated 295 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:11:39.023516 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f88514-f506-438d-945d-37a14b4e5221 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:39.033497 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f88514-f506-438d-945d-37a14b4e5221 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:39.038227 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbde70-c9cd-47f0-aeb6-24acab2d1491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:39.038846 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbde70-c9cd-47f0-aeb6-24acab2d1491 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:39.039141 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbde70-c9cd-47f0-aeb6-24acab2d1491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:39.039457 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbde70-c9cd-47f0-aeb6-24acab2d1491 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:39.040078 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bbde70-c9cd-47f0-aeb6-24acab2d1491 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:39.042077 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bbde70-c9cd-47f0-aeb6-24acab2d1491 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:39.127508 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:39.137035 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 988/1962] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:11:39 2022] POST /identity/v3/users => generated 295 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:39.137035 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbde70-c9cd-47f0-aeb6-24acab2d1491 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:39.145125 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbde70-c9cd-47f0-aeb6-24acab2d1491 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:39.149829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442eef01-41c4-4a76-853d-68354055ff8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:39.150432 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442eef01-41c4-4a76-853d-68354055ff8c admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:39.150711 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442eef01-41c4-4a76-853d-68354055ff8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:39.150986 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442eef01-41c4-4a76-853d-68354055ff8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:39.151669 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442eef01-41c4-4a76-853d-68354055ff8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:39.153282 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442eef01-41c4-4a76-853d-68354055ff8c admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:39.171022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 989/1963] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:39.171022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442eef01-41c4-4a76-853d-68354055ff8c admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:39.180987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-d3df1b92-9a3e-442a-b5fa-ff9f28ced491 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0adca1e4ee71464b8ae788e1087e6e20'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:39.181272 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442eef01-41c4-4a76-853d-68354055ff8c admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:39.181678 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-d3df1b92-9a3e-442a-b5fa-ff9f28ced491 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0adca1e4ee71464b8ae788e1087e6e20'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:39.186266 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b2dfd-25c4-4350-9d66-ea1e2bda08c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:39.186919 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b2dfd-25c4-4350-9d66-ea1e2bda08c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:39.187358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b2dfd-25c4-4350-9d66-ea1e2bda08c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:39.187652 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b2dfd-25c4-4350-9d66-ea1e2bda08c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:39.188491 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b2dfd-25c4-4350-9d66-ea1e2bda08c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:39.190197 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-d3df1b92-9a3e-442a-b5fa-ff9f28ced491 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0adca1e4ee71464b8ae788e1087e6e20'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:39.190317 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b2dfd-25c4-4350-9d66-ea1e2bda08c6 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:39.190866 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-d3df1b92-9a3e-442a-b5fa-ff9f28ced491 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0adca1e4ee71464b8ae788e1087e6e20'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:39.200848 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 990/1964] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:39.201762 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b2dfd-25c4-4350-9d66-ea1e2bda08c6 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:39.203596 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-b06b2dfd-25c4-4350-9d66-ea1e2bda08c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:39.216634 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b2dfd-25c4-4350-9d66-ea1e2bda08c6 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:39.221557 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0a80c-58f5-4b0c-a04c-f2530ba0eead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:39.222176 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0a80c-58f5-4b0c-a04c-f2530ba0eead admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:39.222471 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0a80c-58f5-4b0c-a04c-f2530ba0eead admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:39.222719 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a0a80c-58f5-4b0c-a04c-f2530ba0eead admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:39.223541 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0a80c-58f5-4b0c-a04c-f2530ba0eead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:39.225138 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a0a80c-58f5-4b0c-a04c-f2530ba0eead admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:39.236647 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 991/1965] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:39.239944 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0a80c-58f5-4b0c-a04c-f2530ba0eead admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:39.239944 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-22a0a80c-58f5-4b0c-a04c-f2530ba0eead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:39.252672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a0a80c-58f5-4b0c-a04c-f2530ba0eead admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:39.258189 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a290d2-7334-4f44-9bd9-84d39f25a268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:39.258864 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a290d2-7334-4f44-9bd9-84d39f25a268 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:39.259177 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a290d2-7334-4f44-9bd9-84d39f25a268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:39.259460 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a290d2-7334-4f44-9bd9-84d39f25a268 admin admin] PATH_INFO: `/v3/projects/3b641e8a0cb44f22996c9938a0131197/users/a1316aa8e151437ea9e71510b7359715/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:39.279312 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a290d2-7334-4f44-9bd9-84d39f25a268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b641e8a0cb44f22996c9938a0131197, user_id=a1316aa8e151437ea9e71510b7359715, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:39.282443 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a290d2-7334-4f44-9bd9-84d39f25a268 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:39.288622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-d3df1b92-9a3e-442a-b5fa-ff9f28ced491 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0adca1e4ee71464b8ae788e1087e6e20'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:39.324202 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 975/1966] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:11:38 2022] DELETE /identity/v3/users/0adca1e4ee71464b8ae788e1087e6e20 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:39.325994 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df1b92-9a3e-442a-b5fa-ff9f28ced491 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:39.381153 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 992/1967] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:11:39 2022] PUT /identity/v3/projects/3b641e8a0cb44f22996c9938a0131197/users/a1316aa8e151437ea9e71510b7359715/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:39.381342 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07bce7-883c-4cd0-836b-b8536b52fcf1 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:39.382714 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07bce7-883c-4cd0-836b-b8536b52fcf1 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:39.383271 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d07bce7-883c-4cd0-836b-b8536b52fcf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:39.410742 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-4d07bce7-883c-4cd0-836b-b8536b52fcf1 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:39.412007 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-4d07bce7-883c-4cd0-836b-b8536b52fcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:39.425408 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df1b92-9a3e-442a-b5fa-ff9f28ced491 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:39.486373 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 993/1968] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:39.487466 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07bce7-883c-4cd0-836b-b8536b52fcf1 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:39.509364 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d07bce7-883c-4cd0-836b-b8536b52fcf1 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:39.509364 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4cf03-9011-4dbd-9370-9d2a72795781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:39.509364 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4cf03-9011-4dbd-9370-9d2a72795781 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:39.509364 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4cf03-9011-4dbd-9370-9d2a72795781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:39.509769 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4cf03-9011-4dbd-9370-9d2a72795781 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:39.509769 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4cf03-9011-4dbd-9370-9d2a72795781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:39.510016 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a3f14-026d-488c-b8a6-d5a9c621fff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:39.510122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4cf03-9011-4dbd-9370-9d2a72795781 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:39.510206 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a3f14-026d-488c-b8a6-d5a9c621fff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:39.510206 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a3f14-026d-488c-b8a6-d5a9c621fff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:39.510206 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a3f14-026d-488c-b8a6-d5a9c621fff3 admin admin] PATH_INFO: `/v3/projects/96bf98d3ccff45a1b322b4033e026856/users/f5453f8638164741abe074e920094b05/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:39.516977 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 994/1969] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:39.518055 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4cf03-9011-4dbd-9370-9d2a72795781 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:39.519770 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-5fd4cf03-9011-4dbd-9370-9d2a72795781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:39.523412 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a3f14-026d-488c-b8a6-d5a9c621fff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96bf98d3ccff45a1b322b4033e026856, user_id=f5453f8638164741abe074e920094b05, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:39.526094 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a3f14-026d-488c-b8a6-d5a9c621fff3 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:39.577968 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4cf03-9011-4dbd-9370-9d2a72795781 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:39.581593 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8469492-c231-4a7f-8632-7e1824d55a8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:39.582197 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8469492-c231-4a7f-8632-7e1824d55a8b service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:39.582481 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8469492-c231-4a7f-8632-7e1824d55a8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:39.582756 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8469492-c231-4a7f-8632-7e1824d55a8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:39.592641 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8469492-c231-4a7f-8632-7e1824d55a8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:39.594067 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8469492-c231-4a7f-8632-7e1824d55a8b service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:39.603639 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 995/1970] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:11:39.604546 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8469492-c231-4a7f-8632-7e1824d55a8b service neutron] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:39.614954 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8469492-c231-4a7f-8632-7e1824d55a8b service neutron] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:39.620249 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3a4bb5-1f6e-48fc-92aa-90e72ce63dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:39.620946 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a4bb5-1f6e-48fc-92aa-90e72ce63dc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:39.621342 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a4bb5-1f6e-48fc-92aa-90e72ce63dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:39.621737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3a4bb5-1f6e-48fc-92aa-90e72ce63dc2 admin admin] PATH_INFO: `/v3/projects/3b641e8a0cb44f22996c9938a0131197/users/a1316aa8e151437ea9e71510b7359715/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:39.623866 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a4bb5-1f6e-48fc-92aa-90e72ce63dc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b641e8a0cb44f22996c9938a0131197, user_id=a1316aa8e151437ea9e71510b7359715, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:39.626575 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3a4bb5-1f6e-48fc-92aa-90e72ce63dc2 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:39.629389 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 976/1971] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:11:39 2022] PUT /identity/v3/projects/96bf98d3ccff45a1b322b4033e026856/users/f5453f8638164741abe074e920094b05/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:39.640912 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7229d0-461c-436e-b60c-fd350700aa49 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:39.641123 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7229d0-461c-436e-b60c-fd350700aa49 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:39.641390 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7229d0-461c-436e-b60c-fd350700aa49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:39.646090 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 996/1972] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:11:39 2022] PUT /identity/v3/projects/3b641e8a0cb44f22996c9938a0131197/users/a1316aa8e151437ea9e71510b7359715/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:39.659241 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be056b-ae20-49be-af49-18be7b0e2095 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:39.659759 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be056b-ae20-49be-af49-18be7b0e2095 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:39.661045 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be056b-ae20-49be-af49-18be7b0e2095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:39.677621 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-2b7229d0-461c-436e-b60c-fd350700aa49 None None] MFA Rules not processed for user `f5453f8638164741abe074e920094b05`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:39.678965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-2b7229d0-461c-436e-b60c-fd350700aa49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:39.691525 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-c0be056b-ae20-49be-af49-18be7b0e2095 None None] MFA Rules not processed for user `a1316aa8e151437ea9e71510b7359715`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:39.692762 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-c0be056b-ae20-49be-af49-18be7b0e2095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:39.757391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 977/1973] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:39 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:11:39.769573 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7229d0-461c-436e-b60c-fd350700aa49 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:39.770929 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-2b7229d0-461c-436e-b60c-fd350700aa49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:39.779947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 997/1974] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:39 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:39.793091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be056b-ae20-49be-af49-18be7b0e2095 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:39.795473 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-c0be056b-ae20-49be-af49-18be7b0e2095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:39.840615 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7229d0-461c-436e-b60c-fd350700aa49 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:39.847537 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283ce35-c29d-477a-a2ef-278f757e6411 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:39.848445 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283ce35-c29d-477a-a2ef-278f757e6411 service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:39.848829 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283ce35-c29d-477a-a2ef-278f757e6411 service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:39.849407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0283ce35-c29d-477a-a2ef-278f757e6411 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:39.861961 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be056b-ae20-49be-af49-18be7b0e2095 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:39.865599 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50ffa1-9d75-4e7d-be82-c929f23b0103 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:39.866343 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50ffa1-9d75-4e7d-be82-c929f23b0103 service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:39.866752 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50ffa1-9d75-4e7d-be82-c929f23b0103 service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:39.867105 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283ce35-c29d-477a-a2ef-278f757e6411 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:39.867242 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50ffa1-9d75-4e7d-be82-c929f23b0103 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:39.869119 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0283ce35-c29d-477a-a2ef-278f757e6411 service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:39.876940 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-9a50ffa1-9d75-4e7d-be82-c929f23b0103 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:39.886316 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 978/1975] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:39 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:11:39.960153 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a50ffa1-9d75-4e7d-be82-c929f23b0103 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:39.962979 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a50ffa1-9d75-4e7d-be82-c929f23b0103 service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:39.982602 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 998/1976] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:11:40.142857 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:40.179102 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283ce35-c29d-477a-a2ef-278f757e6411 service cinder] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:40.183142 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-0283ce35-c29d-477a-a2ef-278f757e6411 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:40.213846 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:40.265584 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0283ce35-c29d-477a-a2ef-278f757e6411 service cinder] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:40.270407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b1ac0-ca21-40cc-956f-c95b621f88bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:40.271056 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b1ac0-ca21-40cc-956f-c95b621f88bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:40.271356 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b1ac0-ca21-40cc-956f-c95b621f88bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:40.271627 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b1ac0-ca21-40cc-956f-c95b621f88bd admin admin] PATH_INFO: `/v3/projects/92a93a22af9f4c06a571c32504afbf0a` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:40.272753 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b1ac0-ca21-40cc-956f-c95b621f88bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=92a93a22af9f4c06a571c32504afbf0a)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:40.274689 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b1ac0-ca21-40cc-956f-c95b621f88bd admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:40.446818 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-5b1b1ac0-ca21-40cc-956f-c95b621f88bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92a93a22af9f4c06a571c32504afbf0a', 'request_id': 'req-5b1b1ac0-ca21-40cc-956f-c95b621f88bd'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:40.454310 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-5b1b1ac0-ca21-40cc-956f-c95b621f88bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92a93a22af9f4c06a571c32504afbf0a', 'request_id': 'req-5b1b1ac0-ca21-40cc-956f-c95b621f88bd'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:40.461192 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-5b1b1ac0-ca21-40cc-956f-c95b621f88bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92a93a22af9f4c06a571c32504afbf0a', 'request_id': 'req-5b1b1ac0-ca21-40cc-956f-c95b621f88bd'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:40.613041 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-5b1b1ac0-ca21-40cc-956f-c95b621f88bd admin admin] The token cache is being invalidate because project 92a93a22af9f4c06a571c32504afbf0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:11:40.619173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-5b1b1ac0-ca21-40cc-956f-c95b621f88bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:40.619173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-5b1b1ac0-ca21-40cc-956f-c95b621f88bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:40.619173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 979/1977] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:11:40 2022] DELETE /identity/v3/projects/92a93a22af9f4c06a571c32504afbf0a => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:40.620318 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50ffa1-9d75-4e7d-be82-c929f23b0103 service cinder] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:40.632459 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50ffa1-9d75-4e7d-be82-c929f23b0103 service cinder] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:40.696272 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59d4d26-ac33-4113-b1ba-9fc4ca5cdbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:40.696909 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d4d26-ac33-4113-b1ba-9fc4ca5cdbc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:40.697092 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d4d26-ac33-4113-b1ba-9fc4ca5cdbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:40.697363 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59d4d26-ac33-4113-b1ba-9fc4ca5cdbc7 admin admin] PATH_INFO: `/v3/users/b925801793744b9cba3de0d4f446f180` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:40.698484 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d4d26-ac33-4113-b1ba-9fc4ca5cdbc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b925801793744b9cba3de0d4f446f180)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:40.701186 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59d4d26-ac33-4113-b1ba-9fc4ca5cdbc7 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:40.979833 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-f59d4d26-ac33-4113-b1ba-9fc4ca5cdbc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b925801793744b9cba3de0d4f446f180'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:40.988477 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-f59d4d26-ac33-4113-b1ba-9fc4ca5cdbc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b925801793744b9cba3de0d4f446f180'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:41.108815 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-f59d4d26-ac33-4113-b1ba-9fc4ca5cdbc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b925801793744b9cba3de0d4f446f180'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:41.109537 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-f59d4d26-ac33-4113-b1ba-9fc4ca5cdbc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b925801793744b9cba3de0d4f446f180'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:41.110170 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-f59d4d26-ac33-4113-b1ba-9fc4ca5cdbc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b925801793744b9cba3de0d4f446f180'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:41.135399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 999/1978] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:11:40 2022] DELETE /identity/v3/users/b925801793744b9cba3de0d4f446f180 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:41.646575 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:41.653983 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b1ac0-ca21-40cc-956f-c95b621f88bd admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:41.657650 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-5b1b1ac0-ca21-40cc-956f-c95b621f88bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:41.673859 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b1ac0-ca21-40cc-956f-c95b621f88bd admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:41.743185 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a6289a-9052-4597-8f65-eb7ad69b084c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:41.743866 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6289a-9052-4597-8f65-eb7ad69b084c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:41.744231 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6289a-9052-4597-8f65-eb7ad69b084c admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:41.744569 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a6289a-9052-4597-8f65-eb7ad69b084c admin admin] PATH_INFO: `/v3/projects/b8edf28822a1401d849f966f7e1dc785` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:41.745896 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a6289a-9052-4597-8f65-eb7ad69b084c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8edf28822a1401d849f966f7e1dc785)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:41.748791 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a6289a-9052-4597-8f65-eb7ad69b084c admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:41.806558 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:41.876431 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-f0a6289a-9052-4597-8f65-eb7ad69b084c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8edf28822a1401d849f966f7e1dc785', 'request_id': 'req-f0a6289a-9052-4597-8f65-eb7ad69b084c'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:41.883309 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-f0a6289a-9052-4597-8f65-eb7ad69b084c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8edf28822a1401d849f966f7e1dc785', 'request_id': 'req-f0a6289a-9052-4597-8f65-eb7ad69b084c'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:41.890407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-f0a6289a-9052-4597-8f65-eb7ad69b084c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8edf28822a1401d849f966f7e1dc785', 'request_id': 'req-f0a6289a-9052-4597-8f65-eb7ad69b084c'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:41.976658 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-f0a6289a-9052-4597-8f65-eb7ad69b084c admin admin] The token cache is being invalidate because project b8edf28822a1401d849f966f7e1dc785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:11:41.976940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-f0a6289a-9052-4597-8f65-eb7ad69b084c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:41.977555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-f0a6289a-9052-4597-8f65-eb7ad69b084c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:41.979048 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 980/1979] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:11:41 2022] DELETE /identity/v3/projects/b8edf28822a1401d849f966f7e1dc785 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:41.985346 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae3e3f-76cb-4936-a091-04ad0423f48f None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:41.985844 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae3e3f-76cb-4936-a091-04ad0423f48f None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:41.985935 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae3e3f-76cb-4936-a091-04ad0423f48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:42.009135 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-80ae3e3f-76cb-4936-a091-04ad0423f48f None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:42.010408 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-80ae3e3f-76cb-4936-a091-04ad0423f48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:42.082234 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1000/1980] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:42.096677 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e29a0-bb1e-4380-8ec6-6bf3d760d080 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:42.096969 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e29a0-bb1e-4380-8ec6-6bf3d760d080 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:42.097253 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e29a0-bb1e-4380-8ec6-6bf3d760d080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:42.119838 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-993e29a0-bb1e-4380-8ec6-6bf3d760d080 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:42.121218 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-993e29a0-bb1e-4380-8ec6-6bf3d760d080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:42.131138 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 981/1981] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:42.135819 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae3e3f-76cb-4936-a091-04ad0423f48f None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:42.146892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae3e3f-76cb-4936-a091-04ad0423f48f None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:42.154357 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef8a2d-7153-431b-aba0-869899520e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:42.158680 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef8a2d-7153-431b-aba0-869899520e56 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:42.159044 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef8a2d-7153-431b-aba0-869899520e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:42.160600 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef8a2d-7153-431b-aba0-869899520e56 admin admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:42.161631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef8a2d-7153-431b-aba0-869899520e56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:11:42.161941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef8a2d-7153-431b-aba0-869899520e56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:42.163885 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef8a2d-7153-431b-aba0-869899520e56 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:42.176715 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1001/1982] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:11:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:11:42.181583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e29a0-bb1e-4380-8ec6-6bf3d760d080 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:42.192169 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e29a0-bb1e-4380-8ec6-6bf3d760d080 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:42.196974 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe5e1b-b733-402b-bcc4-e3d76b6a0434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:42.197591 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe5e1b-b733-402b-bcc4-e3d76b6a0434 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:42.197870 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe5e1b-b733-402b-bcc4-e3d76b6a0434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:42.198136 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe5e1b-b733-402b-bcc4-e3d76b6a0434 admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:42.198758 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe5e1b-b733-402b-bcc4-e3d76b6a0434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:42.201440 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe5e1b-b733-402b-bcc4-e3d76b6a0434 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:42.333426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 982/1983] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:11:42 2022] POST /identity/v3/projects => generated 365 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:42.337831 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef8a2d-7153-431b-aba0-869899520e56 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:42.348140 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef8a2d-7153-431b-aba0-869899520e56 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:42.368429 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:42.409483 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828dc630-482b-4edc-a300-c26aa2b68210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:42.410092 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dc630-482b-4edc-a300-c26aa2b68210 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:42.410368 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dc630-482b-4edc-a300-c26aa2b68210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:42.410636 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dc630-482b-4edc-a300-c26aa2b68210 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:42.411307 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828dc630-482b-4edc-a300-c26aa2b68210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:42.413260 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828dc630-482b-4edc-a300-c26aa2b68210 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:42.489171 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1002/1984] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:11:42 2022] POST /identity/v3/users => generated 283 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:42.493545 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe5e1b-b733-402b-bcc4-e3d76b6a0434 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:42.504650 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe5e1b-b733-402b-bcc4-e3d76b6a0434 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:42.510017 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839bae3-4eae-4fc5-8291-d3e07dd0b6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:42.510623 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839bae3-4eae-4fc5-8291-d3e07dd0b6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:42.510909 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839bae3-4eae-4fc5-8291-d3e07dd0b6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:42.511212 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839bae3-4eae-4fc5-8291-d3e07dd0b6f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:42.511859 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839bae3-4eae-4fc5-8291-d3e07dd0b6f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:42.513501 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839bae3-4eae-4fc5-8291-d3e07dd0b6f8 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:42.524811 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 983/1985] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:42.528443 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828dc630-482b-4edc-a300-c26aa2b68210 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:42.538897 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828dc630-482b-4edc-a300-c26aa2b68210 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:42.544521 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce0978-10c1-4060-a713-c7e3cf971361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:42.545186 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce0978-10c1-4060-a713-c7e3cf971361 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:42.545515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce0978-10c1-4060-a713-c7e3cf971361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:42.545791 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce0978-10c1-4060-a713-c7e3cf971361 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:42.546448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce0978-10c1-4060-a713-c7e3cf971361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:42.548202 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce0978-10c1-4060-a713-c7e3cf971361 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:42.566933 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1003/1986] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:42.571351 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839bae3-4eae-4fc5-8291-d3e07dd0b6f8 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:42.585050 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839bae3-4eae-4fc5-8291-d3e07dd0b6f8 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:42.592629 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7b31c-fbf4-4e25-b831-861dc994273c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:42.592730 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7b31c-fbf4-4e25-b831-861dc994273c admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:42.593096 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7b31c-fbf4-4e25-b831-861dc994273c admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:42.593380 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d7b31c-fbf4-4e25-b831-861dc994273c admin admin] PATH_INFO: `/v3/projects/0a4d5292681d4c258d4698bad1e01bac/users/e791a0c48ad04bdba052c31b7d3efdff/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:42.617776 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7b31c-fbf4-4e25-b831-861dc994273c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a4d5292681d4c258d4698bad1e01bac, user_id=e791a0c48ad04bdba052c31b7d3efdff, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:42.621667 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d7b31c-fbf4-4e25-b831-861dc994273c admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:42.721291 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 984/1987] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:11:42 2022] PUT /identity/v3/projects/0a4d5292681d4c258d4698bad1e01bac/users/e791a0c48ad04bdba052c31b7d3efdff/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:42.735985 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e3fc6-7a9a-409f-83e6-a771f8a95bba None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:42.736304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e3fc6-7a9a-409f-83e6-a771f8a95bba None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:42.736582 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2e3fc6-7a9a-409f-83e6-a771f8a95bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:42.773406 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-5f2e3fc6-7a9a-409f-83e6-a771f8a95bba None None] MFA Rules not processed for user `e791a0c48ad04bdba052c31b7d3efdff`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:42.774613 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-5f2e3fc6-7a9a-409f-83e6-a771f8a95bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:42.848839 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1004/1988] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:42.854104 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7b31c-fbf4-4e25-b831-861dc994273c admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:42.930657 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d7b31c-fbf4-4e25-b831-861dc994273c admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:42.936395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b60a5-7a90-4933-b631-04249997f3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:42.938566 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b60a5-7a90-4933-b631-04249997f3b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:42.938566 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b60a5-7a90-4933-b631-04249997f3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:42.938566 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b60a5-7a90-4933-b631-04249997f3b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:42.938566 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b60a5-7a90-4933-b631-04249997f3b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:42.940383 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b60a5-7a90-4933-b631-04249997f3b8 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:43.081647 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 985/1989] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:11:42 2022] POST /identity/v3/projects => generated 369 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:43.082919 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e3fc6-7a9a-409f-83e6-a771f8a95bba None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:43.094943 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2e3fc6-7a9a-409f-83e6-a771f8a95bba None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:43.115246 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:43.161743 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b4598-6a56-4a5c-b036-102ccfe78ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:43.162448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b4598-6a56-4a5c-b036-102ccfe78ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:43.162730 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b4598-6a56-4a5c-b036-102ccfe78ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:43.163002 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73b4598-6a56-4a5c-b036-102ccfe78ec0 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:43.163656 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b4598-6a56-4a5c-b036-102ccfe78ec0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:43.165592 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73b4598-6a56-4a5c-b036-102ccfe78ec0 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:43.194750 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:43.270115 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1005/1990] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:11:43 2022] POST /identity/v3/users => generated 291 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:43.274259 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b60a5-7a90-4933-b631-04249997f3b8 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:43.285440 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b60a5-7a90-4933-b631-04249997f3b8 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:43.290921 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8af1fb-15f6-4915-93d3-3f948c54ae10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:43.291573 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8af1fb-15f6-4915-93d3-3f948c54ae10 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:43.291851 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8af1fb-15f6-4915-93d3-3f948c54ae10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:43.292119 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8af1fb-15f6-4915-93d3-3f948c54ae10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:43.292851 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8af1fb-15f6-4915-93d3-3f948c54ae10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:43.295043 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8af1fb-15f6-4915-93d3-3f948c54ae10 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:43.306355 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 986/1991] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:43.311673 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b4598-6a56-4a5c-b036-102ccfe78ec0 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:43.322112 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73b4598-6a56-4a5c-b036-102ccfe78ec0 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:43.327333 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65ac53-6b05-4c9a-91ee-41660d7f005b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:43.327997 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65ac53-6b05-4c9a-91ee-41660d7f005b admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:43.328273 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65ac53-6b05-4c9a-91ee-41660d7f005b admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:43.328544 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee65ac53-6b05-4c9a-91ee-41660d7f005b admin admin] PATH_INFO: `/v3/projects/31d8d0d1f79a4a28934860e15fdcc278/users/20b46c2df3f0456c9bd25dfc29232d9d/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:43.344249 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65ac53-6b05-4c9a-91ee-41660d7f005b admin admin] RBAC: Authorizing `identity:create_grant(project_id=31d8d0d1f79a4a28934860e15fdcc278, user_id=20b46c2df3f0456c9bd25dfc29232d9d, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:43.347303 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee65ac53-6b05-4c9a-91ee-41660d7f005b admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:43.457746 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1006/1992] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:11:43 2022] PUT /identity/v3/projects/31d8d0d1f79a4a28934860e15fdcc278/users/20b46c2df3f0456c9bd25dfc29232d9d/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:43.462122 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8af1fb-15f6-4915-93d3-3f948c54ae10 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:43.473208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8af1fb-15f6-4915-93d3-3f948c54ae10 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:43.531306 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d4911-546b-4aad-bf98-869e88a4fd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:43.532089 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d4911-546b-4aad-bf98-869e88a4fd12 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:43.532374 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d4911-546b-4aad-bf98-869e88a4fd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:43.532648 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d4911-546b-4aad-bf98-869e88a4fd12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:43.533296 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d4911-546b-4aad-bf98-869e88a4fd12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:43.534921 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9d4911-546b-4aad-bf98-869e88a4fd12 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:43.546406 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 987/1993] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:43.550895 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65ac53-6b05-4c9a-91ee-41660d7f005b admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:43.561677 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee65ac53-6b05-4c9a-91ee-41660d7f005b admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:43.567370 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d7745-dfa2-4aa0-b749-df1a9edbac0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:43.569935 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d7745-dfa2-4aa0-b749-df1a9edbac0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:43.569935 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d7745-dfa2-4aa0-b749-df1a9edbac0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:43.569935 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d7745-dfa2-4aa0-b749-df1a9edbac0b admin admin] PATH_INFO: `/v3/projects/31d8d0d1f79a4a28934860e15fdcc278/users/20b46c2df3f0456c9bd25dfc29232d9d/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:43.570467 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d7745-dfa2-4aa0-b749-df1a9edbac0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=31d8d0d1f79a4a28934860e15fdcc278, user_id=20b46c2df3f0456c9bd25dfc29232d9d, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:43.573140 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d7745-dfa2-4aa0-b749-df1a9edbac0b admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:43.584424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1007/1994] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:11:43 2022] PUT /identity/v3/projects/31d8d0d1f79a4a28934860e15fdcc278/users/20b46c2df3f0456c9bd25dfc29232d9d/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:43.602743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8b12b-7cd0-42ac-a530-b7a2730386b6 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:43.602743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8b12b-7cd0-42ac-a530-b7a2730386b6 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:43.602743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8b12b-7cd0-42ac-a530-b7a2730386b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:43.627734 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-bab8b12b-7cd0-42ac-a530-b7a2730386b6 None None] MFA Rules not processed for user `20b46c2df3f0456c9bd25dfc29232d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:43.628757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-bab8b12b-7cd0-42ac-a530-b7a2730386b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:43.711842 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 988/1995] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:43 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:11:43.724157 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d7745-dfa2-4aa0-b749-df1a9edbac0b admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:43.727471 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-7d3d7745-dfa2-4aa0-b749-df1a9edbac0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:43.791432 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d7745-dfa2-4aa0-b749-df1a9edbac0b admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:43.796260 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49b235-2092-411f-9670-65c089fba330 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:43.796881 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49b235-2092-411f-9670-65c089fba330 service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:43.797158 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49b235-2092-411f-9670-65c089fba330 service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:43.797477 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49b235-2092-411f-9670-65c089fba330 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:43.807477 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49b235-2092-411f-9670-65c089fba330 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:43.808957 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49b235-2092-411f-9670-65c089fba330 service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:43.818792 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1008/1996] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:43 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:11:44.280588 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8b12b-7cd0-42ac-a530-b7a2730386b6 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:44.291971 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8b12b-7cd0-42ac-a530-b7a2730386b6 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:44.293066 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:44.298506 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780d25a-bd37-44a9-9641-8f38f58929a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:44.299446 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780d25a-bd37-44a9-9641-8f38f58929a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:44.299793 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780d25a-bd37-44a9-9641-8f38f58929a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:44.300261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780d25a-bd37-44a9-9641-8f38f58929a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:44.309120 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-6780d25a-bd37-44a9-9641-8f38f58929a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:44.423808 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780d25a-bd37-44a9-9641-8f38f58929a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:44.425420 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6780d25a-bd37-44a9-9641-8f38f58929a0 service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:44.436772 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 989/1997] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:44 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:11:45.360268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:46.548587 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:47.272912 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c1afa-0587-44b0-9b94-b2bdd8ede1e6 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:47.272912 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c1afa-0587-44b0-9b94-b2bdd8ede1e6 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:47.273427 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c1afa-0587-44b0-9b94-b2bdd8ede1e6 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:47.275974 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:47.288861 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1009/1998] 10.222.0.55 () {54 vars in 921 bytes} [Wed Aug 24 17:11:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:11:47.297217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c07bd5-3556-4d88-930d-3f9a02eb06cb None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:47.298056 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c07bd5-3556-4d88-930d-3f9a02eb06cb None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:47.298346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c07bd5-3556-4d88-930d-3f9a02eb06cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:47.336936 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-63c07bd5-3556-4d88-930d-3f9a02eb06cb None None] MFA Rules not processed for user `32ef97356edf406aad9ab5f502bdb0af`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:47.336936 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-63c07bd5-3556-4d88-930d-3f9a02eb06cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:47.423582 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 990/1999] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Aug 24 17:11:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:47.441456 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c1afa-0587-44b0-9b94-b2bdd8ede1e6 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:47.443858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-144c1afa-0587-44b0-9b94-b2bdd8ede1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:47.455247 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c07bd5-3556-4d88-930d-3f9a02eb06cb None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:47.456836 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-63c07bd5-3556-4d88-930d-3f9a02eb06cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:47.477270 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c1afa-0587-44b0-9b94-b2bdd8ede1e6 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:47.482635 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215390b7-ab6d-454e-b252-f7371067f55a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ef97356edf406aad9ab5f502bdb0af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:47.483749 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215390b7-ab6d-454e-b252-f7371067f55a service placement] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:47.484128 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215390b7-ab6d-454e-b252-f7371067f55a service placement] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:47.484417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215390b7-ab6d-454e-b252-f7371067f55a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:47.498810 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215390b7-ab6d-454e-b252-f7371067f55a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:47.504022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215390b7-ab6d-454e-b252-f7371067f55a service placement] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:47.512509 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1010/2000] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:11:47.589204 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c07bd5-3556-4d88-930d-3f9a02eb06cb None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:47.601417 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48512f9-85c3-42f3-9948-adc9118935e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:47.602340 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48512f9-85c3-42f3-9948-adc9118935e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:47.602711 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48512f9-85c3-42f3-9948-adc9118935e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:47.603101 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48512f9-85c3-42f3-9948-adc9118935e7 admin admin] PATH_INFO: `/v3/users/f2e414a711f74b20a0eb0f89bb2bf6f7` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:47.604604 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48512f9-85c3-42f3-9948-adc9118935e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2e414a711f74b20a0eb0f89bb2bf6f7)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:47.606938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48512f9-85c3-42f3-9948-adc9118935e7 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:47.974243 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-a48512f9-85c3-42f3-9948-adc9118935e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2e414a711f74b20a0eb0f89bb2bf6f7'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:47.974820 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-a48512f9-85c3-42f3-9948-adc9118935e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2e414a711f74b20a0eb0f89bb2bf6f7'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:47.982727 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-a48512f9-85c3-42f3-9948-adc9118935e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2e414a711f74b20a0eb0f89bb2bf6f7'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:47.983434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-a48512f9-85c3-42f3-9948-adc9118935e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2e414a711f74b20a0eb0f89bb2bf6f7'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:48.103938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-a48512f9-85c3-42f3-9948-adc9118935e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2e414a711f74b20a0eb0f89bb2bf6f7'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:48.164065 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 991/2001] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:11:47 2022] DELETE /identity/v3/users/f2e414a711f74b20a0eb0f89bb2bf6f7 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:48.440947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215390b7-ab6d-454e-b252-f7371067f55a service placement] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:48.475932 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215390b7-ab6d-454e-b252-f7371067f55a service placement] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:48.478837 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48512f9-85c3-42f3-9948-adc9118935e7 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:48.480328 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-a48512f9-85c3-42f3-9948-adc9118935e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:48.570636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48512f9-85c3-42f3-9948-adc9118935e7 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:48.571798 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bfd1ef-fc42-4107-8870-e71662352ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:48.572533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfd1ef-fc42-4107-8870-e71662352ed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:48.572893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfd1ef-fc42-4107-8870-e71662352ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:48.573234 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bfd1ef-fc42-4107-8870-e71662352ed1 admin admin] PATH_INFO: `/v3/users/e791a0c48ad04bdba052c31b7d3efdff` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:48.574402 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bfd1ef-fc42-4107-8870-e71662352ed1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e791a0c48ad04bdba052c31b7d3efdff)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:48.575315 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e5abc-cf7d-4f7f-b5c2-91361e2c9899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:48.576556 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e5abc-cf7d-4f7f-b5c2-91361e2c9899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:48.579632 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e5abc-cf7d-4f7f-b5c2-91361e2c9899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:48.579765 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bfd1ef-fc42-4107-8870-e71662352ed1 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:48.579863 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e5abc-cf7d-4f7f-b5c2-91361e2c9899 admin admin] PATH_INFO: `/v3/projects/2754140684a847fa9592df3e16aa42df` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:48.579863 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e5abc-cf7d-4f7f-b5c2-91361e2c9899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2754140684a847fa9592df3e16aa42df)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:48.581266 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e5abc-cf7d-4f7f-b5c2-91361e2c9899 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:48.785167 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:48.797804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-d09e5abc-cf7d-4f7f-b5c2-91361e2c9899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2754140684a847fa9592df3e16aa42df', 'request_id': 'req-d09e5abc-cf7d-4f7f-b5c2-91361e2c9899'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:48.799502 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-a8bfd1ef-fc42-4107-8870-e71662352ed1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e791a0c48ad04bdba052c31b7d3efdff'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:48.803724 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-d09e5abc-cf7d-4f7f-b5c2-91361e2c9899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2754140684a847fa9592df3e16aa42df', 'request_id': 'req-d09e5abc-cf7d-4f7f-b5c2-91361e2c9899'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:48.806811 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-a8bfd1ef-fc42-4107-8870-e71662352ed1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e791a0c48ad04bdba052c31b7d3efdff'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:48.810479 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-d09e5abc-cf7d-4f7f-b5c2-91361e2c9899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2754140684a847fa9592df3e16aa42df', 'request_id': 'req-d09e5abc-cf7d-4f7f-b5c2-91361e2c9899'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:48.891348 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-a8bfd1ef-fc42-4107-8870-e71662352ed1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e791a0c48ad04bdba052c31b7d3efdff'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:48.892056 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-a8bfd1ef-fc42-4107-8870-e71662352ed1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e791a0c48ad04bdba052c31b7d3efdff'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:48.892994 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-a8bfd1ef-fc42-4107-8870-e71662352ed1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e791a0c48ad04bdba052c31b7d3efdff'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:48.933475 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1011/2002] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:11:48 2022] DELETE /identity/v3/users/e791a0c48ad04bdba052c31b7d3efdff => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:48.938221 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da68d4-f084-44e9-bbc3-eefc5055af83 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:48.938512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da68d4-f084-44e9-bbc3-eefc5055af83 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:48.938819 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da68d4-f084-44e9-bbc3-eefc5055af83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:48.958738 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-46da68d4-f084-44e9-bbc3-eefc5055af83 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:48.960022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-46da68d4-f084-44e9-bbc3-eefc5055af83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:48.966743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-d09e5abc-cf7d-4f7f-b5c2-91361e2c9899 admin admin] The token cache is being invalidate because project 2754140684a847fa9592df3e16aa42df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:11:48.967551 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-d09e5abc-cf7d-4f7f-b5c2-91361e2c9899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:48.968203 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-d09e5abc-cf7d-4f7f-b5c2-91361e2c9899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:48.973387 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 992/2003] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:11:48 2022] DELETE /identity/v3/projects/2754140684a847fa9592df3e16aa42df => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:11:48.973387 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:48.977098 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54068450-a3f7-442c-b417-a041b3b9e68e None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:48.977292 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54068450-a3f7-442c-b417-a041b3b9e68e None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:48.977547 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54068450-a3f7-442c-b417-a041b3b9e68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:48.998340 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-54068450-a3f7-442c-b417-a041b3b9e68e None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:49.000299 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-54068450-a3f7-442c-b417-a041b3b9e68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:49.027470 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1012/2004] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:11:49.038235 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da68d4-f084-44e9-bbc3-eefc5055af83 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:49.039679 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-46da68d4-f084-44e9-bbc3-eefc5055af83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:49.064370 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 993/2005] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:11:49.073150 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7bf01-3bbb-44d6-9a43-8f1a56578191 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:49.073433 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7bf01-3bbb-44d6-9a43-8f1a56578191 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:49.073883 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a7bf01-3bbb-44d6-9a43-8f1a56578191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:49.095233 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-10a7bf01-3bbb-44d6-9a43-8f1a56578191 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:49.096633 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-10a7bf01-3bbb-44d6-9a43-8f1a56578191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:49.100665 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da68d4-f084-44e9-bbc3-eefc5055af83 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:49.104657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7b15c-69fd-48e7-901a-0bec5929ed48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:49.107829 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 994/2006] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:11:49.108052 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7b15c-69fd-48e7-901a-0bec5929ed48 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:49.108052 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7b15c-69fd-48e7-901a-0bec5929ed48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:49.108052 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7b15c-69fd-48e7-901a-0bec5929ed48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:49.110741 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a7bf01-3bbb-44d6-9a43-8f1a56578191 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:49.117434 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7b15c-69fd-48e7-901a-0bec5929ed48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:49.118864 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7b15c-69fd-48e7-901a-0bec5929ed48 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:49.120033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a7bf01-3bbb-44d6-9a43-8f1a56578191 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:49.125434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab9977-fffd-49b5-9f9b-1af3f17e9512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:49.126085 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab9977-fffd-49b5-9f9b-1af3f17e9512 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:49.126363 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab9977-fffd-49b5-9f9b-1af3f17e9512 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:49.126629 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eab9977-fffd-49b5-9f9b-1af3f17e9512 admin admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:49.127308 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab9977-fffd-49b5-9f9b-1af3f17e9512 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:11:49.127622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab9977-fffd-49b5-9f9b-1af3f17e9512 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:49.129207 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eab9977-fffd-49b5-9f9b-1af3f17e9512 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:49.130351 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1013/2007] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:11:49.142813 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 995/2008] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:11:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:11:49.147398 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7b15c-69fd-48e7-901a-0bec5929ed48 service neutron] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:49.157700 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7b15c-69fd-48e7-901a-0bec5929ed48 service neutron] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:49.162679 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2e187-95a0-483c-86da-b7fae8a1b560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:49.163310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2e187-95a0-483c-86da-b7fae8a1b560 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:49.163597 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2e187-95a0-483c-86da-b7fae8a1b560 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:49.163868 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2e187-95a0-483c-86da-b7fae8a1b560 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:49.164503 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2e187-95a0-483c-86da-b7fae8a1b560 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:49.166944 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a2e187-95a0-483c-86da-b7fae8a1b560 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:49.300560 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1014/2009] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:11:49 2022] POST /identity/v3/projects => generated 367 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:11:49.302001 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab9977-fffd-49b5-9f9b-1af3f17e9512 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:49.314634 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eab9977-fffd-49b5-9f9b-1af3f17e9512 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:49.396126 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b43596-3a5a-4cc6-949f-7602ba6ede0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:49.396762 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b43596-3a5a-4cc6-949f-7602ba6ede0b admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:49.397049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b43596-3a5a-4cc6-949f-7602ba6ede0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:49.397355 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b43596-3a5a-4cc6-949f-7602ba6ede0b admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:49.398019 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b43596-3a5a-4cc6-949f-7602ba6ede0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:49.400221 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b43596-3a5a-4cc6-949f-7602ba6ede0b admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:49.498030 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 996/2010] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:11:49 2022] POST /identity/v3/users => generated 284 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:49.502342 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2e187-95a0-483c-86da-b7fae8a1b560 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:49.512995 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2e187-95a0-483c-86da-b7fae8a1b560 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:49.517684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f21cd4-e375-4533-a831-86af503a86c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:49.518286 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f21cd4-e375-4533-a831-86af503a86c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:49.518730 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f21cd4-e375-4533-a831-86af503a86c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:49.518948 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f21cd4-e375-4533-a831-86af503a86c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:49.519627 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f21cd4-e375-4533-a831-86af503a86c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:49.521202 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f21cd4-e375-4533-a831-86af503a86c1 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:49.532240 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1015/2011] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:49.536220 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b43596-3a5a-4cc6-949f-7602ba6ede0b admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:49.546944 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b43596-3a5a-4cc6-949f-7602ba6ede0b admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:49.551779 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b0f60-9021-4c17-afad-a9b7678a4fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:49.552317 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b0f60-9021-4c17-afad-a9b7678a4fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:49.552625 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b0f60-9021-4c17-afad-a9b7678a4fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:49.552895 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73b0f60-9021-4c17-afad-a9b7678a4fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:49.553537 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b0f60-9021-4c17-afad-a9b7678a4fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:49.555163 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73b0f60-9021-4c17-afad-a9b7678a4fd2 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:49.567902 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 997/2012] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:49.572563 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f21cd4-e375-4533-a831-86af503a86c1 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:49.579609 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b0f60-9021-4c17-afad-a9b7678a4fd2 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:49.581545 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-b73b0f60-9021-4c17-afad-a9b7678a4fd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:49.584309 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f21cd4-e375-4533-a831-86af503a86c1 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:49.590338 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef5778-610a-408a-a326-e4e4d8993378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:49.591806 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef5778-610a-408a-a326-e4e4d8993378 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:49.592910 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef5778-610a-408a-a326-e4e4d8993378 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:49.593196 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef5778-610a-408a-a326-e4e4d8993378 admin admin] PATH_INFO: `/v3/projects/4ccd03d18c9b43e38e808f755e531ea6/users/4eb2f51d1b38447cb1aa06b9d82fb954/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:49.600757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73b0f60-9021-4c17-afad-a9b7678a4fd2 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:49.607598 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae450c4e-9960-4307-99cb-437d460df626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:49.608734 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae450c4e-9960-4307-99cb-437d460df626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:49.608961 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae450c4e-9960-4307-99cb-437d460df626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:49.609236 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae450c4e-9960-4307-99cb-437d460df626 admin admin] PATH_INFO: `/v3/projects/0a4d5292681d4c258d4698bad1e01bac` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:49.610483 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae450c4e-9960-4307-99cb-437d460df626 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a4d5292681d4c258d4698bad1e01bac)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:49.612082 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef5778-610a-408a-a326-e4e4d8993378 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ccd03d18c9b43e38e808f755e531ea6, user_id=4eb2f51d1b38447cb1aa06b9d82fb954, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:49.612418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae450c4e-9960-4307-99cb-437d460df626 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:49.615174 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef5778-610a-408a-a326-e4e4d8993378 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:49.709543 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1016/2013] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:11:49 2022] PUT /identity/v3/projects/4ccd03d18c9b43e38e808f755e531ea6/users/4eb2f51d1b38447cb1aa06b9d82fb954/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:49.720020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ff7cc-13ca-4505-8a19-271562ce97eb None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:49.720313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ff7cc-13ca-4505-8a19-271562ce97eb None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:49.720604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ff7cc-13ca-4505-8a19-271562ce97eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:49.751264 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-952ff7cc-13ca-4505-8a19-271562ce97eb None None] MFA Rules not processed for user `4eb2f51d1b38447cb1aa06b9d82fb954`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:49.752570 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-952ff7cc-13ca-4505-8a19-271562ce97eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:49.767427 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-ae450c4e-9960-4307-99cb-437d460df626 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a4d5292681d4c258d4698bad1e01bac', 'request_id': 'req-ae450c4e-9960-4307-99cb-437d460df626'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:49.773460 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-ae450c4e-9960-4307-99cb-437d460df626 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a4d5292681d4c258d4698bad1e01bac', 'request_id': 'req-ae450c4e-9960-4307-99cb-437d460df626'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:49.780899 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-ae450c4e-9960-4307-99cb-437d460df626 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a4d5292681d4c258d4698bad1e01bac', 'request_id': 'req-ae450c4e-9960-4307-99cb-437d460df626'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:49.824943 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1017/2014] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:11:49.835855 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ff7cc-13ca-4505-8a19-271562ce97eb None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:49.837203 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-952ff7cc-13ca-4505-8a19-271562ce97eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:49.889340 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-ae450c4e-9960-4307-99cb-437d460df626 admin admin] The token cache is being invalidate because project 0a4d5292681d4c258d4698bad1e01bac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:11:49.889340 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-ae450c4e-9960-4307-99cb-437d460df626 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:49.889340 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-ae450c4e-9960-4307-99cb-437d460df626 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:49.890463 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 998/2015] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:11:49 2022] DELETE /identity/v3/projects/0a4d5292681d4c258d4698bad1e01bac => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:11:49.896057 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae450c4e-9960-4307-99cb-437d460df626 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:49.897631 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-ae450c4e-9960-4307-99cb-437d460df626 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:49.898837 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ff7cc-13ca-4505-8a19-271562ce97eb None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:49.903681 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53cfd7-57c6-4be5-a817-f74cd186b7e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:49.904168 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53cfd7-57c6-4be5-a817-f74cd186b7e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:49.904446 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53cfd7-57c6-4be5-a817-f74cd186b7e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:49.904715 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f53cfd7-57c6-4be5-a817-f74cd186b7e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:49.906709 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-6f53cfd7-57c6-4be5-a817-f74cd186b7e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:49.918372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53cfd7-57c6-4be5-a817-f74cd186b7e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:49.920472 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f53cfd7-57c6-4be5-a817-f74cd186b7e2 service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:49.930369 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1018/2016] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:11:49.975227 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae450c4e-9960-4307-99cb-437d460df626 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:49.978032 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df39194-a169-49b4-b641-72e993d3fe91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:49.978698 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df39194-a169-49b4-b641-72e993d3fe91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:49.979054 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df39194-a169-49b4-b641-72e993d3fe91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:49.979570 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df39194-a169-49b4-b641-72e993d3fe91 admin admin] PATH_INFO: `/v3/users/20b46c2df3f0456c9bd25dfc29232d9d` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:49.980733 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df39194-a169-49b4-b641-72e993d3fe91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20b46c2df3f0456c9bd25dfc29232d9d)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:49.983738 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df39194-a169-49b4-b641-72e993d3fe91 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:50.183957 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-1df39194-a169-49b4-b641-72e993d3fe91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20b46c2df3f0456c9bd25dfc29232d9d'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:50.184874 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-1df39194-a169-49b4-b641-72e993d3fe91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20b46c2df3f0456c9bd25dfc29232d9d'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:50.192201 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-1df39194-a169-49b4-b641-72e993d3fe91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20b46c2df3f0456c9bd25dfc29232d9d'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:50.192952 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-1df39194-a169-49b4-b641-72e993d3fe91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20b46c2df3f0456c9bd25dfc29232d9d'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:50.292067 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-1df39194-a169-49b4-b641-72e993d3fe91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20b46c2df3f0456c9bd25dfc29232d9d'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:50.315742 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 999/2017] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:11:49 2022] DELETE /identity/v3/users/20b46c2df3f0456c9bd25dfc29232d9d => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:11:50.492253 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:50.538309 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:50.817901 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53cfd7-57c6-4be5-a817-f74cd186b7e2 service cinder] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:50.831659 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f53cfd7-57c6-4be5-a817-f74cd186b7e2 service cinder] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:50.910984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74e70d-2e25-46c7-8fe0-52d118d835a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:50.911671 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74e70d-2e25-46c7-8fe0-52d118d835a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:50.911954 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74e70d-2e25-46c7-8fe0-52d118d835a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:50.912242 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74e70d-2e25-46c7-8fe0-52d118d835a3 admin admin] PATH_INFO: `/v3/projects/31d8d0d1f79a4a28934860e15fdcc278` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:50.913579 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74e70d-2e25-46c7-8fe0-52d118d835a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31d8d0d1f79a4a28934860e15fdcc278)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:50.915542 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74e70d-2e25-46c7-8fe0-52d118d835a3 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:51.064847 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-bf74e70d-2e25-46c7-8fe0-52d118d835a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31d8d0d1f79a4a28934860e15fdcc278', 'request_id': 'req-bf74e70d-2e25-46c7-8fe0-52d118d835a3'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:51.070728 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-bf74e70d-2e25-46c7-8fe0-52d118d835a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31d8d0d1f79a4a28934860e15fdcc278', 'request_id': 'req-bf74e70d-2e25-46c7-8fe0-52d118d835a3'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:51.155495 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-bf74e70d-2e25-46c7-8fe0-52d118d835a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31d8d0d1f79a4a28934860e15fdcc278', 'request_id': 'req-bf74e70d-2e25-46c7-8fe0-52d118d835a3'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:51.167939 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-bf74e70d-2e25-46c7-8fe0-52d118d835a3 admin admin] The token cache is being invalidate because project 31d8d0d1f79a4a28934860e15fdcc278 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:11:51.168236 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-bf74e70d-2e25-46c7-8fe0-52d118d835a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:51.168885 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-bf74e70d-2e25-46c7-8fe0-52d118d835a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:51.171232 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1019/2018] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:11:50 2022] DELETE /identity/v3/projects/31d8d0d1f79a4a28934860e15fdcc278 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:11:51.176194 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087efa38-44c1-4ff8-bc33-a0bfff35de4b None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:51.177833 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087efa38-44c1-4ff8-bc33-a0bfff35de4b None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:51.177833 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087efa38-44c1-4ff8-bc33-a0bfff35de4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:51.196525 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-087efa38-44c1-4ff8-bc33-a0bfff35de4b None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:51.197739 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-087efa38-44c1-4ff8-bc33-a0bfff35de4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:51.300012 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1000/2019] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:51.317034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc07c0-d93f-4e77-a4b4-3d4fd4e85861 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:51.321447 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc07c0-d93f-4e77-a4b4-3d4fd4e85861 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:51.321447 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fc07c0-d93f-4e77-a4b4-3d4fd4e85861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:51.325034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:51.343706 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-38fc07c0-d93f-4e77-a4b4-3d4fd4e85861 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:51.345209 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-38fc07c0-d93f-4e77-a4b4-3d4fd4e85861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:51.354284 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1020/2020] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:11:51.359007 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087efa38-44c1-4ff8-bc33-a0bfff35de4b None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:51.371369 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087efa38-44c1-4ff8-bc33-a0bfff35de4b None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:51.376980 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4ccf9-f354-485e-a21d-8a052ced062d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:51.377726 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4ccf9-f354-485e-a21d-8a052ced062d admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:51.378080 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4ccf9-f354-485e-a21d-8a052ced062d admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:51.378422 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4ccf9-f354-485e-a21d-8a052ced062d admin admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:51.379252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4ccf9-f354-485e-a21d-8a052ced062d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:11:51.379702 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4ccf9-f354-485e-a21d-8a052ced062d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:51.381532 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4ccf9-f354-485e-a21d-8a052ced062d admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:51.395054 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1001/2021] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:11:51.399857 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc07c0-d93f-4e77-a4b4-3d4fd4e85861 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:51.410142 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fc07c0-d93f-4e77-a4b4-3d4fd4e85861 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:51.414968 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9da57-5497-4696-a2b2-f89612bf5015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:51.415677 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9da57-5497-4696-a2b2-f89612bf5015 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:51.415962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9da57-5497-4696-a2b2-f89612bf5015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:51.416238 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9da57-5497-4696-a2b2-f89612bf5015 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:51.416869 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9da57-5497-4696-a2b2-f89612bf5015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:51.418777 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9da57-5497-4696-a2b2-f89612bf5015 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:51.534104 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1021/2022] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:11:51 2022] POST /identity/v3/projects => generated 387 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:51.538726 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4ccf9-f354-485e-a21d-8a052ced062d admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:51.551456 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4ccf9-f354-485e-a21d-8a052ced062d admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:51.615065 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa0b87-e05d-4399-932e-b577a3dfac05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:51.615735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa0b87-e05d-4399-932e-b577a3dfac05 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:51.616012 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa0b87-e05d-4399-932e-b577a3dfac05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:51.616478 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa0b87-e05d-4399-932e-b577a3dfac05 admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:51.617126 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa0b87-e05d-4399-932e-b577a3dfac05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:51.619075 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa0b87-e05d-4399-932e-b577a3dfac05 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:51.745235 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1002/2023] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:11:51 2022] POST /identity/v3/users => generated 294 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:51.750588 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9da57-5497-4696-a2b2-f89612bf5015 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:51.761555 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9da57-5497-4696-a2b2-f89612bf5015 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:51.766503 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e89427-fbfd-4487-ad9d-fd35eb244202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:51.767173 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e89427-fbfd-4487-ad9d-fd35eb244202 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:51.767480 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e89427-fbfd-4487-ad9d-fd35eb244202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:51.767884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e89427-fbfd-4487-ad9d-fd35eb244202 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:51.768484 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e89427-fbfd-4487-ad9d-fd35eb244202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:51.770098 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e89427-fbfd-4487-ad9d-fd35eb244202 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:51.782403 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1022/2024] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:51.790306 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa0b87-e05d-4399-932e-b577a3dfac05 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:51.804131 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa0b87-e05d-4399-932e-b577a3dfac05 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:51.809776 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227a174-f3e5-4231-9e0c-a00a60898eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:51.810356 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227a174-f3e5-4231-9e0c-a00a60898eec admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:51.810708 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227a174-f3e5-4231-9e0c-a00a60898eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:51.811022 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227a174-f3e5-4231-9e0c-a00a60898eec admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:51.811799 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9227a174-f3e5-4231-9e0c-a00a60898eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:51.813759 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9227a174-f3e5-4231-9e0c-a00a60898eec admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:51.826941 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1003/2025] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:51.832043 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e89427-fbfd-4487-ad9d-fd35eb244202 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:51.844267 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e89427-fbfd-4487-ad9d-fd35eb244202 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:51.848903 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1619e-d02b-45ff-b024-cc02d05cdeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:51.849564 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1619e-d02b-45ff-b024-cc02d05cdeb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:51.849846 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1619e-d02b-45ff-b024-cc02d05cdeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:51.850115 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1619e-d02b-45ff-b024-cc02d05cdeb4 admin admin] PATH_INFO: `/v3/projects/77407ef1e24e4b6687ef8c350d963d25/users/794b858940b046dfbf5006b6ae50d13a/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:51.866775 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1619e-d02b-45ff-b024-cc02d05cdeb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77407ef1e24e4b6687ef8c350d963d25, user_id=794b858940b046dfbf5006b6ae50d13a, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:51.869489 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1619e-d02b-45ff-b024-cc02d05cdeb4 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:52.183466 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:52.189647 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1023/2026] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:11:51 2022] PUT /identity/v3/projects/77407ef1e24e4b6687ef8c350d963d25/users/794b858940b046dfbf5006b6ae50d13a/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:52.202339 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e4895-12f3-4a5d-8a41-1b75a9064daa None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:52.209875 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e4895-12f3-4a5d-8a41-1b75a9064daa None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:52.210384 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e4895-12f3-4a5d-8a41-1b75a9064daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:52.253289 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-994e4895-12f3-4a5d-8a41-1b75a9064daa None None] MFA Rules not processed for user `794b858940b046dfbf5006b6ae50d13a`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:52.254657 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-994e4895-12f3-4a5d-8a41-1b75a9064daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:52.324481 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1004/2027] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:52.329484 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1619e-d02b-45ff-b024-cc02d05cdeb4 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:52.399527 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1619e-d02b-45ff-b024-cc02d05cdeb4 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:52.404267 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f9ed6-b579-4026-bd47-770ad7b65620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:52.404878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f9ed6-b579-4026-bd47-770ad7b65620 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:52.405154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f9ed6-b579-4026-bd47-770ad7b65620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:52.405449 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3f9ed6-b579-4026-bd47-770ad7b65620 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:52.406116 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f9ed6-b579-4026-bd47-770ad7b65620 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:52.408091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3f9ed6-b579-4026-bd47-770ad7b65620 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:52.477194 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1024/2028] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:11:52 2022] POST /identity/v3/projects => generated 385 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:52.478339 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e4895-12f3-4a5d-8a41-1b75a9064daa None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:52.480898 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:52.494372 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e4895-12f3-4a5d-8a41-1b75a9064daa None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:52.561229 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073b19a-94ed-4d5f-9437-15a9ac4677eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:52.562240 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073b19a-94ed-4d5f-9437-15a9ac4677eb admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:52.562586 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073b19a-94ed-4d5f-9437-15a9ac4677eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:52.562928 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073b19a-94ed-4d5f-9437-15a9ac4677eb admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:52.563682 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073b19a-94ed-4d5f-9437-15a9ac4677eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:52.565693 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2073b19a-94ed-4d5f-9437-15a9ac4677eb admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:52.653056 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1005/2029] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:11:52 2022] POST /identity/v3/users => generated 299 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:52.658081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f9ed6-b579-4026-bd47-770ad7b65620 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:52.675213 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3f9ed6-b579-4026-bd47-770ad7b65620 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:52.682214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f894fb-8171-4eff-bc9e-30b6af0e925e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:52.683028 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f894fb-8171-4eff-bc9e-30b6af0e925e admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:52.683536 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f894fb-8171-4eff-bc9e-30b6af0e925e admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:52.683811 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f894fb-8171-4eff-bc9e-30b6af0e925e admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:52.684654 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f894fb-8171-4eff-bc9e-30b6af0e925e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:52.686534 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f894fb-8171-4eff-bc9e-30b6af0e925e admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:52.704607 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073b19a-94ed-4d5f-9437-15a9ac4677eb admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:52.709835 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1025/2030] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:52.716979 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2073b19a-94ed-4d5f-9437-15a9ac4677eb admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:52.722493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254377c-3aaf-4bb2-bf33-a13d11b8b346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:52.723608 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254377c-3aaf-4bb2-bf33-a13d11b8b346 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:52.723894 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254377c-3aaf-4bb2-bf33-a13d11b8b346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:52.724377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d254377c-3aaf-4bb2-bf33-a13d11b8b346 admin admin] PATH_INFO: `/v3/projects/a703a471d05446d08c0ccc21994a070c/users/f5ecf36528bd4a08a46d019d47fbc722/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:52.743021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d254377c-3aaf-4bb2-bf33-a13d11b8b346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a703a471d05446d08c0ccc21994a070c, user_id=f5ecf36528bd4a08a46d019d47fbc722, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:52.745858 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d254377c-3aaf-4bb2-bf33-a13d11b8b346 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:52.911741 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1006/2031] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:11:52 2022] PUT /identity/v3/projects/a703a471d05446d08c0ccc21994a070c/users/f5ecf36528bd4a08a46d019d47fbc722/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:52.914591 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f894fb-8171-4eff-bc9e-30b6af0e925e admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:52.925674 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f894fb-8171-4eff-bc9e-30b6af0e925e admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:52.993721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff76b4-2eb5-4693-a0c4-2a839262e431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:52.994239 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff76b4-2eb5-4693-a0c4-2a839262e431 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:52.994589 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff76b4-2eb5-4693-a0c4-2a839262e431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:52.994869 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff76b4-2eb5-4693-a0c4-2a839262e431 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:52.995539 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff76b4-2eb5-4693-a0c4-2a839262e431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:52.997147 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff76b4-2eb5-4693-a0c4-2a839262e431 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:53.007876 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1026/2032] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:53.012516 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254377c-3aaf-4bb2-bf33-a13d11b8b346 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:53.024979 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d254377c-3aaf-4bb2-bf33-a13d11b8b346 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:53.030591 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9fa2e-6b04-4b72-89b3-8ba45e4c8be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:53.031299 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9fa2e-6b04-4b72-89b3-8ba45e4c8be3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:53.031578 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9fa2e-6b04-4b72-89b3-8ba45e4c8be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:53.031935 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d9fa2e-6b04-4b72-89b3-8ba45e4c8be3 admin admin] PATH_INFO: `/v3/projects/a703a471d05446d08c0ccc21994a070c/users/f5ecf36528bd4a08a46d019d47fbc722/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:53.033914 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9fa2e-6b04-4b72-89b3-8ba45e4c8be3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a703a471d05446d08c0ccc21994a070c, user_id=f5ecf36528bd4a08a46d019d47fbc722, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:53.036608 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d9fa2e-6b04-4b72-89b3-8ba45e4c8be3 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:53.048410 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1007/2033] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:11:53 2022] PUT /identity/v3/projects/a703a471d05446d08c0ccc21994a070c/users/f5ecf36528bd4a08a46d019d47fbc722/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:53.058828 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549217dd-8e53-4857-8cc6-aad5bf19d3c2 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:53.059133 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549217dd-8e53-4857-8cc6-aad5bf19d3c2 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:53.059418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549217dd-8e53-4857-8cc6-aad5bf19d3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:53.089643 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-549217dd-8e53-4857-8cc6-aad5bf19d3c2 None None] MFA Rules not processed for user `f5ecf36528bd4a08a46d019d47fbc722`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:53.090968 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-549217dd-8e53-4857-8cc6-aad5bf19d3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:53.161763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1027/2034] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:53 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:53.177804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9fa2e-6b04-4b72-89b3-8ba45e4c8be3 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:53.179962 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-a4d9fa2e-6b04-4b72-89b3-8ba45e4c8be3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:53.206556 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:53.242943 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d9fa2e-6b04-4b72-89b3-8ba45e4c8be3 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:53.246759 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf55f67-5a8c-4004-9771-520f1dc8e07f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:53.247415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf55f67-5a8c-4004-9771-520f1dc8e07f service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:53.247690 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf55f67-5a8c-4004-9771-520f1dc8e07f service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:53.247980 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf55f67-5a8c-4004-9771-520f1dc8e07f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:53.259638 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf55f67-5a8c-4004-9771-520f1dc8e07f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:53.261158 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf55f67-5a8c-4004-9771-520f1dc8e07f service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:53.272404 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1008/2035] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:11:53.280922 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:53.307686 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549217dd-8e53-4857-8cc6-aad5bf19d3c2 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:53.383446 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549217dd-8e53-4857-8cc6-aad5bf19d3c2 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:53.388054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2de14-7adc-4c16-be56-857f61196120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:53.388687 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2de14-7adc-4c16-be56-857f61196120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:53.388958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2de14-7adc-4c16-be56-857f61196120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:53.389227 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2de14-7adc-4c16-be56-857f61196120 admin admin] PATH_INFO: `/v3/users/794b858940b046dfbf5006b6ae50d13a` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:53.390388 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2de14-7adc-4c16-be56-857f61196120 admin admin] RBAC: Authorizing `identity:delete_user(user_id=794b858940b046dfbf5006b6ae50d13a)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:53.392344 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e2de14-7adc-4c16-be56-857f61196120 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:53.565861 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf55f67-5a8c-4004-9771-520f1dc8e07f service cinder] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:53.567442 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-bcf55f67-5a8c-4004-9771-520f1dc8e07f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:53.582854 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf55f67-5a8c-4004-9771-520f1dc8e07f service cinder] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:53.587917 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-b6e2de14-7adc-4c16-be56-857f61196120 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '794b858940b046dfbf5006b6ae50d13a'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:53.593985 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2f783-133b-4e65-a158-817564790d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:53.593985 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2f783-133b-4e65-a158-817564790d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:53.593985 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2f783-133b-4e65-a158-817564790d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:53.593985 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce2f783-133b-4e65-a158-817564790d5d admin admin] PATH_INFO: `/v3/users/f5453f8638164741abe074e920094b05` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:53.594416 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce2f783-133b-4e65-a158-817564790d5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5453f8638164741abe074e920094b05)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:53.594896 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce2f783-133b-4e65-a158-817564790d5d admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:53.597354 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-b6e2de14-7adc-4c16-be56-857f61196120 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '794b858940b046dfbf5006b6ae50d13a'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:53.725873 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-b6e2de14-7adc-4c16-be56-857f61196120 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '794b858940b046dfbf5006b6ae50d13a'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:53.726601 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-b6e2de14-7adc-4c16-be56-857f61196120 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '794b858940b046dfbf5006b6ae50d13a'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:53.727500 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-b6e2de14-7adc-4c16-be56-857f61196120 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '794b858940b046dfbf5006b6ae50d13a'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:53.753899 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1028/2036] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:11:53 2022] DELETE /identity/v3/users/794b858940b046dfbf5006b6ae50d13a => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:53.758659 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5191e29-f472-475f-b254-1cb716db7ed0 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:53.759014 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5191e29-f472-475f-b254-1cb716db7ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:53.759284 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5191e29-f472-475f-b254-1cb716db7ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:53.780384 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-e5191e29-f472-475f-b254-1cb716db7ed0 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:53.781652 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-e5191e29-f472-475f-b254-1cb716db7ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:53.849422 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1029/2037] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:11:53.871588 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5191e29-f472-475f-b254-1cb716db7ed0 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:53.875302 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-e5191e29-f472-475f-b254-1cb716db7ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:53.886189 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-4ce2f783-133b-4e65-a158-817564790d5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5453f8638164741abe074e920094b05'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:53.887242 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-4ce2f783-133b-4e65-a158-817564790d5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5453f8638164741abe074e920094b05'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:53.896598 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-4ce2f783-133b-4e65-a158-817564790d5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5453f8638164741abe074e920094b05'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:53.897869 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-4ce2f783-133b-4e65-a158-817564790d5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5453f8638164741abe074e920094b05'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:53.945735 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5191e29-f472-475f-b254-1cb716db7ed0 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:53.951783 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9c176-a279-448d-b6ed-52744a139822 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:53.960451 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9c176-a279-448d-b6ed-52744a139822 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:53.960451 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9c176-a279-448d-b6ed-52744a139822 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:53.960451 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9c176-a279-448d-b6ed-52744a139822 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:53.960451 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-0ba9c176-a279-448d-b6ed-52744a139822 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:53.971669 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9c176-a279-448d-b6ed-52744a139822 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:53.973856 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba9c176-a279-448d-b6ed-52744a139822 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:53.984289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1030/2038] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:11:54.017462 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-4ce2f783-133b-4e65-a158-817564790d5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5453f8638164741abe074e920094b05'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:54.037880 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1009/2039] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:11:53 2022] DELETE /identity/v3/users/f5453f8638164741abe074e920094b05 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:54.042767 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3670b03-34dc-469b-a5bc-f5a38940b781 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:54.043181 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3670b03-34dc-469b-a5bc-f5a38940b781 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:54.043525 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3670b03-34dc-469b-a5bc-f5a38940b781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:54.064965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-e3670b03-34dc-469b-a5bc-f5a38940b781 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:54.065959 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-e3670b03-34dc-469b-a5bc-f5a38940b781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:54.142221 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1031/2040] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:11:54.153170 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2f783-133b-4e65-a158-817564790d5d admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:54.154567 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-4ce2f783-133b-4e65-a158-817564790d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:54.228679 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce2f783-133b-4e65-a158-817564790d5d admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:54.232519 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bd476-0534-472c-9dc5-a7747c3b26e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:54.233362 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bd476-0534-472c-9dc5-a7747c3b26e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:54.233595 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bd476-0534-472c-9dc5-a7747c3b26e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:54.233937 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20bd476-0534-472c-9dc5-a7747c3b26e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:54.244755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20bd476-0534-472c-9dc5-a7747c3b26e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:54.245460 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20bd476-0534-472c-9dc5-a7747c3b26e6 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:54.257670 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1010/2041] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:11:54.546179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3670b03-34dc-469b-a5bc-f5a38940b781 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:54.547745 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-e3670b03-34dc-469b-a5bc-f5a38940b781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:54.563194 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3670b03-34dc-469b-a5bc-f5a38940b781 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:54.569076 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1143681-f0cf-41c7-bd54-59088be4ce23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:54.570697 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1143681-f0cf-41c7-bd54-59088be4ce23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:54.571309 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1143681-f0cf-41c7-bd54-59088be4ce23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:54.571782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1143681-f0cf-41c7-bd54-59088be4ce23 admin admin] PATH_INFO: `/v3/projects/77407ef1e24e4b6687ef8c350d963d25` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:54.573917 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1143681-f0cf-41c7-bd54-59088be4ce23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77407ef1e24e4b6687ef8c350d963d25)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:54.578805 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1143681-f0cf-41c7-bd54-59088be4ce23 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:54.618205 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:54.728045 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-d1143681-f0cf-41c7-bd54-59088be4ce23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77407ef1e24e4b6687ef8c350d963d25', 'request_id': 'req-d1143681-f0cf-41c7-bd54-59088be4ce23'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:54.734438 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-d1143681-f0cf-41c7-bd54-59088be4ce23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77407ef1e24e4b6687ef8c350d963d25', 'request_id': 'req-d1143681-f0cf-41c7-bd54-59088be4ce23'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:54.743226 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:54.798766 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bd476-0534-472c-9dc5-a7747c3b26e6 service neutron] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:54.800204 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-a20bd476-0534-472c-9dc5-a7747c3b26e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:54.827151 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20bd476-0534-472c-9dc5-a7747c3b26e6 service neutron] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:54.846597 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-d1143681-f0cf-41c7-bd54-59088be4ce23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77407ef1e24e4b6687ef8c350d963d25', 'request_id': 'req-d1143681-f0cf-41c7-bd54-59088be4ce23'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:54.880321 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-d1143681-f0cf-41c7-bd54-59088be4ce23 admin admin] The token cache is being invalidate because project 77407ef1e24e4b6687ef8c350d963d25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:11:54.880596 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-d1143681-f0cf-41c7-bd54-59088be4ce23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:54.881470 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-d1143681-f0cf-41c7-bd54-59088be4ce23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:54.883420 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1032/2042] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:11:54 2022] DELETE /identity/v3/projects/77407ef1e24e4b6687ef8c350d963d25 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:54.890834 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1143681-f0cf-41c7-bd54-59088be4ce23 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:54.892867 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-d1143681-f0cf-41c7-bd54-59088be4ce23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:54.906704 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3026920-73ef-4f9c-b739-f106744c8c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:54.907444 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3026920-73ef-4f9c-b739-f106744c8c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:54.907728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3026920-73ef-4f9c-b739-f106744c8c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:54.908005 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3026920-73ef-4f9c-b739-f106744c8c34 admin admin] PATH_INFO: `/v3/projects/96bf98d3ccff45a1b322b4033e026856` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:54.909181 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3026920-73ef-4f9c-b739-f106744c8c34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96bf98d3ccff45a1b322b4033e026856)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:54.911487 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3026920-73ef-4f9c-b739-f106744c8c34 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:54.965635 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1143681-f0cf-41c7-bd54-59088be4ce23 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:54.971622 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086e30a-96c0-43c5-921e-41d8804614e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:54.972250 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086e30a-96c0-43c5-921e-41d8804614e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:54.972556 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086e30a-96c0-43c5-921e-41d8804614e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:54.972829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086e30a-96c0-43c5-921e-41d8804614e2 admin admin] PATH_INFO: `/v3/users/f5ecf36528bd4a08a46d019d47fbc722` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:54.973969 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086e30a-96c0-43c5-921e-41d8804614e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5ecf36528bd4a08a46d019d47fbc722)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:54.976009 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086e30a-96c0-43c5-921e-41d8804614e2 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:55.015120 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-b3026920-73ef-4f9c-b739-f106744c8c34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96bf98d3ccff45a1b322b4033e026856', 'request_id': 'req-b3026920-73ef-4f9c-b739-f106744c8c34'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:55.021022 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-b3026920-73ef-4f9c-b739-f106744c8c34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96bf98d3ccff45a1b322b4033e026856', 'request_id': 'req-b3026920-73ef-4f9c-b739-f106744c8c34'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:55.027405 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-b3026920-73ef-4f9c-b739-f106744c8c34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96bf98d3ccff45a1b322b4033e026856', 'request_id': 'req-b3026920-73ef-4f9c-b739-f106744c8c34'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:55.148163 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-b3026920-73ef-4f9c-b739-f106744c8c34 admin admin] The token cache is being invalidate because project 96bf98d3ccff45a1b322b4033e026856 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:11:55.148460 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-b3026920-73ef-4f9c-b739-f106744c8c34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:55.149151 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-b3026920-73ef-4f9c-b739-f106744c8c34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:55.150673 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1011/2043] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:11:54 2022] DELETE /identity/v3/projects/96bf98d3ccff45a1b322b4033e026856 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:55.156461 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304cae4-5d28-4b92-b2c4-7d8c0d8de188 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:55.156758 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304cae4-5d28-4b92-b2c4-7d8c0d8de188 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:55.157034 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6304cae4-5d28-4b92-b2c4-7d8c0d8de188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:55.177143 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-6304cae4-5d28-4b92-b2c4-7d8c0d8de188 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:55.178381 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-6304cae4-5d28-4b92-b2c4-7d8c0d8de188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:55.241606 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-c086e30a-96c0-43c5-921e-41d8804614e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5ecf36528bd4a08a46d019d47fbc722'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:55.250015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1012/2044] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:11:55.258866 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d9685-ff76-4495-89e4-0dd15fa4d608 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:55.259442 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d9685-ff76-4495-89e4-0dd15fa4d608 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:55.259556 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d9685-ff76-4495-89e4-0dd15fa4d608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:55.277372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-c086e30a-96c0-43c5-921e-41d8804614e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5ecf36528bd4a08a46d019d47fbc722'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:55.292923 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-6f6d9685-ff76-4495-89e4-0dd15fa4d608 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:55.292923 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-6f6d9685-ff76-4495-89e4-0dd15fa4d608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:55.302288 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1013/2045] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:11:55.303003 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d9685-ff76-4495-89e4-0dd15fa4d608 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:55.312994 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d9685-ff76-4495-89e4-0dd15fa4d608 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:55.317853 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a9f8d-f71c-42a0-a03b-b02f96b5446b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:55.318518 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a9f8d-f71c-42a0-a03b-b02f96b5446b admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:55.318794 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a9f8d-f71c-42a0-a03b-b02f96b5446b admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:55.319060 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a9f8d-f71c-42a0-a03b-b02f96b5446b admin admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:55.319862 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a9f8d-f71c-42a0-a03b-b02f96b5446b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:11:55.320175 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a9f8d-f71c-42a0-a03b-b02f96b5446b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:55.320458 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-c086e30a-96c0-43c5-921e-41d8804614e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5ecf36528bd4a08a46d019d47fbc722'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:55.321197 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-c086e30a-96c0-43c5-921e-41d8804614e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5ecf36528bd4a08a46d019d47fbc722'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:55.321998 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a9f8d-f71c-42a0-a03b-b02f96b5446b admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:55.322625 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-c086e30a-96c0-43c5-921e-41d8804614e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5ecf36528bd4a08a46d019d47fbc722'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:55.335696 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1014/2046] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:11:55.340107 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a9f8d-f71c-42a0-a03b-b02f96b5446b admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:55.345137 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-476a9f8d-f71c-42a0-a03b-b02f96b5446b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:55.347681 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1033/2047] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:11:54 2022] DELETE /identity/v3/users/f5ecf36528bd4a08a46d019d47fbc722 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:55.363990 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a9f8d-f71c-42a0-a03b-b02f96b5446b admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:55.431844 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ad4a8-9f01-4e13-94b5-6ec232b8b66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:55.432647 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ad4a8-9f01-4e13-94b5-6ec232b8b66c admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:55.432830 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ad4a8-9f01-4e13-94b5-6ec232b8b66c admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:55.433079 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ad4a8-9f01-4e13-94b5-6ec232b8b66c admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:55.433713 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ad4a8-9f01-4e13-94b5-6ec232b8b66c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:55.436442 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ad4a8-9f01-4e13-94b5-6ec232b8b66c admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:55.537033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1015/2048] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:11:55 2022] POST /identity/v3/projects => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:55.540784 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086e30a-96c0-43c5-921e-41d8804614e2 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:55.550208 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:55.555053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086e30a-96c0-43c5-921e-41d8804614e2 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:55.619790 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc6f4e-264f-4b99-814b-9182150d24da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:55.620441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc6f4e-264f-4b99-814b-9182150d24da admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:55.620718 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc6f4e-264f-4b99-814b-9182150d24da admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:55.621013 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc6f4e-264f-4b99-814b-9182150d24da admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:55.622533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc6f4e-264f-4b99-814b-9182150d24da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:55.624778 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc6f4e-264f-4b99-814b-9182150d24da admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:55.646141 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:55.721048 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1034/2049] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:11:55 2022] POST /identity/v3/users => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:55.722380 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ad4a8-9f01-4e13-94b5-6ec232b8b66c admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:55.734192 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ad4a8-9f01-4e13-94b5-6ec232b8b66c admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:55.741952 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c96968-5395-4727-a14a-be421874f783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:55.741952 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c96968-5395-4727-a14a-be421874f783 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:55.741952 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c96968-5395-4727-a14a-be421874f783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:55.741952 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c96968-5395-4727-a14a-be421874f783 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:55.742322 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c96968-5395-4727-a14a-be421874f783 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:55.743419 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c96968-5395-4727-a14a-be421874f783 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:55.755304 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1016/2050] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:55.762144 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc6f4e-264f-4b99-814b-9182150d24da admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:55.771945 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc6f4e-264f-4b99-814b-9182150d24da admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:55.777040 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fea1fe-4cb4-4096-b322-d96429d42eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:55.777667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fea1fe-4cb4-4096-b322-d96429d42eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:55.777946 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fea1fe-4cb4-4096-b322-d96429d42eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:55.778253 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fea1fe-4cb4-4096-b322-d96429d42eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:55.778911 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fea1fe-4cb4-4096-b322-d96429d42eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:55.780548 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fea1fe-4cb4-4096-b322-d96429d42eb9 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:55.792369 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1035/2051] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:55.796371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c96968-5395-4727-a14a-be421874f783 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:55.807169 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c96968-5395-4727-a14a-be421874f783 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:55.808610 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fea1fe-4cb4-4096-b322-d96429d42eb9 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:55.811644 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-46fea1fe-4cb4-4096-b322-d96429d42eb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:55.814547 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f4e9f4-c0ba-4940-a31b-8ce29d95fd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:55.815489 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4e9f4-c0ba-4940-a31b-8ce29d95fd92 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:55.815928 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4e9f4-c0ba-4940-a31b-8ce29d95fd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:55.816516 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f4e9f4-c0ba-4940-a31b-8ce29d95fd92 admin admin] PATH_INFO: `/v3/projects/0ba64a90f44c4ec08bb88e418b4f2572/users/190cccbe419249338c60fdec264f2bd0/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:55.830902 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fea1fe-4cb4-4096-b322-d96429d42eb9 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:55.847786 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401744c-19c3-48e1-8c0a-36d20b11902b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:55.848447 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401744c-19c3-48e1-8c0a-36d20b11902b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:55.848747 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401744c-19c3-48e1-8c0a-36d20b11902b admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:55.849026 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401744c-19c3-48e1-8c0a-36d20b11902b admin admin] PATH_INFO: `/v3/projects/a703a471d05446d08c0ccc21994a070c` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:55.851162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4e9f4-c0ba-4940-a31b-8ce29d95fd92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ba64a90f44c4ec08bb88e418b4f2572, user_id=190cccbe419249338c60fdec264f2bd0, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:55.853076 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401744c-19c3-48e1-8c0a-36d20b11902b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a703a471d05446d08c0ccc21994a070c)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:55.854300 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f4e9f4-c0ba-4940-a31b-8ce29d95fd92 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:55.857307 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401744c-19c3-48e1-8c0a-36d20b11902b admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:55.952213 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1017/2052] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:11:55 2022] PUT /identity/v3/projects/0ba64a90f44c4ec08bb88e418b4f2572/users/190cccbe419249338c60fdec264f2bd0/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:55.957689 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9fce5-7cdb-403d-820c-5d7c59765585 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:55.958049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9fce5-7cdb-403d-820c-5d7c59765585 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:55.958447 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c9fce5-7cdb-403d-820c-5d7c59765585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:55.983194 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-28c9fce5-7cdb-403d-820c-5d7c59765585 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:55.984520 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-28c9fce5-7cdb-403d-820c-5d7c59765585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:56.013845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0401744c-19c3-48e1-8c0a-36d20b11902b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a703a471d05446d08c0ccc21994a070c', 'request_id': 'req-0401744c-19c3-48e1-8c0a-36d20b11902b'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:56.020426 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0401744c-19c3-48e1-8c0a-36d20b11902b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a703a471d05446d08c0ccc21994a070c', 'request_id': 'req-0401744c-19c3-48e1-8c0a-36d20b11902b'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:56.055742 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1018/2053] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:56.066375 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9fce5-7cdb-403d-820c-5d7c59765585 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:56.067880 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-28c9fce5-7cdb-403d-820c-5d7c59765585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:56.085728 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0401744c-19c3-48e1-8c0a-36d20b11902b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a703a471d05446d08c0ccc21994a070c', 'request_id': 'req-0401744c-19c3-48e1-8c0a-36d20b11902b'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:56.103689 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0401744c-19c3-48e1-8c0a-36d20b11902b admin admin] The token cache is being invalidate because project a703a471d05446d08c0ccc21994a070c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:11:56.104233 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0401744c-19c3-48e1-8c0a-36d20b11902b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:56.105031 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0401744c-19c3-48e1-8c0a-36d20b11902b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:11:56.111043 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1036/2054] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:11:55 2022] DELETE /identity/v3/projects/a703a471d05446d08c0ccc21994a070c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:56.112736 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2ec0f-97bc-48ea-8309-0cbaa9b0be51 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:56.113118 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2ec0f-97bc-48ea-8309-0cbaa9b0be51 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:56.113449 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2ec0f-97bc-48ea-8309-0cbaa9b0be51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:56.135510 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-80d2ec0f-97bc-48ea-8309-0cbaa9b0be51 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:56.136819 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-80d2ec0f-97bc-48ea-8309-0cbaa9b0be51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:56.138096 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c9fce5-7cdb-403d-820c-5d7c59765585 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:56.196010 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c270f-983c-4f88-b2ca-5fe8c8abb714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:56.196634 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c270f-983c-4f88-b2ca-5fe8c8abb714 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:56.196963 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c270f-983c-4f88-b2ca-5fe8c8abb714 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:56.197236 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c270f-983c-4f88-b2ca-5fe8c8abb714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:56.200004 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-940c270f-983c-4f88-b2ca-5fe8c8abb714 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:56.204770 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1037/2055] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:56.214867 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c270f-983c-4f88-b2ca-5fe8c8abb714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:56.217124 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c270f-983c-4f88-b2ca-5fe8c8abb714 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:56.221106 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88387c2f-eeb7-478f-97fa-aefb7095aff6 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:56.221591 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88387c2f-eeb7-478f-97fa-aefb7095aff6 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:56.221842 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88387c2f-eeb7-478f-97fa-aefb7095aff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:56.228658 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1019/2056] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:11:56.243578 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-88387c2f-eeb7-478f-97fa-aefb7095aff6 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:56.244915 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-88387c2f-eeb7-478f-97fa-aefb7095aff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:56.253795 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1038/2057] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:56.258451 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c270f-983c-4f88-b2ca-5fe8c8abb714 service neutron] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:56.269406 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c270f-983c-4f88-b2ca-5fe8c8abb714 service neutron] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:56.274529 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e8a17-8759-4c9e-a127-e6f262e47843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:56.275176 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e8a17-8759-4c9e-a127-e6f262e47843 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:56.280350 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e8a17-8759-4c9e-a127-e6f262e47843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:56.280350 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24e8a17-8759-4c9e-a127-e6f262e47843 admin admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:56.280350 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e8a17-8759-4c9e-a127-e6f262e47843 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:11:56.280350 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e8a17-8759-4c9e-a127-e6f262e47843 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:56.280350 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24e8a17-8759-4c9e-a127-e6f262e47843 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:56.291600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1020/2058] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:11:56.296754 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88387c2f-eeb7-478f-97fa-aefb7095aff6 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:56.309714 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88387c2f-eeb7-478f-97fa-aefb7095aff6 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:56.312722 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531e887-3824-4de6-a3de-76aea485a0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:56.313494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531e887-3824-4de6-a3de-76aea485a0a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:56.313857 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531e887-3824-4de6-a3de-76aea485a0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:56.314167 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f531e887-3824-4de6-a3de-76aea485a0a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:56.314871 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531e887-3824-4de6-a3de-76aea485a0a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:56.317112 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f531e887-3824-4de6-a3de-76aea485a0a1 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:56.430755 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1039/2059] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:11:56 2022] POST /identity/v3/projects => generated 387 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:56.434942 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e8a17-8759-4c9e-a127-e6f262e47843 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:56.449272 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24e8a17-8759-4c9e-a127-e6f262e47843 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:56.560883 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149b0e0-b3d7-4860-94d3-5e9081419920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:56.561098 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149b0e0-b3d7-4860-94d3-5e9081419920 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:56.561380 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149b0e0-b3d7-4860-94d3-5e9081419920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:56.562156 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d149b0e0-b3d7-4860-94d3-5e9081419920 admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:56.564470 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149b0e0-b3d7-4860-94d3-5e9081419920 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:56.566445 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d149b0e0-b3d7-4860-94d3-5e9081419920 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:56.600329 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:56.642177 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1021/2060] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:11:56 2022] POST /identity/v3/users => generated 294 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:56.646881 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531e887-3824-4de6-a3de-76aea485a0a1 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:56.665715 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f531e887-3824-4de6-a3de-76aea485a0a1 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:56.676110 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ae73c-93da-4839-904c-26f443365a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:56.676431 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ae73c-93da-4839-904c-26f443365a24 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:56.676712 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ae73c-93da-4839-904c-26f443365a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:56.676983 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ae73c-93da-4839-904c-26f443365a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:56.677631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ae73c-93da-4839-904c-26f443365a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:56.679444 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ae73c-93da-4839-904c-26f443365a24 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:56.696517 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1040/2061] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:56.699551 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149b0e0-b3d7-4860-94d3-5e9081419920 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:56.711981 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d149b0e0-b3d7-4860-94d3-5e9081419920 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:56.718449 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093516ce-54e4-4f47-bead-8303c37518cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:56.719580 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093516ce-54e4-4f47-bead-8303c37518cf admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:56.720106 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093516ce-54e4-4f47-bead-8303c37518cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:56.720628 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093516ce-54e4-4f47-bead-8303c37518cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:56.721666 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093516ce-54e4-4f47-bead-8303c37518cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:56.723949 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093516ce-54e4-4f47-bead-8303c37518cf admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:56.737910 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1022/2062] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:56.742285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ae73c-93da-4839-904c-26f443365a24 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:56.753469 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ae73c-93da-4839-904c-26f443365a24 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:56.758782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a8da9-5849-4577-a3f4-8056b4c4321b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:56.760337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a8da9-5849-4577-a3f4-8056b4c4321b admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:56.760637 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a8da9-5849-4577-a3f4-8056b4c4321b admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:56.760916 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a8da9-5849-4577-a3f4-8056b4c4321b admin admin] PATH_INFO: `/v3/projects/01f3a282022e4337afecabb3febad743/users/11f4031385a048b78f7ebfadf5fe7ec6/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:56.778448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a8da9-5849-4577-a3f4-8056b4c4321b admin admin] RBAC: Authorizing `identity:create_grant(project_id=01f3a282022e4337afecabb3febad743, user_id=11f4031385a048b78f7ebfadf5fe7ec6, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:56.781972 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a8da9-5849-4577-a3f4-8056b4c4321b admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:56.795423 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:56.835299 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1041/2063] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:11:56 2022] PUT /identity/v3/projects/01f3a282022e4337afecabb3febad743/users/11f4031385a048b78f7ebfadf5fe7ec6/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:56.847959 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975d133-4146-460f-8895-020c87531803 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:56.848250 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975d133-4146-460f-8895-020c87531803 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:56.848527 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975d133-4146-460f-8895-020c87531803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:56.889383 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-6975d133-4146-460f-8895-020c87531803 None None] MFA Rules not processed for user `11f4031385a048b78f7ebfadf5fe7ec6`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:56.889383 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-6975d133-4146-460f-8895-020c87531803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:56.982943 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1023/2064] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:56.987636 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a8da9-5849-4577-a3f4-8056b4c4321b admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:57.066770 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a8da9-5849-4577-a3f4-8056b4c4321b admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:57.072332 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942ca45-f388-40d9-8d0e-eb2ef8b8398d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:57.073039 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942ca45-f388-40d9-8d0e-eb2ef8b8398d admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:57.073493 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942ca45-f388-40d9-8d0e-eb2ef8b8398d admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:57.073921 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942ca45-f388-40d9-8d0e-eb2ef8b8398d admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:57.074754 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942ca45-f388-40d9-8d0e-eb2ef8b8398d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:57.076980 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942ca45-f388-40d9-8d0e-eb2ef8b8398d admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:57.186442 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1042/2065] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:11:56 2022] POST /identity/v3/projects => generated 387 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:57.190628 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975d133-4146-460f-8895-020c87531803 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:57.201695 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975d133-4146-460f-8895-020c87531803 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:57.259742 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa3708-c81e-4238-9f4b-8465cd1ca3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:57.260388 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa3708-c81e-4238-9f4b-8465cd1ca3e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:57.260690 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa3708-c81e-4238-9f4b-8465cd1ca3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:57.260962 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa3708-c81e-4238-9f4b-8465cd1ca3e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:57.262420 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa3708-c81e-4238-9f4b-8465cd1ca3e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:57.263879 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa3708-c81e-4238-9f4b-8465cd1ca3e1 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:57.365003 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1024/2066] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:11:57 2022] POST /identity/v3/users => generated 294 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:57.366777 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942ca45-f388-40d9-8d0e-eb2ef8b8398d admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:57.377607 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942ca45-f388-40d9-8d0e-eb2ef8b8398d admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:57.383491 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c348a-ba61-4545-9a03-46fde10d6eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:57.384121 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c348a-ba61-4545-9a03-46fde10d6eba admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:57.384394 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c348a-ba61-4545-9a03-46fde10d6eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:57.384714 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c348a-ba61-4545-9a03-46fde10d6eba admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:57.385404 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c348a-ba61-4545-9a03-46fde10d6eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:57.387100 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c348a-ba61-4545-9a03-46fde10d6eba admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:57.400387 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1043/2067] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:57.409498 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa3708-c81e-4238-9f4b-8465cd1ca3e1 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:57.424306 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa3708-c81e-4238-9f4b-8465cd1ca3e1 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:57.430890 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43614c31-db16-487b-bcc1-9cb85ff6287c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:57.432339 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43614c31-db16-487b-bcc1-9cb85ff6287c admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:57.433312 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43614c31-db16-487b-bcc1-9cb85ff6287c admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:57.433744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43614c31-db16-487b-bcc1-9cb85ff6287c admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:57.434680 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43614c31-db16-487b-bcc1-9cb85ff6287c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:57.435136 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:57.437125 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43614c31-db16-487b-bcc1-9cb85ff6287c admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:57.448577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1025/2068] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:57.453602 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c348a-ba61-4545-9a03-46fde10d6eba admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:57.463817 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c348a-ba61-4545-9a03-46fde10d6eba admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:57.469485 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a847df-521a-4b2d-a006-28729c6010c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:57.470174 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a847df-521a-4b2d-a006-28729c6010c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:57.470477 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a847df-521a-4b2d-a006-28729c6010c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:57.470751 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a847df-521a-4b2d-a006-28729c6010c9 admin admin] PATH_INFO: `/v3/projects/2f7a4f10f76647799821b9331096defa/users/45727927f6084bbda82f45c34847e67b/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:57.487511 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a847df-521a-4b2d-a006-28729c6010c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f7a4f10f76647799821b9331096defa, user_id=45727927f6084bbda82f45c34847e67b, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:57.490235 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a847df-521a-4b2d-a006-28729c6010c9 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:57.549857 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1044/2069] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:11:57 2022] PUT /identity/v3/projects/2f7a4f10f76647799821b9331096defa/users/45727927f6084bbda82f45c34847e67b/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:57.560433 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924e8ec-f5bd-4be0-8b72-37af375df2e3 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:57.560720 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924e8ec-f5bd-4be0-8b72-37af375df2e3 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:57.560994 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3924e8ec-f5bd-4be0-8b72-37af375df2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:57.597276 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-3924e8ec-f5bd-4be0-8b72-37af375df2e3 None None] MFA Rules not processed for user `45727927f6084bbda82f45c34847e67b`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:57.598551 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-3924e8ec-f5bd-4be0-8b72-37af375df2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:57.695773 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1026/2070] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:57.698467 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a847df-521a-4b2d-a006-28729c6010c9 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:57.812495 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a847df-521a-4b2d-a006-28729c6010c9 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:57.817596 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf259540-25ab-4117-b81f-59531a54a0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:57.818889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf259540-25ab-4117-b81f-59531a54a0aa admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:57.819561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf259540-25ab-4117-b81f-59531a54a0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:57.819561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf259540-25ab-4117-b81f-59531a54a0aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:57.820225 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf259540-25ab-4117-b81f-59531a54a0aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:57.823148 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf259540-25ab-4117-b81f-59531a54a0aa admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:57.981095 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1045/2071] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:11:57 2022] POST /identity/v3/projects => generated 385 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:57.986021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924e8ec-f5bd-4be0-8b72-37af375df2e3 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:57.998092 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3924e8ec-f5bd-4be0-8b72-37af375df2e3 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:58.078585 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9044269-fd8e-4f5a-a664-4b4571a14f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:58.080189 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9044269-fd8e-4f5a-a664-4b4571a14f1c admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:58.080478 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9044269-fd8e-4f5a-a664-4b4571a14f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:58.080749 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9044269-fd8e-4f5a-a664-4b4571a14f1c admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:58.082543 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9044269-fd8e-4f5a-a664-4b4571a14f1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:58.094789 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9044269-fd8e-4f5a-a664-4b4571a14f1c admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:58.238241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=11 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:58.250768 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1027/2072] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:11:57 2022] POST /identity/v3/users => generated 299 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:11:58.251932 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf259540-25ab-4117-b81f-59531a54a0aa admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:58.264610 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf259540-25ab-4117-b81f-59531a54a0aa admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:58.277816 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdfd18-2a04-4299-bd32-e6ad17735089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:58.277816 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdfd18-2a04-4299-bd32-e6ad17735089 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:58.277816 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdfd18-2a04-4299-bd32-e6ad17735089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:58.277816 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdfd18-2a04-4299-bd32-e6ad17735089 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:58.278687 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acdfd18-2a04-4299-bd32-e6ad17735089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:58.280149 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acdfd18-2a04-4299-bd32-e6ad17735089 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:58.303391 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1046/2073] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:11:58.306758 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9044269-fd8e-4f5a-a664-4b4571a14f1c admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:58.323369 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9044269-fd8e-4f5a-a664-4b4571a14f1c admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:58.330337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480b797-2f5b-4a8e-a8a9-231be884c841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:58.331433 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480b797-2f5b-4a8e-a8a9-231be884c841 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:58.331937 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480b797-2f5b-4a8e-a8a9-231be884c841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:58.332433 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480b797-2f5b-4a8e-a8a9-231be884c841 admin admin] PATH_INFO: `/v3/projects/04635ea0fba34beeaa77741c47879649/users/46aba327c0e6412a97b0e9ad1b6d6db0/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:58.355717 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480b797-2f5b-4a8e-a8a9-231be884c841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04635ea0fba34beeaa77741c47879649, user_id=46aba327c0e6412a97b0e9ad1b6d6db0, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:58.359793 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480b797-2f5b-4a8e-a8a9-231be884c841 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:58.452604 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1028/2074] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:11:58 2022] PUT /identity/v3/projects/04635ea0fba34beeaa77741c47879649/users/46aba327c0e6412a97b0e9ad1b6d6db0/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:58.456771 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdfd18-2a04-4299-bd32-e6ad17735089 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:58.476705 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdfd18-2a04-4299-bd32-e6ad17735089 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:58.553059 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca1128-f6db-4af4-899a-94dc601c4ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:58.553918 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca1128-f6db-4af4-899a-94dc601c4ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:58.554228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca1128-f6db-4af4-899a-94dc601c4ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:58.554533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca1128-f6db-4af4-899a-94dc601c4ab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:58.555489 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca1128-f6db-4af4-899a-94dc601c4ab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:58.559693 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca1128-f6db-4af4-899a-94dc601c4ab8 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:58.583779 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1047/2075] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:11:58.595389 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480b797-2f5b-4a8e-a8a9-231be884c841 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:58.611771 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480b797-2f5b-4a8e-a8a9-231be884c841 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:58.620000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b6c57-dc73-4a34-b993-d0582db7177d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:58.620000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b6c57-dc73-4a34-b993-d0582db7177d admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:58.620000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b6c57-dc73-4a34-b993-d0582db7177d admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:58.620000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4b6c57-dc73-4a34-b993-d0582db7177d admin admin] PATH_INFO: `/v3/projects/04635ea0fba34beeaa77741c47879649/users/46aba327c0e6412a97b0e9ad1b6d6db0/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:58.621424 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b6c57-dc73-4a34-b993-d0582db7177d admin admin] RBAC: Authorizing `identity:create_grant(project_id=04635ea0fba34beeaa77741c47879649, user_id=46aba327c0e6412a97b0e9ad1b6d6db0, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:58.631566 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4b6c57-dc73-4a34-b993-d0582db7177d admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:58.662739 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1029/2076] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:11:58 2022] PUT /identity/v3/projects/04635ea0fba34beeaa77741c47879649/users/46aba327c0e6412a97b0e9ad1b6d6db0/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:11:58.674438 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cbfab-d602-47c5-8490-b921eecadab6 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:58.674829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cbfab-d602-47c5-8490-b921eecadab6 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:58.675254 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cbfab-d602-47c5-8490-b921eecadab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:58.729687 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-c86cbfab-d602-47c5-8490-b921eecadab6 None None] MFA Rules not processed for user `46aba327c0e6412a97b0e9ad1b6d6db0`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:11:58.730962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-c86cbfab-d602-47c5-8490-b921eecadab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:58.891405 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1048/2077] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:11:58 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:11:58.903651 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b6c57-dc73-4a34-b993-d0582db7177d admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:58.905919 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-3c4b6c57-dc73-4a34-b993-d0582db7177d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:58.989928 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4b6c57-dc73-4a34-b993-d0582db7177d admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:58.994642 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f802ce4-8f02-4451-8837-f9c4fc63961f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:58.995308 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f802ce4-8f02-4451-8837-f9c4fc63961f service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:58.995587 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f802ce4-8f02-4451-8837-f9c4fc63961f service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:58.995855 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f802ce4-8f02-4451-8837-f9c4fc63961f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:59.008673 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f802ce4-8f02-4451-8837-f9c4fc63961f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:59.016575 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f802ce4-8f02-4451-8837-f9c4fc63961f service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:11:59.021561 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1030/2078] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:11:58 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:11:59.144122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:11:59.683380 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86cbfab-d602-47c5-8490-b921eecadab6 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:11:59.685005 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-c86cbfab-d602-47c5-8490-b921eecadab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:11:59.780434 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86cbfab-d602-47c5-8490-b921eecadab6 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:11:59.787869 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd8c5b-0ad0-469a-bf17-5cea57493384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:11:59.787869 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd8c5b-0ad0-469a-bf17-5cea57493384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:11:59.788460 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd8c5b-0ad0-469a-bf17-5cea57493384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:11:59.788883 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd8c5b-0ad0-469a-bf17-5cea57493384 admin admin] PATH_INFO: `/v3/users/27e79047e49e4efbbf6b70f2120e5b53` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:11:59.790397 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd8c5b-0ad0-469a-bf17-5cea57493384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27e79047e49e4efbbf6b70f2120e5b53)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:11:59.792634 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd8c5b-0ad0-469a-bf17-5cea57493384 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:00.045602 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-9dcd8c5b-0ad0-469a-bf17-5cea57493384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27e79047e49e4efbbf6b70f2120e5b53'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:00.054397 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-9dcd8c5b-0ad0-469a-bf17-5cea57493384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27e79047e49e4efbbf6b70f2120e5b53'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:00.137361 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-9dcd8c5b-0ad0-469a-bf17-5cea57493384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27e79047e49e4efbbf6b70f2120e5b53'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:00.139182 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-9dcd8c5b-0ad0-469a-bf17-5cea57493384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27e79047e49e4efbbf6b70f2120e5b53'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:00.140106 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-9dcd8c5b-0ad0-469a-bf17-5cea57493384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27e79047e49e4efbbf6b70f2120e5b53'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:00.181113 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1049/2079] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:11:59 2022] DELETE /identity/v3/users/27e79047e49e4efbbf6b70f2120e5b53 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:00.186137 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6e94f-86e2-43ce-a0a2-7996cdbd9fa2 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:00.187706 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6e94f-86e2-43ce-a0a2-7996cdbd9fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:00.188184 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6e94f-86e2-43ce-a0a2-7996cdbd9fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:00.220950 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-4bb6e94f-86e2-43ce-a0a2-7996cdbd9fa2 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:00.222641 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-4bb6e94f-86e2-43ce-a0a2-7996cdbd9fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:00.229587 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:00.308417 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1031/2080] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:00.319701 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd8c5b-0ad0-469a-bf17-5cea57493384 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:00.321649 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-9dcd8c5b-0ad0-469a-bf17-5cea57493384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:00.350805 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:00.380699 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6e94f-86e2-43ce-a0a2-7996cdbd9fa2 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:00.383870 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-4bb6e94f-86e2-43ce-a0a2-7996cdbd9fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:00.397636 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd8c5b-0ad0-469a-bf17-5cea57493384 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:00.401590 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262e246-405e-4e94-a333-68f7ebd978e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:00.402217 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262e246-405e-4e94-a333-68f7ebd978e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:00.402532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262e246-405e-4e94-a333-68f7ebd978e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:00.402753 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262e246-405e-4e94-a333-68f7ebd978e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:00.414047 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262e246-405e-4e94-a333-68f7ebd978e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:00.415718 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262e246-405e-4e94-a333-68f7ebd978e5 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:00.427930 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1050/2081] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:12:00.463670 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6e94f-86e2-43ce-a0a2-7996cdbd9fa2 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:00.472293 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7dd22b-d6a6-4590-96b1-4b3db98f8a84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:00.472789 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7dd22b-d6a6-4590-96b1-4b3db98f8a84 service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:00.473197 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7dd22b-d6a6-4590-96b1-4b3db98f8a84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:00.473530 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7dd22b-d6a6-4590-96b1-4b3db98f8a84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:00.475701 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-df7dd22b-d6a6-4590-96b1-4b3db98f8a84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:00.599142 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7dd22b-d6a6-4590-96b1-4b3db98f8a84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:00.600787 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7dd22b-d6a6-4590-96b1-4b3db98f8a84 service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:00.614859 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1032/2082] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:00 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:12:00.675432 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262e246-405e-4e94-a333-68f7ebd978e5 service neutron] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:00.677172 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-8262e246-405e-4e94-a333-68f7ebd978e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:00.698424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262e246-405e-4e94-a333-68f7ebd978e5 service neutron] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:00.712563 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586f996-d699-40f5-a559-b6103f8a3d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:00.713756 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586f996-d699-40f5-a559-b6103f8a3d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:00.716669 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586f996-d699-40f5-a559-b6103f8a3d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:00.716669 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a586f996-d699-40f5-a559-b6103f8a3d28 admin admin] PATH_INFO: `/v3/users/4eb2f51d1b38447cb1aa06b9d82fb954` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:00.716669 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586f996-d699-40f5-a559-b6103f8a3d28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eb2f51d1b38447cb1aa06b9d82fb954)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:00.720227 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a586f996-d699-40f5-a559-b6103f8a3d28 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:00.974789 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-a586f996-d699-40f5-a559-b6103f8a3d28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eb2f51d1b38447cb1aa06b9d82fb954'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:00.997299 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-a586f996-d699-40f5-a559-b6103f8a3d28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eb2f51d1b38447cb1aa06b9d82fb954'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:01.051834 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-a586f996-d699-40f5-a559-b6103f8a3d28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eb2f51d1b38447cb1aa06b9d82fb954'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:01.052466 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-a586f996-d699-40f5-a559-b6103f8a3d28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eb2f51d1b38447cb1aa06b9d82fb954'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:01.054024 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-a586f996-d699-40f5-a559-b6103f8a3d28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eb2f51d1b38447cb1aa06b9d82fb954'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:01.078352 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1051/2083] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:12:00 2022] DELETE /identity/v3/users/4eb2f51d1b38447cb1aa06b9d82fb954 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:01.082935 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217473b2-f012-4100-a2a9-e6cec1cf5212 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:01.083282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217473b2-f012-4100-a2a9-e6cec1cf5212 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:01.083791 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217473b2-f012-4100-a2a9-e6cec1cf5212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:01.101084 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586f996-d699-40f5-a559-b6103f8a3d28 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:01.112713 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-a586f996-d699-40f5-a559-b6103f8a3d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:01.153309 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-217473b2-f012-4100-a2a9-e6cec1cf5212 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:01.157872 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-217473b2-f012-4100-a2a9-e6cec1cf5212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:01.259695 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a586f996-d699-40f5-a559-b6103f8a3d28 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:01.266901 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee039b-a1d8-4021-bca8-e58ce0e9b8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:01.267360 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee039b-a1d8-4021-bca8-e58ce0e9b8f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:01.267582 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee039b-a1d8-4021-bca8-e58ce0e9b8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:01.267847 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee039b-a1d8-4021-bca8-e58ce0e9b8f2 admin admin] PATH_INFO: `/v3/projects/ee9b493d10294e85b0efda4744b9b9dd` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:01.269116 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee039b-a1d8-4021-bca8-e58ce0e9b8f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee9b493d10294e85b0efda4744b9b9dd)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:01.271081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee039b-a1d8-4021-bca8-e58ce0e9b8f2 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:01.298411 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1033/2084] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:01.305933 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217473b2-f012-4100-a2a9-e6cec1cf5212 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:01.308030 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-217473b2-f012-4100-a2a9-e6cec1cf5212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:01.382505 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217473b2-f012-4100-a2a9-e6cec1cf5212 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:01.387467 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0401baa-17ea-4db0-b30d-1d6ea9147924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:01.391054 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0401baa-17ea-4db0-b30d-1d6ea9147924 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:01.391054 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0401baa-17ea-4db0-b30d-1d6ea9147924 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:01.391054 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0401baa-17ea-4db0-b30d-1d6ea9147924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:01.400804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0401baa-17ea-4db0-b30d-1d6ea9147924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:01.402384 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0401baa-17ea-4db0-b30d-1d6ea9147924 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:01.417329 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1034/2085] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:12:01.438153 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0401baa-17ea-4db0-b30d-1d6ea9147924 service neutron] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:01.440201 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-f0401baa-17ea-4db0-b30d-1d6ea9147924 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:01.456481 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-95ee039b-a1d8-4021-bca8-e58ce0e9b8f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee9b493d10294e85b0efda4744b9b9dd', 'request_id': 'req-95ee039b-a1d8-4021-bca8-e58ce0e9b8f2'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:01.461090 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0401baa-17ea-4db0-b30d-1d6ea9147924 service neutron] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:01.471354 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-95ee039b-a1d8-4021-bca8-e58ce0e9b8f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee9b493d10294e85b0efda4744b9b9dd', 'request_id': 'req-95ee039b-a1d8-4021-bca8-e58ce0e9b8f2'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:01.587750 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f53e5-09ce-4ff7-aaf3-0762453facb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:01.588975 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f53e5-09ce-4ff7-aaf3-0762453facb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:01.589449 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f53e5-09ce-4ff7-aaf3-0762453facb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:01.589906 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f53e5-09ce-4ff7-aaf3-0762453facb0 admin admin] PATH_INFO: `/v3/users/f829ea9b22e543309a39ade2d7c5bf98` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:01.593806 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f53e5-09ce-4ff7-aaf3-0762453facb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f829ea9b22e543309a39ade2d7c5bf98)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:01.598848 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f53e5-09ce-4ff7-aaf3-0762453facb0 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:01.607611 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-95ee039b-a1d8-4021-bca8-e58ce0e9b8f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee9b493d10294e85b0efda4744b9b9dd', 'request_id': 'req-95ee039b-a1d8-4021-bca8-e58ce0e9b8f2'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:01.628316 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-95ee039b-a1d8-4021-bca8-e58ce0e9b8f2 admin admin] The token cache is being invalidate because project ee9b493d10294e85b0efda4744b9b9dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:12:01.628732 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-95ee039b-a1d8-4021-bca8-e58ce0e9b8f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:01.630165 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-95ee039b-a1d8-4021-bca8-e58ce0e9b8f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:01.637120 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1052/2086] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:12:01 2022] DELETE /identity/v3/projects/ee9b493d10294e85b0efda4744b9b9dd => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:01.639981 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e5a24-db98-4556-a459-01b6fda5d8b6 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:01.640516 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e5a24-db98-4556-a459-01b6fda5d8b6 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:01.641265 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e5a24-db98-4556-a459-01b6fda5d8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:01.688355 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-569e5a24-db98-4556-a459-01b6fda5d8b6 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:01.707289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-569e5a24-db98-4556-a459-01b6fda5d8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:01.712662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1053/2087] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:01.723224 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a504c98-1765-4273-ad63-246477703862 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:01.723517 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a504c98-1765-4273-ad63-246477703862 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:01.723794 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a504c98-1765-4273-ad63-246477703862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:01.749107 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-2a504c98-1765-4273-ad63-246477703862 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:01.751137 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-2a504c98-1765-4273-ad63-246477703862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:01.767311 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1054/2088] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:01.771093 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a504c98-1765-4273-ad63-246477703862 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:01.782684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a504c98-1765-4273-ad63-246477703862 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:01.789623 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd4075-3d54-432e-8066-e405168d3bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:01.793197 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd4075-3d54-432e-8066-e405168d3bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:01.793197 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd4075-3d54-432e-8066-e405168d3bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:01.793197 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd4075-3d54-432e-8066-e405168d3bc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:01.793197 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd4075-3d54-432e-8066-e405168d3bc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:12:01.793197 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd4075-3d54-432e-8066-e405168d3bc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:01.795179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd4075-3d54-432e-8066-e405168d3bc9 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:01.826973 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1055/2089] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:12:01.831318 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd4075-3d54-432e-8066-e405168d3bc9 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:01.843375 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd4075-3d54-432e-8066-e405168d3bc9 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:01.849382 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fa0a9-de7f-4d9f-9be0-9053c710181c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:01.850001 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fa0a9-de7f-4d9f-9be0-9053c710181c admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:01.850284 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fa0a9-de7f-4d9f-9be0-9053c710181c admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:01.850568 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fa0a9-de7f-4d9f-9be0-9053c710181c admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:01.851306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fa0a9-de7f-4d9f-9be0-9053c710181c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:01.853375 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fa0a9-de7f-4d9f-9be0-9053c710181c admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:01.905544 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-2e3f53e5-09ce-4ff7-aaf3-0762453facb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f829ea9b22e543309a39ade2d7c5bf98'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:01.906254 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-2e3f53e5-09ce-4ff7-aaf3-0762453facb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f829ea9b22e543309a39ade2d7c5bf98'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:01.915322 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-2e3f53e5-09ce-4ff7-aaf3-0762453facb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f829ea9b22e543309a39ade2d7c5bf98'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:01.916175 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-2e3f53e5-09ce-4ff7-aaf3-0762453facb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f829ea9b22e543309a39ade2d7c5bf98'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:02.007906 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1056/2090] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:12:01 2022] POST /identity/v3/projects => generated 363 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:12:02.008498 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fa0a9-de7f-4d9f-9be0-9053c710181c admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:02.010482 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-a56fa0a9-de7f-4d9f-9be0-9053c710181c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:02.098340 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-2e3f53e5-09ce-4ff7-aaf3-0762453facb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f829ea9b22e543309a39ade2d7c5bf98'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:02.139765 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1035/2091] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:12:01 2022] DELETE /identity/v3/users/f829ea9b22e543309a39ade2d7c5bf98 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:02.140980 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f53e5-09ce-4ff7-aaf3-0762453facb0 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:02.143094 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-2e3f53e5-09ce-4ff7-aaf3-0762453facb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:02.149943 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fa0a9-de7f-4d9f-9be0-9053c710181c admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:02.232630 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f53e5-09ce-4ff7-aaf3-0762453facb0 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:02.237988 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cab9cc-727a-4713-aacb-c522500d39b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:02.240757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cab9cc-727a-4713-aacb-c522500d39b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:02.240757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cab9cc-727a-4713-aacb-c522500d39b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:02.240757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cab9cc-727a-4713-aacb-c522500d39b8 admin admin] PATH_INFO: `/v3/projects/4ccd03d18c9b43e38e808f755e531ea6` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:02.241155 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cab9cc-727a-4713-aacb-c522500d39b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ccd03d18c9b43e38e808f755e531ea6)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:02.243217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cab9cc-727a-4713-aacb-c522500d39b8 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:02.255566 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617d5c2-bdc5-4b07-9e14-047fdc7ec787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:02.257059 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617d5c2-bdc5-4b07-9e14-047fdc7ec787 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:02.257895 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617d5c2-bdc5-4b07-9e14-047fdc7ec787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:02.259045 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617d5c2-bdc5-4b07-9e14-047fdc7ec787 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:02.260892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617d5c2-bdc5-4b07-9e14-047fdc7ec787 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:02.266451 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6617d5c2-bdc5-4b07-9e14-047fdc7ec787 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:02.343525 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-97cab9cc-727a-4713-aacb-c522500d39b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ccd03d18c9b43e38e808f755e531ea6', 'request_id': 'req-97cab9cc-727a-4713-aacb-c522500d39b8'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:02.348799 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1057/2092] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:12:02 2022] POST /identity/v3/users => generated 282 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:12:02.351461 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1f553-edc8-4ea5-97d7-c179f83f4398 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:02.351977 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1f553-edc8-4ea5-97d7-c179f83f4398 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:02.352466 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df1f553-edc8-4ea5-97d7-c179f83f4398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:02.355370 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-97cab9cc-727a-4713-aacb-c522500d39b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ccd03d18c9b43e38e808f755e531ea6', 'request_id': 'req-97cab9cc-727a-4713-aacb-c522500d39b8'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:02.365450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-97cab9cc-727a-4713-aacb-c522500d39b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ccd03d18c9b43e38e808f755e531ea6', 'request_id': 'req-97cab9cc-727a-4713-aacb-c522500d39b8'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:02.389144 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-3df1f553-edc8-4ea5-97d7-c179f83f4398 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:02.390526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-3df1f553-edc8-4ea5-97d7-c179f83f4398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:02.419032 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:02.458337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-97cab9cc-727a-4713-aacb-c522500d39b8 admin admin] The token cache is being invalidate because project 4ccd03d18c9b43e38e808f755e531ea6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:12:02.458658 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-97cab9cc-727a-4713-aacb-c522500d39b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:02.459805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-97cab9cc-727a-4713-aacb-c522500d39b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:02.462586 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1036/2093] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:12:02 2022] DELETE /identity/v3/projects/4ccd03d18c9b43e38e808f755e531ea6 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:02.463853 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cab9cc-727a-4713-aacb-c522500d39b8 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:02.467219 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-97cab9cc-727a-4713-aacb-c522500d39b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:02.482897 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1058/2094] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:02.485548 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032084cf-cc09-4e08-8c11-e034f1b03797 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:02.486105 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032084cf-cc09-4e08-8c11-e034f1b03797 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:02.486902 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032084cf-cc09-4e08-8c11-e034f1b03797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:02.520801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:02.542670 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-032084cf-cc09-4e08-8c11-e034f1b03797 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:02.544409 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-032084cf-cc09-4e08-8c11-e034f1b03797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:02.553131 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1059/2095] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:02.554004 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032084cf-cc09-4e08-8c11-e034f1b03797 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:02.555356 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-032084cf-cc09-4e08-8c11-e034f1b03797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:02.616670 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cab9cc-727a-4713-aacb-c522500d39b8 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:02.624569 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad0b0b-20a3-4c19-96aa-02dfd7896c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:02.625342 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad0b0b-20a3-4c19-96aa-02dfd7896c39 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:02.625715 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad0b0b-20a3-4c19-96aa-02dfd7896c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:02.626419 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad0b0b-20a3-4c19-96aa-02dfd7896c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:02.627607 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad0b0b-20a3-4c19-96aa-02dfd7896c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:02.629704 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad0b0b-20a3-4c19-96aa-02dfd7896c39 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:02.648385 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1037/2096] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:02.649472 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058fd1d-9682-4422-88ed-ed0e98f934a4 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:02.649819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058fd1d-9682-4422-88ed-ed0e98f934a4 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:02.650345 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058fd1d-9682-4422-88ed-ed0e98f934a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:02.664360 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032084cf-cc09-4e08-8c11-e034f1b03797 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:02.671483 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91433412-3d5a-44a2-8e31-f011ce2429f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:02.672122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91433412-3d5a-44a2-8e31-f011ce2429f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:02.672402 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91433412-3d5a-44a2-8e31-f011ce2429f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:02.672998 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91433412-3d5a-44a2-8e31-f011ce2429f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:02.679447 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-0058fd1d-9682-4422-88ed-ed0e98f934a4 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:02.681022 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-0058fd1d-9682-4422-88ed-ed0e98f934a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:02.688233 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91433412-3d5a-44a2-8e31-f011ce2429f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:02.689923 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91433412-3d5a-44a2-8e31-f011ce2429f9 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:02.702185 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1060/2097] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:12:02.704563 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1038/2098] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:02.720156 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058fd1d-9682-4422-88ed-ed0e98f934a4 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:02.728383 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91433412-3d5a-44a2-8e31-f011ce2429f9 service neutron] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:02.734204 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058fd1d-9682-4422-88ed-ed0e98f934a4 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:02.752428 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1177c-42ab-4985-8fc3-bc66d964b2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:02.753055 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1177c-42ab-4985-8fc3-bc66d964b2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:02.753337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1177c-42ab-4985-8fc3-bc66d964b2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:02.753607 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce1177c-42ab-4985-8fc3-bc66d964b2b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:02.754273 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1177c-42ab-4985-8fc3-bc66d964b2b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:12:02.756129 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1177c-42ab-4985-8fc3-bc66d964b2b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:02.756390 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce1177c-42ab-4985-8fc3-bc66d964b2b8 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:02.760683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91433412-3d5a-44a2-8e31-f011ce2429f9 service neutron] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:02.788012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d38cf-4268-4c24-a7b0-477cb059f29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:02.788635 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d38cf-4268-4c24-a7b0-477cb059f29c admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:02.788917 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d38cf-4268-4c24-a7b0-477cb059f29c admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:02.789190 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57d38cf-4268-4c24-a7b0-477cb059f29c admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:02.789842 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d38cf-4268-4c24-a7b0-477cb059f29c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:02.791469 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57d38cf-4268-4c24-a7b0-477cb059f29c admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:02.814946 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1039/2099] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:12:02.819931 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1177c-42ab-4985-8fc3-bc66d964b2b8 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:02.833688 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1061/2100] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:02.835379 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d38cf-4268-4c24-a7b0-477cb059f29c admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:02.843602 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce1177c-42ab-4985-8fc3-bc66d964b2b8 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:02.850142 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5867b9-e9f6-4e5a-b22a-81bfdcb5df1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:02.851358 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5867b9-e9f6-4e5a-b22a-81bfdcb5df1d admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:02.851829 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5867b9-e9f6-4e5a-b22a-81bfdcb5df1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:02.852320 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5867b9-e9f6-4e5a-b22a-81bfdcb5df1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:02.853139 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5867b9-e9f6-4e5a-b22a-81bfdcb5df1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:02.861564 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57d38cf-4268-4c24-a7b0-477cb059f29c admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:02.862768 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5867b9-e9f6-4e5a-b22a-81bfdcb5df1d admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:02.877249 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90382bd3-6c2c-4b0a-be6d-98f61889d030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:02.877967 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90382bd3-6c2c-4b0a-be6d-98f61889d030 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:02.878514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90382bd3-6c2c-4b0a-be6d-98f61889d030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:02.878952 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90382bd3-6c2c-4b0a-be6d-98f61889d030 admin admin] PATH_INFO: `/v3/projects/e1350d448b7f4297948071554264eb81/users/cd2be7c406704510810e485bc3053916/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:02.911804 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90382bd3-6c2c-4b0a-be6d-98f61889d030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1350d448b7f4297948071554264eb81, user_id=cd2be7c406704510810e485bc3053916, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:02.914944 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90382bd3-6c2c-4b0a-be6d-98f61889d030 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:03.028160 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1062/2101] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:12:02 2022] PUT /identity/v3/projects/e1350d448b7f4297948071554264eb81/users/cd2be7c406704510810e485bc3053916/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:03.033364 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90382bd3-6c2c-4b0a-be6d-98f61889d030 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:03.034302 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1040/2102] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:12:02 2022] POST /identity/v3/projects => generated 381 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:12:03.041318 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0098f-7f41-4637-a5f4-f8e29b87e4f3 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:03.041627 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0098f-7f41-4637-a5f4-f8e29b87e4f3 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:03.042007 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0098f-7f41-4637-a5f4-f8e29b87e4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:03.123032 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-87a0098f-7f41-4637-a5f4-f8e29b87e4f3 None None] MFA Rules not processed for user `cd2be7c406704510810e485bc3053916`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:03.126177 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-87a0098f-7f41-4637-a5f4-f8e29b87e4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:03.240504 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90382bd3-6c2c-4b0a-be6d-98f61889d030 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:03.317590 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1041/2103] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:03.328387 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0098f-7f41-4637-a5f4-f8e29b87e4f3 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:03.329926 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-87a0098f-7f41-4637-a5f4-f8e29b87e4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:03.418065 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61e351-a834-44fe-9d8a-d56301701314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:03.419469 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61e351-a834-44fe-9d8a-d56301701314 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:03.420721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61e351-a834-44fe-9d8a-d56301701314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:03.421447 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61e351-a834-44fe-9d8a-d56301701314 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:03.422418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61e351-a834-44fe-9d8a-d56301701314 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:03.425627 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61e351-a834-44fe-9d8a-d56301701314 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:03.484012 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0098f-7f41-4637-a5f4-f8e29b87e4f3 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:03.492829 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd926da-7429-4ead-baa1-9c7d18690cd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:03.493471 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd926da-7429-4ead-baa1-9c7d18690cd5 service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:03.493756 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd926da-7429-4ead-baa1-9c7d18690cd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:03.494035 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd926da-7429-4ead-baa1-9c7d18690cd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:03.516907 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd926da-7429-4ead-baa1-9c7d18690cd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:03.518863 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd926da-7429-4ead-baa1-9c7d18690cd5 service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:03.537744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1042/2104] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:03 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:12:03.565313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1063/2105] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:12:03 2022] POST /identity/v3/users => generated 291 bytes in 532 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:12:03.573487 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61e351-a834-44fe-9d8a-d56301701314 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:03.574870 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd926da-7429-4ead-baa1-9c7d18690cd5 service cinder] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:03.579179 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-2bd926da-7429-4ead-baa1-9c7d18690cd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:03.603682 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61e351-a834-44fe-9d8a-d56301701314 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:03.632831 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f555a1-574b-4ea8-8e80-975256f1d19c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:03.634710 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f555a1-574b-4ea8-8e80-975256f1d19c admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:03.634997 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f555a1-574b-4ea8-8e80-975256f1d19c admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:03.635469 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f555a1-574b-4ea8-8e80-975256f1d19c admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:03.640423 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f555a1-574b-4ea8-8e80-975256f1d19c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:03.640423 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f555a1-574b-4ea8-8e80-975256f1d19c admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:03.641065 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd926da-7429-4ead-baa1-9c7d18690cd5 service cinder] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:03.656089 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519e3fa-d9e3-4453-91db-80bd56ab7a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:03.663208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519e3fa-d9e3-4453-91db-80bd56ab7a6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:03.663208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519e3fa-d9e3-4453-91db-80bd56ab7a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:03.663208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519e3fa-d9e3-4453-91db-80bd56ab7a6d admin admin] PATH_INFO: `/v3/projects/5f9b37e60ffe477db6539a53bc9f3144` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:03.663208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:03.663208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519e3fa-d9e3-4453-91db-80bd56ab7a6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f9b37e60ffe477db6539a53bc9f3144)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:03.664285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1064/2106] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:03.664625 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519e3fa-d9e3-4453-91db-80bd56ab7a6d admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:03.666893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8cbb2-94ac-44c2-9aa0-b26f1258517a None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:03.667520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8cbb2-94ac-44c2-9aa0-b26f1258517a None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:03.667986 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8cbb2-94ac-44c2-9aa0-b26f1258517a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:03.710499 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-c1a8cbb2-94ac-44c2-9aa0-b26f1258517a None None] MFA Rules not processed for user `190cccbe419249338c60fdec264f2bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:03.719037 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-c1a8cbb2-94ac-44c2-9aa0-b26f1258517a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:03.855842 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-5519e3fa-d9e3-4453-91db-80bd56ab7a6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f9b37e60ffe477db6539a53bc9f3144', 'request_id': 'req-5519e3fa-d9e3-4453-91db-80bd56ab7a6d'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:03.866547 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-5519e3fa-d9e3-4453-91db-80bd56ab7a6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f9b37e60ffe477db6539a53bc9f3144', 'request_id': 'req-5519e3fa-d9e3-4453-91db-80bd56ab7a6d'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:03.888971 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1065/2107] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:03.888971 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8cbb2-94ac-44c2-9aa0-b26f1258517a None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:03.891550 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-5519e3fa-d9e3-4453-91db-80bd56ab7a6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f9b37e60ffe477db6539a53bc9f3144', 'request_id': 'req-5519e3fa-d9e3-4453-91db-80bd56ab7a6d'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:03.894751 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8cbb2-94ac-44c2-9aa0-b26f1258517a None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:03.983780 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-5519e3fa-d9e3-4453-91db-80bd56ab7a6d admin admin] The token cache is being invalidate because project 5f9b37e60ffe477db6539a53bc9f3144 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:12:03.984490 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-5519e3fa-d9e3-4453-91db-80bd56ab7a6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:03.985027 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-5519e3fa-d9e3-4453-91db-80bd56ab7a6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:03.987943 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1043/2108] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:12:03 2022] DELETE /identity/v3/projects/5f9b37e60ffe477db6539a53bc9f3144 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:03.991848 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519e3fa-d9e3-4453-91db-80bd56ab7a6d admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:03.993685 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-5519e3fa-d9e3-4453-91db-80bd56ab7a6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:03.993814 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcabc0b2-3b42-4e0b-8516-aab02c8e230d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:03.994376 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabc0b2-3b42-4e0b-8516-aab02c8e230d admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:03.994760 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabc0b2-3b42-4e0b-8516-aab02c8e230d admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:03.995218 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcabc0b2-3b42-4e0b-8516-aab02c8e230d admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:03.995934 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcabc0b2-3b42-4e0b-8516-aab02c8e230d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:03.997908 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcabc0b2-3b42-4e0b-8516-aab02c8e230d admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:04.010421 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1066/2109] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:04.011470 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcabc0b2-3b42-4e0b-8516-aab02c8e230d admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:04.013062 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519e3fa-d9e3-4453-91db-80bd56ab7a6d admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:04.013553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-bcabc0b2-3b42-4e0b-8516-aab02c8e230d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:04.018376 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5bfb6-8887-4fa6-87f3-c57364476eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:04.019206 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5bfb6-8887-4fa6-87f3-c57364476eaa admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:04.019382 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5bfb6-8887-4fa6-87f3-c57364476eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:04.019640 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5bfb6-8887-4fa6-87f3-c57364476eaa admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:04.020419 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5bfb6-8887-4fa6-87f3-c57364476eaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:04.022544 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5bfb6-8887-4fa6-87f3-c57364476eaa admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:04.027803 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcabc0b2-3b42-4e0b-8516-aab02c8e230d admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:04.033784 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db51e8-ca8a-4fe7-9d32-a091be0727b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:04.034437 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db51e8-ca8a-4fe7-9d32-a091be0727b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:04.034852 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db51e8-ca8a-4fe7-9d32-a091be0727b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:04.035145 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db51e8-ca8a-4fe7-9d32-a091be0727b7 admin admin] PATH_INFO: `/v3/users/a1316aa8e151437ea9e71510b7359715` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:04.036364 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31db51e8-ca8a-4fe7-9d32-a091be0727b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1316aa8e151437ea9e71510b7359715)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:04.038589 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31db51e8-ca8a-4fe7-9d32-a091be0727b7 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:04.195850 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1044/2110] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:12:03 2022] POST /identity/v3/projects => generated 373 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:12:04.195850 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5bfb6-8887-4fa6-87f3-c57364476eaa admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:04.195850 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-9dc5bfb6-8887-4fa6-87f3-c57364476eaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:04.270004 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5bfb6-8887-4fa6-87f3-c57364476eaa admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:04.274995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a034a-beb8-413c-9a2c-6e62a7d0ae71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:04.276019 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a034a-beb8-413c-9a2c-6e62a7d0ae71 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:04.276304 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a034a-beb8-413c-9a2c-6e62a7d0ae71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:04.276611 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a034a-beb8-413c-9a2c-6e62a7d0ae71 admin admin] PATH_INFO: `/v3/projects/0d32ba55a3134a41aaebfc4ca9c28770/users/8260bc632db74635ac673e9314a772f3/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:04.292220 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a034a-beb8-413c-9a2c-6e62a7d0ae71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d32ba55a3134a41aaebfc4ca9c28770, user_id=8260bc632db74635ac673e9314a772f3, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:04.295964 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a034a-beb8-413c-9a2c-6e62a7d0ae71 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:04.330234 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-31db51e8-ca8a-4fe7-9d32-a091be0727b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1316aa8e151437ea9e71510b7359715'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:04.337205 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-31db51e8-ca8a-4fe7-9d32-a091be0727b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1316aa8e151437ea9e71510b7359715'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:04.417708 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1045/2111] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:12:04 2022] PUT /identity/v3/projects/0d32ba55a3134a41aaebfc4ca9c28770/users/8260bc632db74635ac673e9314a772f3/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:04.418617 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a034a-beb8-413c-9a2c-6e62a7d0ae71 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:04.475679 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:DELETE=16,keystone:SELECT=79,keystone:INSERT=5 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:04.476278 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-31db51e8-ca8a-4fe7-9d32-a091be0727b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1316aa8e151437ea9e71510b7359715'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:04.476996 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-31db51e8-ca8a-4fe7-9d32-a091be0727b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1316aa8e151437ea9e71510b7359715'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:04.477639 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-31db51e8-ca8a-4fe7-9d32-a091be0727b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1316aa8e151437ea9e71510b7359715'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:04.493119 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a034a-beb8-413c-9a2c-6e62a7d0ae71 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:04.499176 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3a7fb-a4d4-4278-bffb-1b57005ed31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:04.499705 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3a7fb-a4d4-4278-bffb-1b57005ed31b admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:04.499983 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3a7fb-a4d4-4278-bffb-1b57005ed31b admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:04.500252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d3a7fb-a4d4-4278-bffb-1b57005ed31b admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:04.500883 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3a7fb-a4d4-4278-bffb-1b57005ed31b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:04.502419 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1067/2112] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:12:04 2022] DELETE /identity/v3/users/a1316aa8e151437ea9e71510b7359715 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:04.503475 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496f047-4425-43bb-99a0-7c1a08eb41e1 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:04.503759 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496f047-4425-43bb-99a0-7c1a08eb41e1 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:04.504027 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496f047-4425-43bb-99a0-7c1a08eb41e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:04.505959 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d3a7fb-a4d4-4278-bffb-1b57005ed31b admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:04.536545 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-b496f047-4425-43bb-99a0-7c1a08eb41e1 None None] MFA Rules not processed for user `8260bc632db74635ac673e9314a772f3`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:04.537909 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-b496f047-4425-43bb-99a0-7c1a08eb41e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:04.614462 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1068/2113] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:04.619571 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496f047-4425-43bb-99a0-7c1a08eb41e1 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:04.621250 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-b496f047-4425-43bb-99a0-7c1a08eb41e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:04.631152 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1046/2114] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:12:04 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:12:04.636253 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3a7fb-a4d4-4278-bffb-1b57005ed31b admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:04.638161 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-e4d3a7fb-a4d4-4278-bffb-1b57005ed31b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:04.671102 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d3a7fb-a4d4-4278-bffb-1b57005ed31b admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:04.707803 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496f047-4425-43bb-99a0-7c1a08eb41e1 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:04.713109 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe68dc-defe-41dd-a21e-57e2835039b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:04.714000 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe68dc-defe-41dd-a21e-57e2835039b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:04.714379 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe68dc-defe-41dd-a21e-57e2835039b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:04.714725 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbe68dc-defe-41dd-a21e-57e2835039b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:04.715550 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe68dc-defe-41dd-a21e-57e2835039b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:04.718799 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbe68dc-defe-41dd-a21e-57e2835039b5 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:04.750285 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5d4b4-44a4-4500-9a00-3f78169059da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:04.750865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5d4b4-44a4-4500-9a00-3f78169059da admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:04.751173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5d4b4-44a4-4500-9a00-3f78169059da admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:04.751446 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5d4b4-44a4-4500-9a00-3f78169059da admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:04.752157 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db5d4b4-44a4-4500-9a00-3f78169059da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:04.753963 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db5d4b4-44a4-4500-9a00-3f78169059da admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:04.769379 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1047/2115] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:04.770487 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5d4b4-44a4-4500-9a00-3f78169059da admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:04.790746 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5d4b4-44a4-4500-9a00-3f78169059da admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:04.796932 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8b4f9-fc25-4ccb-9215-814aaec3ce13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:04.797824 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8b4f9-fc25-4ccb-9215-814aaec3ce13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:04.799545 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8b4f9-fc25-4ccb-9215-814aaec3ce13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:04.799862 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8b4f9-fc25-4ccb-9215-814aaec3ce13 admin admin] PATH_INFO: `/v3/projects/0098a14dbf494aa8940e4cc3e69b0894/users/7c4e022b582942cea096bb8f6062ce80/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:04.829790 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8b4f9-fc25-4ccb-9215-814aaec3ce13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0098a14dbf494aa8940e4cc3e69b0894, user_id=7c4e022b582942cea096bb8f6062ce80, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:04.833175 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e8b4f9-fc25-4ccb-9215-814aaec3ce13 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:04.889121 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1069/2116] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:12:04 2022] POST /identity/v3/projects => generated 379 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:12:04.892109 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe68dc-defe-41dd-a21e-57e2835039b5 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:04.967088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1048/2117] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:12:04 2022] PUT /identity/v3/projects/0098a14dbf494aa8940e4cc3e69b0894/users/7c4e022b582942cea096bb8f6062ce80/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:12:04.968905 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8b4f9-fc25-4ccb-9215-814aaec3ce13 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:04.992985 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbe68dc-defe-41dd-a21e-57e2835039b5 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:05.070249 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8b4f9-fc25-4ccb-9215-814aaec3ce13 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:05.070667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986a273-bb52-4a73-8ec2-dea470e64ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:05.071423 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986a273-bb52-4a73-8ec2-dea470e64ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:05.071923 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986a273-bb52-4a73-8ec2-dea470e64ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:05.072321 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7986a273-bb52-4a73-8ec2-dea470e64ca8 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:05.073028 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986a273-bb52-4a73-8ec2-dea470e64ca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:05.074948 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7986a273-bb52-4a73-8ec2-dea470e64ca8 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:05.076219 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97c121-d82f-41d7-bf4f-478418ca0e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:05.076731 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97c121-d82f-41d7-bf4f-478418ca0e49 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:05.077038 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97c121-d82f-41d7-bf4f-478418ca0e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:05.077351 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97c121-d82f-41d7-bf4f-478418ca0e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:05.078068 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97c121-d82f-41d7-bf4f-478418ca0e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:05.079771 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97c121-d82f-41d7-bf4f-478418ca0e49 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:05.092012 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1049/2118] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:05.096333 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97c121-d82f-41d7-bf4f-478418ca0e49 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:05.109431 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97c121-d82f-41d7-bf4f-478418ca0e49 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:05.114703 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47efc1-fc6e-4ca6-bb0b-8bcd80c42365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:05.115488 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47efc1-fc6e-4ca6-bb0b-8bcd80c42365 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:05.115821 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47efc1-fc6e-4ca6-bb0b-8bcd80c42365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:05.116135 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47efc1-fc6e-4ca6-bb0b-8bcd80c42365 admin admin] PATH_INFO: `/v3/projects/0098a14dbf494aa8940e4cc3e69b0894/users/7c4e022b582942cea096bb8f6062ce80/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:05.118468 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47efc1-fc6e-4ca6-bb0b-8bcd80c42365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0098a14dbf494aa8940e4cc3e69b0894, user_id=7c4e022b582942cea096bb8f6062ce80, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:05.126884 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47efc1-fc6e-4ca6-bb0b-8bcd80c42365 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:05.141202 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1050/2119] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:12:05 2022] PUT /identity/v3/projects/0098a14dbf494aa8940e4cc3e69b0894/users/7c4e022b582942cea096bb8f6062ce80/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:05.141202 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47efc1-fc6e-4ca6-bb0b-8bcd80c42365 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:05.143249 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-aa47efc1-fc6e-4ca6-bb0b-8bcd80c42365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:05.178283 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1070/2120] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:12:04 2022] POST /identity/v3/users => generated 296 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:12:05.182860 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986a273-bb52-4a73-8ec2-dea470e64ca8 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:05.197172 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7986a273-bb52-4a73-8ec2-dea470e64ca8 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:05.274578 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47efc1-fc6e-4ca6-bb0b-8bcd80c42365 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:05.280783 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bc3d80-ee87-4385-85e1-d9c5d33d85bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:05.281531 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc3d80-ee87-4385-85e1-d9c5d33d85bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:05.281889 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc3d80-ee87-4385-85e1-d9c5d33d85bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:05.282280 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bc3d80-ee87-4385-85e1-d9c5d33d85bc admin admin] PATH_INFO: `/v3/projects/3b641e8a0cb44f22996c9938a0131197` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:05.283929 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc3d80-ee87-4385-85e1-d9c5d33d85bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b641e8a0cb44f22996c9938a0131197)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:05.286464 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bc3d80-ee87-4385-85e1-d9c5d33d85bc admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:05.302898 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43625e55-fabb-45bd-9435-71d0d53ccca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:05.303561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43625e55-fabb-45bd-9435-71d0d53ccca5 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:05.303842 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43625e55-fabb-45bd-9435-71d0d53ccca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:05.304111 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43625e55-fabb-45bd-9435-71d0d53ccca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:05.304773 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43625e55-fabb-45bd-9435-71d0d53ccca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:05.311915 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43625e55-fabb-45bd-9435-71d0d53ccca5 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:05.331527 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1071/2121] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:12:05.335743 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43625e55-fabb-45bd-9435-71d0d53ccca5 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:05.354811 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43625e55-fabb-45bd-9435-71d0d53ccca5 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:05.363490 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df1c20-3784-43b9-92c4-db291a5a6f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:05.364667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df1c20-3784-43b9-92c4-db291a5a6f14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:05.365054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df1c20-3784-43b9-92c4-db291a5a6f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:05.365466 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df1c20-3784-43b9-92c4-db291a5a6f14 admin admin] PATH_INFO: `/v3/projects/f7eb698dc30045ac9dd5f25293d43654/users/736b00712abf4047b22beeab1b4d3cec/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:05.392931 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df1c20-3784-43b9-92c4-db291a5a6f14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7eb698dc30045ac9dd5f25293d43654, user_id=736b00712abf4047b22beeab1b4d3cec, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:05.396379 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df1c20-3784-43b9-92c4-db291a5a6f14 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:05.464468 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1072/2122] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:12:05 2022] PUT /identity/v3/projects/f7eb698dc30045ac9dd5f25293d43654/users/736b00712abf4047b22beeab1b4d3cec/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:05.468535 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df1c20-3784-43b9-92c4-db291a5a6f14 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:05.475655 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-84bc3d80-ee87-4385-85e1-d9c5d33d85bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b641e8a0cb44f22996c9938a0131197', 'request_id': 'req-84bc3d80-ee87-4385-85e1-d9c5d33d85bc'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:05.483948 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-84bc3d80-ee87-4385-85e1-d9c5d33d85bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b641e8a0cb44f22996c9938a0131197', 'request_id': 'req-84bc3d80-ee87-4385-85e1-d9c5d33d85bc'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:05.491147 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-84bc3d80-ee87-4385-85e1-d9c5d33d85bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b641e8a0cb44f22996c9938a0131197', 'request_id': 'req-84bc3d80-ee87-4385-85e1-d9c5d33d85bc'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:05.551797 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df1c20-3784-43b9-92c4-db291a5a6f14 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:05.571743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-84bc3d80-ee87-4385-85e1-d9c5d33d85bc admin admin] The token cache is being invalidate because project 3b641e8a0cb44f22996c9938a0131197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:12:05.572234 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-84bc3d80-ee87-4385-85e1-d9c5d33d85bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:05.573697 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-84bc3d80-ee87-4385-85e1-d9c5d33d85bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:05.574921 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1051/2123] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:12:05 2022] DELETE /identity/v3/projects/3b641e8a0cb44f22996c9938a0131197 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:05.582581 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9a51e-dd8c-4912-8fd8-a3e860e50fa4 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:05.582944 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9a51e-dd8c-4912-8fd8-a3e860e50fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:05.583312 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b9a51e-dd8c-4912-8fd8-a3e860e50fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:05.629127 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-a6b9a51e-dd8c-4912-8fd8-a3e860e50fa4 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:05.631486 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-a6b9a51e-dd8c-4912-8fd8-a3e860e50fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:05.646738 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ef003-8071-40c4-a650-fd1d90b7bb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:05.647391 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ef003-8071-40c4-a650-fd1d90b7bb78 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:05.647701 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ef003-8071-40c4-a650-fd1d90b7bb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:05.647975 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ef003-8071-40c4-a650-fd1d90b7bb78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:05.648851 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ef003-8071-40c4-a650-fd1d90b7bb78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:05.650484 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ef003-8071-40c4-a650-fd1d90b7bb78 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:05.667526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1073/2124] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:05.670026 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ef003-8071-40c4-a650-fd1d90b7bb78 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:05.675523 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-e99ef003-8071-40c4-a650-fd1d90b7bb78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:05.694908 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ef003-8071-40c4-a650-fd1d90b7bb78 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:05.705264 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3e2ba1-496d-4003-ae03-152b0f589856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:05.706402 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e2ba1-496d-4003-ae03-152b0f589856 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:05.706907 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e2ba1-496d-4003-ae03-152b0f589856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:05.707438 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3e2ba1-496d-4003-ae03-152b0f589856 admin admin] PATH_INFO: `/v3/projects/f7eb698dc30045ac9dd5f25293d43654/users/736b00712abf4047b22beeab1b4d3cec/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:05.712262 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e2ba1-496d-4003-ae03-152b0f589856 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7eb698dc30045ac9dd5f25293d43654, user_id=736b00712abf4047b22beeab1b4d3cec, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:05.720274 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1052/2125] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:05.724139 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3e2ba1-496d-4003-ae03-152b0f589856 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:05.728075 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f21532-34e8-473d-8105-0493a65f6823 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:05.728367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f21532-34e8-473d-8105-0493a65f6823 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:05.728644 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f21532-34e8-473d-8105-0493a65f6823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:05.753248 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-80f21532-34e8-473d-8105-0493a65f6823 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:05.755393 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-80f21532-34e8-473d-8105-0493a65f6823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:05.760787 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1074/2126] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:12:05 2022] PUT /identity/v3/projects/f7eb698dc30045ac9dd5f25293d43654/users/736b00712abf4047b22beeab1b4d3cec/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:05.771267 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29255c-d582-4dd3-bd6e-f025c95f1e40 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:05.771776 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29255c-d582-4dd3-bd6e-f025c95f1e40 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:05.772322 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29255c-d582-4dd3-bd6e-f025c95f1e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:05.822993 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-0f29255c-d582-4dd3-bd6e-f025c95f1e40 None None] MFA Rules not processed for user `736b00712abf4047b22beeab1b4d3cec`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:05.825423 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-0f29255c-d582-4dd3-bd6e-f025c95f1e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:05.841201 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:05.933427 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1053/2127] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:12:05.938921 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f21532-34e8-473d-8105-0493a65f6823 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:05.949469 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f21532-34e8-473d-8105-0493a65f6823 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:05.955497 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16fed1-60af-44a0-a489-e1e4e8e122af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:05.956119 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16fed1-60af-44a0-a489-e1e4e8e122af admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:05.956398 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16fed1-60af-44a0-a489-e1e4e8e122af admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:05.956674 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b16fed1-60af-44a0-a489-e1e4e8e122af admin admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:05.957546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16fed1-60af-44a0-a489-e1e4e8e122af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:12:05.957670 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16fed1-60af-44a0-a489-e1e4e8e122af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:05.959534 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b16fed1-60af-44a0-a489-e1e4e8e122af admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:05.975642 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1054/2128] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:12:05.978089 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16fed1-60af-44a0-a489-e1e4e8e122af admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:05.998373 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b16fed1-60af-44a0-a489-e1e4e8e122af admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:06.006308 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd87ef-4ea8-41f7-94ab-a0c02835b0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:06.006308 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd87ef-4ea8-41f7-94ab-a0c02835b0b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:06.006557 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd87ef-4ea8-41f7-94ab-a0c02835b0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:06.006714 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd87ef-4ea8-41f7-94ab-a0c02835b0b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:06.007392 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd87ef-4ea8-41f7-94ab-a0c02835b0b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:06.009985 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd87ef-4ea8-41f7-94ab-a0c02835b0b2 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:06.034527 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1075/2129] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:05 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:12:06.080220 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29255c-d582-4dd3-bd6e-f025c95f1e40 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:06.084260 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-0f29255c-d582-4dd3-bd6e-f025c95f1e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:06.170858 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1055/2130] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:12:05 2022] POST /identity/v3/projects => generated 381 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:12:06.172850 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd87ef-4ea8-41f7-94ab-a0c02835b0b2 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:06.189328 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29255c-d582-4dd3-bd6e-f025c95f1e40 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:06.313525 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aea88a-330f-41db-b81c-c4bc7364a903 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:06.315398 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aea88a-330f-41db-b81c-c4bc7364a903 service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:06.315398 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aea88a-330f-41db-b81c-c4bc7364a903 service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:06.315398 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aea88a-330f-41db-b81c-c4bc7364a903 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:06.323071 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd87ef-4ea8-41f7-94ab-a0c02835b0b2 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:06.329722 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73807a51-fb29-4c37-8964-27e0ce726ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:06.330351 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73807a51-fb29-4c37-8964-27e0ce726ae5 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:06.331499 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73807a51-fb29-4c37-8964-27e0ce726ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:06.331789 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73807a51-fb29-4c37-8964-27e0ce726ae5 admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:06.333217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73807a51-fb29-4c37-8964-27e0ce726ae5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:06.335897 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73807a51-fb29-4c37-8964-27e0ce726ae5 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:06.412927 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1056/2131] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:12:06 2022] POST /identity/v3/users => generated 291 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:12:06.413136 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aea88a-330f-41db-b81c-c4bc7364a903 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:06.414155 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73807a51-fb29-4c37-8964-27e0ce726ae5 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:06.414972 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aea88a-330f-41db-b81c-c4bc7364a903 service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:06.430465 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1076/2132] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:06 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:12:06.437983 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73807a51-fb29-4c37-8964-27e0ce726ae5 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:06.456237 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b2a3d-ba59-4405-ae0c-d50ddf95243a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:06.457805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b2a3d-ba59-4405-ae0c-d50ddf95243a admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:06.458275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b2a3d-ba59-4405-ae0c-d50ddf95243a admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:06.458690 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140b2a3d-ba59-4405-ae0c-d50ddf95243a admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:06.459657 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b2a3d-ba59-4405-ae0c-d50ddf95243a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:06.461733 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140b2a3d-ba59-4405-ae0c-d50ddf95243a admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:06.478703 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1057/2133] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:06.492638 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:06.495486 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aea88a-330f-41db-b81c-c4bc7364a903 service cinder] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:06.508888 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aea88a-330f-41db-b81c-c4bc7364a903 service cinder] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:06.514954 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f21c8-42ee-46ad-b629-d764e7963a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:06.515805 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f21c8-42ee-46ad-b629-d764e7963a1d admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:06.516610 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f21c8-42ee-46ad-b629-d764e7963a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:06.516610 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f21c8-42ee-46ad-b629-d764e7963a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:06.517302 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447f21c8-42ee-46ad-b629-d764e7963a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:06.519102 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447f21c8-42ee-46ad-b629-d764e7963a1d admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:06.533973 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1077/2134] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:06.538780 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b2a3d-ba59-4405-ae0c-d50ddf95243a admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:06.562242 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140b2a3d-ba59-4405-ae0c-d50ddf95243a admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:06.574569 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f21c8-42ee-46ad-b629-d764e7963a1d admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:06.580267 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e441d488-4f21-4933-a8b1-79c66bb3548d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:06.588310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447f21c8-42ee-46ad-b629-d764e7963a1d admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:06.588505 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441d488-4f21-4933-a8b1-79c66bb3548d admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:06.588505 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441d488-4f21-4933-a8b1-79c66bb3548d admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:06.588505 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441d488-4f21-4933-a8b1-79c66bb3548d admin admin] PATH_INFO: `/v3/projects/dfc89b06a3954d7d93c7b22116485768/users/35e93f2205cb4232a060462a1d8befbc/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:06.600806 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d267e-10f7-41bb-a5e4-9d18396c4e27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:06.601524 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d267e-10f7-41bb-a5e4-9d18396c4e27 service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:06.601878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d267e-10f7-41bb-a5e4-9d18396c4e27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:06.602223 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d267e-10f7-41bb-a5e4-9d18396c4e27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:06.604994 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-bd7d267e-10f7-41bb-a5e4-9d18396c4e27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:06.620006 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e441d488-4f21-4933-a8b1-79c66bb3548d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfc89b06a3954d7d93c7b22116485768, user_id=35e93f2205cb4232a060462a1d8befbc, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:06.625192 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e441d488-4f21-4933-a8b1-79c66bb3548d admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:06.698280 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1058/2135] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:12:06 2022] PUT /identity/v3/projects/dfc89b06a3954d7d93c7b22116485768/users/35e93f2205cb4232a060462a1d8befbc/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:06.702898 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d267e-10f7-41bb-a5e4-9d18396c4e27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:06.704751 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d267e-10f7-41bb-a5e4-9d18396c4e27 service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:06.715160 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953e156-473c-46e4-b18b-7004719d3b83 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:06.717403 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953e156-473c-46e4-b18b-7004719d3b83 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:06.717771 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953e156-473c-46e4-b18b-7004719d3b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:06.721220 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1078/2136] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:06 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:12:06.778783 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-7953e156-473c-46e4-b18b-7004719d3b83 None None] MFA Rules not processed for user `35e93f2205cb4232a060462a1d8befbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:06.780474 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-7953e156-473c-46e4-b18b-7004719d3b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:06.906807 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1059/2137] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:06.910971 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d267e-10f7-41bb-a5e4-9d18396c4e27 service cinder] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:06.922324 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d267e-10f7-41bb-a5e4-9d18396c4e27 service cinder] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:07.031282 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21214a-089b-4281-8e6d-39eeef381425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:07.032036 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21214a-089b-4281-8e6d-39eeef381425 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:07.032502 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21214a-089b-4281-8e6d-39eeef381425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:07.032873 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21214a-089b-4281-8e6d-39eeef381425 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:07.034499 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21214a-089b-4281-8e6d-39eeef381425 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:07.036615 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21214a-089b-4281-8e6d-39eeef381425 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:07.184944 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1079/2138] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:12:06 2022] POST /identity/v3/projects => generated 383 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:12:07.186779 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953e156-473c-46e4-b18b-7004719d3b83 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:07.223852 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953e156-473c-46e4-b18b-7004719d3b83 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:07.330028 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59de9c4-5a80-4c5e-91cd-2749db240f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:07.330840 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59de9c4-5a80-4c5e-91cd-2749db240f69 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:07.331138 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59de9c4-5a80-4c5e-91cd-2749db240f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:07.331433 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59de9c4-5a80-4c5e-91cd-2749db240f69 admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:07.332125 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59de9c4-5a80-4c5e-91cd-2749db240f69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:07.334331 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59de9c4-5a80-4c5e-91cd-2749db240f69 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:07.437062 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1060/2139] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:12:07 2022] POST /identity/v3/users => generated 298 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:12:07.441503 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21214a-089b-4281-8e6d-39eeef381425 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:07.461955 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21214a-089b-4281-8e6d-39eeef381425 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:07.494830 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bbeb97-4b66-4cd3-87af-14c801e4a3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:07.495082 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59de9c4-5a80-4c5e-91cd-2749db240f69 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:07.495554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bbeb97-4b66-4cd3-87af-14c801e4a3a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:07.495834 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bbeb97-4b66-4cd3-87af-14c801e4a3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:07.496104 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bbeb97-4b66-4cd3-87af-14c801e4a3a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:07.496761 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bbeb97-4b66-4cd3-87af-14c801e4a3a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:07.498989 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bbeb97-4b66-4cd3-87af-14c801e4a3a7 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:07.499973 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-f59de9c4-5a80-4c5e-91cd-2749db240f69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:07.527512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1080/2140] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:07.529025 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bbeb97-4b66-4cd3-87af-14c801e4a3a7 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:07.552673 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bbeb97-4b66-4cd3-87af-14c801e4a3a7 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:07.558434 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37caa03a-6170-47ef-b03d-eb07f16dc309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:07.559391 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caa03a-6170-47ef-b03d-eb07f16dc309 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:07.559391 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caa03a-6170-47ef-b03d-eb07f16dc309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:07.559958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caa03a-6170-47ef-b03d-eb07f16dc309 admin admin] PATH_INFO: `/v3/projects/35643beb05e441f2b1c1306310ad5c4c/users/3667a6d95b2646e1bb72892f58fbe159/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:07.578666 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37caa03a-6170-47ef-b03d-eb07f16dc309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35643beb05e441f2b1c1306310ad5c4c, user_id=3667a6d95b2646e1bb72892f58fbe159, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:07.581711 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37caa03a-6170-47ef-b03d-eb07f16dc309 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:07.643013 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59de9c4-5a80-4c5e-91cd-2749db240f69 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:07.648125 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e1541-3372-4c84-9518-7c89f5b66b6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:07.648942 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e1541-3372-4c84-9518-7c89f5b66b6e service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:07.649446 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e1541-3372-4c84-9518-7c89f5b66b6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:07.649977 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e1541-3372-4c84-9518-7c89f5b66b6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:07.652204 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-9a6e1541-3372-4c84-9518-7c89f5b66b6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:07.683050 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1081/2141] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:12:07 2022] PUT /identity/v3/projects/35643beb05e441f2b1c1306310ad5c4c/users/3667a6d95b2646e1bb72892f58fbe159/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:07.687736 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37caa03a-6170-47ef-b03d-eb07f16dc309 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:07.806497 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e1541-3372-4c84-9518-7c89f5b66b6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:07.811191 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e1541-3372-4c84-9518-7c89f5b66b6e service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:07.824506 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:07.837591 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1061/2142] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:07 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:12:07.862653 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37caa03a-6170-47ef-b03d-eb07f16dc309 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:07.880576 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67280cf5-9048-48ed-b802-d570dc79b709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:07.882164 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67280cf5-9048-48ed-b802-d570dc79b709 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:07.883679 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67280cf5-9048-48ed-b802-d570dc79b709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:07.884308 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67280cf5-9048-48ed-b802-d570dc79b709 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:07.885845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67280cf5-9048-48ed-b802-d570dc79b709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:07.894373 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67280cf5-9048-48ed-b802-d570dc79b709 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:07.909596 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:07.918503 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1082/2143] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:07.922351 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e1541-3372-4c84-9518-7c89f5b66b6e service cinder] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:07.934981 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e1541-3372-4c84-9518-7c89f5b66b6e service cinder] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:07.949602 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec13ab-47c1-4a32-85d5-35bc9b054794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:07.950365 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec13ab-47c1-4a32-85d5-35bc9b054794 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:07.950720 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec13ab-47c1-4a32-85d5-35bc9b054794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:07.950999 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec13ab-47c1-4a32-85d5-35bc9b054794 admin admin] PATH_INFO: `/v3/projects/35643beb05e441f2b1c1306310ad5c4c/users/3667a6d95b2646e1bb72892f58fbe159/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:07.953211 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec13ab-47c1-4a32-85d5-35bc9b054794 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35643beb05e441f2b1c1306310ad5c4c, user_id=3667a6d95b2646e1bb72892f58fbe159, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:07.956030 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec13ab-47c1-4a32-85d5-35bc9b054794 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:07.968619 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1062/2144] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:12:07 2022] PUT /identity/v3/projects/35643beb05e441f2b1c1306310ad5c4c/users/3667a6d95b2646e1bb72892f58fbe159/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:07.979145 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa9ebb-77ad-4191-99ed-292d0073e82d None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:07.979862 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa9ebb-77ad-4191-99ed-292d0073e82d None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:07.980329 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa9ebb-77ad-4191-99ed-292d0073e82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:08.020551 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-a0fa9ebb-77ad-4191-99ed-292d0073e82d None None] MFA Rules not processed for user `3667a6d95b2646e1bb72892f58fbe159`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:08.021574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-a0fa9ebb-77ad-4191-99ed-292d0073e82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:08.109478 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1083/2145] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:08.400880 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec13ab-47c1-4a32-85d5-35bc9b054794 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:08.515884 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec13ab-47c1-4a32-85d5-35bc9b054794 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:08.520784 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba55fd-019d-48d0-95bc-aedfe74b2e49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:08.522154 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba55fd-019d-48d0-95bc-aedfe74b2e49 service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:08.522545 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba55fd-019d-48d0-95bc-aedfe74b2e49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:08.522909 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba55fd-019d-48d0-95bc-aedfe74b2e49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:08.542979 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eba55fd-019d-48d0-95bc-aedfe74b2e49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:08.545064 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eba55fd-019d-48d0-95bc-aedfe74b2e49 service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:08.567470 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1063/2146] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:08 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:12:08.838418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa9ebb-77ad-4191-99ed-292d0073e82d None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:08.851835 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa9ebb-77ad-4191-99ed-292d0073e82d None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:08.865210 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0241c-9feb-4a9f-b016-7b80d66978e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:08.865749 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0241c-9feb-4a9f-b016-7b80d66978e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:08.866027 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0241c-9feb-4a9f-b016-7b80d66978e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:08.872565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0241c-9feb-4a9f-b016-7b80d66978e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:08.956850 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0241c-9feb-4a9f-b016-7b80d66978e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:08.958668 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0241c-9feb-4a9f-b016-7b80d66978e9 service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:08.983957 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1084/2147] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:12:09.022237 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:09.133924 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:10.388690 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:11.017748 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:11.674831 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:12.004479 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17ba94-8204-4bd0-943b-b71fc245e198 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:12.004764 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17ba94-8204-4bd0-943b-b71fc245e198 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:12.005037 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17ba94-8204-4bd0-943b-b71fc245e198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:12.043887 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-ab17ba94-8204-4bd0-943b-b71fc245e198 None None] MFA Rules not processed for user `7c4e022b582942cea096bb8f6062ce80`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:12.045764 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-ab17ba94-8204-4bd0-943b-b71fc245e198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:12.125325 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1064/2148] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:12.140441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0241c-9feb-4a9f-b016-7b80d66978e9 service cinder] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:12.142271 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-5af0241c-9feb-4a9f-b016-7b80d66978e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:12.182943 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:12.260106 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0241c-9feb-4a9f-b016-7b80d66978e9 service cinder] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:12.276244 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1410712-6e57-400e-8e64-b8e21622cb0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:12.276870 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1410712-6e57-400e-8e64-b8e21622cb0f service nova] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:12.277147 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1410712-6e57-400e-8e64-b8e21622cb0f service nova] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:12.277411 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1410712-6e57-400e-8e64-b8e21622cb0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:12.280676 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-d1410712-6e57-400e-8e64-b8e21622cb0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:12.354365 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1410712-6e57-400e-8e64-b8e21622cb0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:12.356082 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1410712-6e57-400e-8e64-b8e21622cb0f service nova] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:12.367447 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1085/2149] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:12:12.422834 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17ba94-8204-4bd0-943b-b71fc245e198 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:12.560628 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17ba94-8204-4bd0-943b-b71fc245e198 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:12.567944 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9cebc-7d65-45a2-8536-0d587406d756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:12.568668 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9cebc-7d65-45a2-8536-0d587406d756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:12.568945 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9cebc-7d65-45a2-8536-0d587406d756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:12.569324 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9cebc-7d65-45a2-8536-0d587406d756 admin admin] PATH_INFO: `/v3/users/35e93f2205cb4232a060462a1d8befbc` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:12.572124 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e9cebc-7d65-45a2-8536-0d587406d756 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35e93f2205cb4232a060462a1d8befbc)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:12.575847 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e9cebc-7d65-45a2-8536-0d587406d756 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:12.582599 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1410712-6e57-400e-8e64-b8e21622cb0f service nova] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:12.585224 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-d1410712-6e57-400e-8e64-b8e21622cb0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:12.601596 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1410712-6e57-400e-8e64-b8e21622cb0f service nova] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:12.609448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94784255-834c-4503-bb9b-7694aa7a688a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:12.611181 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94784255-834c-4503-bb9b-7694aa7a688a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:12.611475 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94784255-834c-4503-bb9b-7694aa7a688a admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:12.611916 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94784255-834c-4503-bb9b-7694aa7a688a admin admin] PATH_INFO: `/v3/users/11f4031385a048b78f7ebfadf5fe7ec6` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:12.614154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94784255-834c-4503-bb9b-7694aa7a688a admin admin] RBAC: Authorizing `identity:delete_user(user_id=11f4031385a048b78f7ebfadf5fe7ec6)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:12.616560 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94784255-834c-4503-bb9b-7694aa7a688a admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:12.792755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-47e9cebc-7d65-45a2-8536-0d587406d756 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35e93f2205cb4232a060462a1d8befbc'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:12.793421 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-94784255-834c-4503-bb9b-7694aa7a688a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11f4031385a048b78f7ebfadf5fe7ec6'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:12.794663 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-47e9cebc-7d65-45a2-8536-0d587406d756 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35e93f2205cb4232a060462a1d8befbc'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:12.802124 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-47e9cebc-7d65-45a2-8536-0d587406d756 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35e93f2205cb4232a060462a1d8befbc'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:12.802882 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-47e9cebc-7d65-45a2-8536-0d587406d756 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35e93f2205cb4232a060462a1d8befbc'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:12.802990 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-94784255-834c-4503-bb9b-7694aa7a688a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11f4031385a048b78f7ebfadf5fe7ec6'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:12.840569 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:12.880294 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-47e9cebc-7d65-45a2-8536-0d587406d756 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35e93f2205cb4232a060462a1d8befbc'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:12.899089 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1065/2150] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:12:12 2022] DELETE /identity/v3/users/35e93f2205cb4232a060462a1d8befbc => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:12.903632 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116cef5-2f5d-465f-aec7-e74ab164be04 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:12.903911 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116cef5-2f5d-465f-aec7-e74ab164be04 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:12.904180 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116cef5-2f5d-465f-aec7-e74ab164be04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:12.924169 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-f116cef5-2f5d-465f-aec7-e74ab164be04 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:12.925483 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-f116cef5-2f5d-465f-aec7-e74ab164be04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:12.991911 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1066/2151] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:12:12.992104 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-94784255-834c-4503-bb9b-7694aa7a688a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11f4031385a048b78f7ebfadf5fe7ec6'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:12.992104 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-94784255-834c-4503-bb9b-7694aa7a688a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11f4031385a048b78f7ebfadf5fe7ec6'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:12.992104 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-94784255-834c-4503-bb9b-7694aa7a688a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11f4031385a048b78f7ebfadf5fe7ec6'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:13.001388 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116cef5-2f5d-465f-aec7-e74ab164be04 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:13.003361 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-f116cef5-2f5d-465f-aec7-e74ab164be04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:13.014179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1086/2152] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:12:12 2022] DELETE /identity/v3/users/11f4031385a048b78f7ebfadf5fe7ec6 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:13.018558 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cd697-6305-4690-bb3b-42991c8e88b1 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:13.018833 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cd697-6305-4690-bb3b-42991c8e88b1 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:13.019100 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cd697-6305-4690-bb3b-42991c8e88b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:13.039170 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-840cd697-6305-4690-bb3b-42991c8e88b1 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:13.040541 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-840cd697-6305-4690-bb3b-42991c8e88b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:13.064393 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116cef5-2f5d-465f-aec7-e74ab164be04 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:13.102535 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1087/2153] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:13.114545 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840cd697-6305-4690-bb3b-42991c8e88b1 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:13.116035 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-840cd697-6305-4690-bb3b-42991c8e88b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:13.118363 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc530abd-cb2f-4cbe-96b7-e0c7bbdb5b03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:13.119216 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc530abd-cb2f-4cbe-96b7-e0c7bbdb5b03 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:13.119663 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc530abd-cb2f-4cbe-96b7-e0c7bbdb5b03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:13.120249 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc530abd-cb2f-4cbe-96b7-e0c7bbdb5b03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:13.122976 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-cc530abd-cb2f-4cbe-96b7-e0c7bbdb5b03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:13.129423 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840cd697-6305-4690-bb3b-42991c8e88b1 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:13.145976 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc530abd-cb2f-4cbe-96b7-e0c7bbdb5b03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:13.145976 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc530abd-cb2f-4cbe-96b7-e0c7bbdb5b03 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:13.146130 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1261f4e-e14d-4f26-8d1f-0bb2c909e723 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:13.146130 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1261f4e-e14d-4f26-8d1f-0bb2c909e723 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:13.146130 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1261f4e-e14d-4f26-8d1f-0bb2c909e723 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:13.152372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1261f4e-e14d-4f26-8d1f-0bb2c909e723 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:13.167054 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1067/2154] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:12:13.173815 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1261f4e-e14d-4f26-8d1f-0bb2c909e723 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:13.175766 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1261f4e-e14d-4f26-8d1f-0bb2c909e723 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:13.189332 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1088/2155] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:12:13.667080 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc530abd-cb2f-4cbe-96b7-e0c7bbdb5b03 service neutron] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:13.667080 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-cc530abd-cb2f-4cbe-96b7-e0c7bbdb5b03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:13.678402 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc530abd-cb2f-4cbe-96b7-e0c7bbdb5b03 service neutron] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:13.684623 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850deee-2bdd-42a9-b002-5f7517e3c352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:13.686081 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850deee-2bdd-42a9-b002-5f7517e3c352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:13.686081 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850deee-2bdd-42a9-b002-5f7517e3c352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:13.686651 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2850deee-2bdd-42a9-b002-5f7517e3c352 admin admin] PATH_INFO: `/v3/projects/dfc89b06a3954d7d93c7b22116485768` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:13.688135 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850deee-2bdd-42a9-b002-5f7517e3c352 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfc89b06a3954d7d93c7b22116485768)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:13.690348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2850deee-2bdd-42a9-b002-5f7517e3c352 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:13.724097 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1261f4e-e14d-4f26-8d1f-0bb2c909e723 service neutron] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:13.728143 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-c1261f4e-e14d-4f26-8d1f-0bb2c909e723 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:13.749737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1261f4e-e14d-4f26-8d1f-0bb2c909e723 service neutron] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:13.759394 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22023a-0858-4371-8583-f3428d356f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:13.760690 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22023a-0858-4371-8583-f3428d356f44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:13.761289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22023a-0858-4371-8583-f3428d356f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:13.761874 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22023a-0858-4371-8583-f3428d356f44 admin admin] PATH_INFO: `/v3/projects/01f3a282022e4337afecabb3febad743` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:13.764139 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22023a-0858-4371-8583-f3428d356f44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01f3a282022e4337afecabb3febad743)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:13.766237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22023a-0858-4371-8583-f3428d356f44 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:13.820347 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-2850deee-2bdd-42a9-b002-5f7517e3c352 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfc89b06a3954d7d93c7b22116485768', 'request_id': 'req-2850deee-2bdd-42a9-b002-5f7517e3c352'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:13.826996 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-2850deee-2bdd-42a9-b002-5f7517e3c352 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfc89b06a3954d7d93c7b22116485768', 'request_id': 'req-2850deee-2bdd-42a9-b002-5f7517e3c352'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:13.834448 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-2850deee-2bdd-42a9-b002-5f7517e3c352 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfc89b06a3954d7d93c7b22116485768', 'request_id': 'req-2850deee-2bdd-42a9-b002-5f7517e3c352'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:13.914399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-5e22023a-0858-4371-8583-f3428d356f44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01f3a282022e4337afecabb3febad743', 'request_id': 'req-5e22023a-0858-4371-8583-f3428d356f44'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:13.923140 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-5e22023a-0858-4371-8583-f3428d356f44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01f3a282022e4337afecabb3febad743', 'request_id': 'req-5e22023a-0858-4371-8583-f3428d356f44'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:13.961825 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-2850deee-2bdd-42a9-b002-5f7517e3c352 admin admin] The token cache is being invalidate because project dfc89b06a3954d7d93c7b22116485768 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:12:13.962186 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-2850deee-2bdd-42a9-b002-5f7517e3c352 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:13.968052 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-2850deee-2bdd-42a9-b002-5f7517e3c352 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:13.968052 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1068/2156] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:12:13 2022] DELETE /identity/v3/projects/dfc89b06a3954d7d93c7b22116485768 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:13.969095 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850deee-2bdd-42a9-b002-5f7517e3c352 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:13.970750 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-2850deee-2bdd-42a9-b002-5f7517e3c352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:14.040401 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-5e22023a-0858-4371-8583-f3428d356f44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01f3a282022e4337afecabb3febad743', 'request_id': 'req-5e22023a-0858-4371-8583-f3428d356f44'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:14.055801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-5e22023a-0858-4371-8583-f3428d356f44 admin admin] The token cache is being invalidate because project 01f3a282022e4337afecabb3febad743 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:12:14.056183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2850deee-2bdd-42a9-b002-5f7517e3c352 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:14.056675 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-5e22023a-0858-4371-8583-f3428d356f44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:14.057616 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-5e22023a-0858-4371-8583-f3428d356f44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:14.059569 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1089/2157] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:12:13 2022] DELETE /identity/v3/projects/01f3a282022e4337afecabb3febad743 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:12:14.063824 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22023a-0858-4371-8583-f3428d356f44 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:14.066751 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-5e22023a-0858-4371-8583-f3428d356f44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:14.127312 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f07c88-91ec-4230-ab7e-baa74b886a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:14.128089 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f07c88-91ec-4230-ab7e-baa74b886a75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:14.128408 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f07c88-91ec-4230-ab7e-baa74b886a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:14.128752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f07c88-91ec-4230-ab7e-baa74b886a75 admin admin] PATH_INFO: `/v3/users/3667a6d95b2646e1bb72892f58fbe159` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:14.130166 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f07c88-91ec-4230-ab7e-baa74b886a75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3667a6d95b2646e1bb72892f58fbe159)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:14.132429 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f07c88-91ec-4230-ab7e-baa74b886a75 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:14.144349 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22023a-0858-4371-8583-f3428d356f44 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:14.150535 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d9589-86c7-4552-9efa-2e971a91ea8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:14.151664 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d9589-86c7-4552-9efa-2e971a91ea8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:14.152014 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d9589-86c7-4552-9efa-2e971a91ea8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:14.152358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d9589-86c7-4552-9efa-2e971a91ea8a admin admin] PATH_INFO: `/v3/users/45727927f6084bbda82f45c34847e67b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:14.154476 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d9589-86c7-4552-9efa-2e971a91ea8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=45727927f6084bbda82f45c34847e67b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:14.156749 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d9589-86c7-4552-9efa-2e971a91ea8a admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:14.315281 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:14.407695 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:14.424737 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-72f07c88-91ec-4230-ab7e-baa74b886a75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3667a6d95b2646e1bb72892f58fbe159'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:14.425595 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-72f07c88-91ec-4230-ab7e-baa74b886a75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3667a6d95b2646e1bb72892f58fbe159'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:14.434624 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-72f07c88-91ec-4230-ab7e-baa74b886a75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3667a6d95b2646e1bb72892f58fbe159'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:14.435639 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-72f07c88-91ec-4230-ab7e-baa74b886a75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3667a6d95b2646e1bb72892f58fbe159'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:14.441383 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-ce4d9589-86c7-4552-9efa-2e971a91ea8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45727927f6084bbda82f45c34847e67b'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:14.453048 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-ce4d9589-86c7-4552-9efa-2e971a91ea8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45727927f6084bbda82f45c34847e67b'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:14.554466 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-72f07c88-91ec-4230-ab7e-baa74b886a75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3667a6d95b2646e1bb72892f58fbe159'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:14.575787 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1069/2158] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:12:13 2022] DELETE /identity/v3/users/3667a6d95b2646e1bb72892f58fbe159 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:12:14.611483 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-ce4d9589-86c7-4552-9efa-2e971a91ea8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45727927f6084bbda82f45c34847e67b'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:14.612190 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-ce4d9589-86c7-4552-9efa-2e971a91ea8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45727927f6084bbda82f45c34847e67b'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:14.614166 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-ce4d9589-86c7-4552-9efa-2e971a91ea8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45727927f6084bbda82f45c34847e67b'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:14.641223 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1090/2159] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:12:14 2022] DELETE /identity/v3/users/45727927f6084bbda82f45c34847e67b => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:15.205005 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f07c88-91ec-4230-ab7e-baa74b886a75 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:15.208034 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-72f07c88-91ec-4230-ab7e-baa74b886a75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:15.229908 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d9589-86c7-4552-9efa-2e971a91ea8a admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:15.232668 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-ce4d9589-86c7-4552-9efa-2e971a91ea8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:15.368614 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d9589-86c7-4552-9efa-2e971a91ea8a admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:15.375720 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb96c3-c0fe-4269-ab5d-b47a70c49d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:15.376561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb96c3-c0fe-4269-ab5d-b47a70c49d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:15.376843 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb96c3-c0fe-4269-ab5d-b47a70c49d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:15.377312 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb96c3-c0fe-4269-ab5d-b47a70c49d1c admin admin] PATH_INFO: `/v3/projects/2f7a4f10f76647799821b9331096defa` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:15.378691 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb96c3-c0fe-4269-ab5d-b47a70c49d1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f7a4f10f76647799821b9331096defa)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:15.381479 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb96c3-c0fe-4269-ab5d-b47a70c49d1c admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:15.495997 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f07c88-91ec-4230-ab7e-baa74b886a75 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:15.513374 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e409eee1-e9c2-4b74-92f8-bfb4d5b846a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:15.513374 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409eee1-e9c2-4b74-92f8-bfb4d5b846a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:15.513374 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409eee1-e9c2-4b74-92f8-bfb4d5b846a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:15.513374 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e409eee1-e9c2-4b74-92f8-bfb4d5b846a0 admin admin] PATH_INFO: `/v3/projects/35643beb05e441f2b1c1306310ad5c4c` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:15.514352 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409eee1-e9c2-4b74-92f8-bfb4d5b846a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35643beb05e441f2b1c1306310ad5c4c)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:15.515352 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e409eee1-e9c2-4b74-92f8-bfb4d5b846a0 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:15.571379 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-16eb96c3-c0fe-4269-ab5d-b47a70c49d1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f7a4f10f76647799821b9331096defa', 'request_id': 'req-16eb96c3-c0fe-4269-ab5d-b47a70c49d1c'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:15.580816 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-16eb96c3-c0fe-4269-ab5d-b47a70c49d1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f7a4f10f76647799821b9331096defa', 'request_id': 'req-16eb96c3-c0fe-4269-ab5d-b47a70c49d1c'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:15.716982 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-16eb96c3-c0fe-4269-ab5d-b47a70c49d1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f7a4f10f76647799821b9331096defa', 'request_id': 'req-16eb96c3-c0fe-4269-ab5d-b47a70c49d1c'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:15.737870 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-e409eee1-e9c2-4b74-92f8-bfb4d5b846a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35643beb05e441f2b1c1306310ad5c4c', 'request_id': 'req-e409eee1-e9c2-4b74-92f8-bfb4d5b846a0'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:15.744797 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-16eb96c3-c0fe-4269-ab5d-b47a70c49d1c admin admin] The token cache is being invalidate because project 2f7a4f10f76647799821b9331096defa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:12:15.745174 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-16eb96c3-c0fe-4269-ab5d-b47a70c49d1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:15.747941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-16eb96c3-c0fe-4269-ab5d-b47a70c49d1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:15.751554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1091/2160] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:12:15 2022] DELETE /identity/v3/projects/2f7a4f10f76647799821b9331096defa => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:15.754730 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-e409eee1-e9c2-4b74-92f8-bfb4d5b846a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35643beb05e441f2b1c1306310ad5c4c', 'request_id': 'req-e409eee1-e9c2-4b74-92f8-bfb4d5b846a0'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:15.760577 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb96c3-c0fe-4269-ab5d-b47a70c49d1c admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:15.761736 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-e409eee1-e9c2-4b74-92f8-bfb4d5b846a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35643beb05e441f2b1c1306310ad5c4c', 'request_id': 'req-e409eee1-e9c2-4b74-92f8-bfb4d5b846a0'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:15.766909 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-16eb96c3-c0fe-4269-ab5d-b47a70c49d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:15.851710 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-e409eee1-e9c2-4b74-92f8-bfb4d5b846a0 admin admin] The token cache is being invalidate because project 35643beb05e441f2b1c1306310ad5c4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:12:15.852328 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-e409eee1-e9c2-4b74-92f8-bfb4d5b846a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:15.853150 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-e409eee1-e9c2-4b74-92f8-bfb4d5b846a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:15.855557 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1070/2161] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:12:15 2022] DELETE /identity/v3/projects/35643beb05e441f2b1c1306310ad5c4c => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:15.861269 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afc785-f253-476c-ad73-779682007c89 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:15.861822 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afc785-f253-476c-ad73-779682007c89 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:15.862366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afc785-f253-476c-ad73-779682007c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:15.880435 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb96c3-c0fe-4269-ab5d-b47a70c49d1c admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:15.896413 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-86afc785-f253-476c-ad73-779682007c89 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:15.898107 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-86afc785-f253-476c-ad73-779682007c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:15.965329 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745d280-02a6-4f76-98fb-93d59539adb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:15.966950 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745d280-02a6-4f76-98fb-93d59539adb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:15.967428 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745d280-02a6-4f76-98fb-93d59539adb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:15.967893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2745d280-02a6-4f76-98fb-93d59539adb8 admin admin] PATH_INFO: `/v3/users/46aba327c0e6412a97b0e9ad1b6d6db0` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:15.969763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745d280-02a6-4f76-98fb-93d59539adb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46aba327c0e6412a97b0e9ad1b6d6db0)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:15.972209 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2745d280-02a6-4f76-98fb-93d59539adb8 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:16.019585 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1071/2162] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:16.022980 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f51a4-9459-434b-8337-bc5f6236f19b None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:16.023321 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f51a4-9459-434b-8337-bc5f6236f19b None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:16.023665 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f51a4-9459-434b-8337-bc5f6236f19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:16.051063 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-8a2f51a4-9459-434b-8337-bc5f6236f19b None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:16.053091 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-8a2f51a4-9459-434b-8337-bc5f6236f19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:16.066775 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1072/2163] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:12:16.067836 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f51a4-9459-434b-8337-bc5f6236f19b None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:16.078349 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f51a4-9459-434b-8337-bc5f6236f19b None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:16.083653 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc731b-b791-4d5a-9156-4b060920c96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:16.084604 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc731b-b791-4d5a-9156-4b060920c96b admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:16.085037 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc731b-b791-4d5a-9156-4b060920c96b admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:16.085544 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cc731b-b791-4d5a-9156-4b060920c96b admin admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:16.086349 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc731b-b791-4d5a-9156-4b060920c96b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:12:16.086813 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc731b-b791-4d5a-9156-4b060920c96b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:16.088624 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cc731b-b791-4d5a-9156-4b060920c96b admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:16.107865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1073/2164] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:12:16.109054 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc731b-b791-4d5a-9156-4b060920c96b admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:16.119611 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cc731b-b791-4d5a-9156-4b060920c96b admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:16.125625 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426ebd2-5784-4756-8c59-12e873eda799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:16.126256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426ebd2-5784-4756-8c59-12e873eda799 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:16.126523 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426ebd2-5784-4756-8c59-12e873eda799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:16.126956 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426ebd2-5784-4756-8c59-12e873eda799 admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:16.127760 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426ebd2-5784-4756-8c59-12e873eda799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:16.129996 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426ebd2-5784-4756-8c59-12e873eda799 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:16.266054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-2745d280-02a6-4f76-98fb-93d59539adb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46aba327c0e6412a97b0e9ad1b6d6db0'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:16.267413 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1074/2165] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:12:16 2022] POST /identity/v3/projects => generated 409 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:12:16.270224 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9c40a-6969-48b7-ac19-14ad9166de15 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:16.270720 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9c40a-6969-48b7-ac19-14ad9166de15 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:16.271240 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9c40a-6969-48b7-ac19-14ad9166de15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:16.281292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-2745d280-02a6-4f76-98fb-93d59539adb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46aba327c0e6412a97b0e9ad1b6d6db0'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:16.297543 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-e3d9c40a-6969-48b7-ac19-14ad9166de15 None None] MFA Rules not processed for user `190cccbe419249338c60fdec264f2bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:16.298857 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-e3d9c40a-6969-48b7-ac19-14ad9166de15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:16.349082 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-2745d280-02a6-4f76-98fb-93d59539adb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46aba327c0e6412a97b0e9ad1b6d6db0'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:16.349724 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-2745d280-02a6-4f76-98fb-93d59539adb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46aba327c0e6412a97b0e9ad1b6d6db0'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:16.350378 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-2745d280-02a6-4f76-98fb-93d59539adb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46aba327c0e6412a97b0e9ad1b6d6db0'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:16.377255 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1092/2166] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:12:15 2022] DELETE /identity/v3/users/46aba327c0e6412a97b0e9ad1b6d6db0 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:16.377255 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745d280-02a6-4f76-98fb-93d59539adb8 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:16.379510 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-2745d280-02a6-4f76-98fb-93d59539adb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:16.387254 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1075/2167] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:16.496664 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2745d280-02a6-4f76-98fb-93d59539adb8 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:16.503086 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:16.518933 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a85d2-cb5d-4cce-bf96-ff0e8c4a0d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:16.518933 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a85d2-cb5d-4cce-bf96-ff0e8c4a0d89 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:16.518933 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a85d2-cb5d-4cce-bf96-ff0e8c4a0d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:16.518933 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a85d2-cb5d-4cce-bf96-ff0e8c4a0d89 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:16.519408 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a85d2-cb5d-4cce-bf96-ff0e8c4a0d89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:16.521919 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a85d2-cb5d-4cce-bf96-ff0e8c4a0d89 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:16.660437 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1093/2168] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:12:16 2022] POST /identity/v3/users => generated 305 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:12:16.664886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9c40a-6969-48b7-ac19-14ad9166de15 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:16.843886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9c40a-6969-48b7-ac19-14ad9166de15 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:16.858434 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241883b-e9af-4dd0-a3d1-30639d98259f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:16.859086 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241883b-e9af-4dd0-a3d1-30639d98259f admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:16.859533 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241883b-e9af-4dd0-a3d1-30639d98259f admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:16.859699 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241883b-e9af-4dd0-a3d1-30639d98259f admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:16.863365 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241883b-e9af-4dd0-a3d1-30639d98259f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:16.866830 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b241883b-e9af-4dd0-a3d1-30639d98259f admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:16.903511 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1076/2169] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:16.905478 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:16.908605 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a85d2-cb5d-4cce-bf96-ff0e8c4a0d89 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:16.925811 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a85d2-cb5d-4cce-bf96-ff0e8c4a0d89 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:16.932969 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5fb0e-ecbd-4bed-a088-cceaa2c2ee72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:16.934164 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5fb0e-ecbd-4bed-a088-cceaa2c2ee72 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:16.936314 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5fb0e-ecbd-4bed-a088-cceaa2c2ee72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:16.936922 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5fb0e-ecbd-4bed-a088-cceaa2c2ee72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:16.938853 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5fb0e-ecbd-4bed-a088-cceaa2c2ee72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:16.940874 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5fb0e-ecbd-4bed-a088-cceaa2c2ee72 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:16.956001 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1094/2170] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:16.960409 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241883b-e9af-4dd0-a3d1-30639d98259f admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:16.972258 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241883b-e9af-4dd0-a3d1-30639d98259f admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:16.977601 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d86a387-d57f-4da0-a103-0b38e53e0a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:16.978272 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86a387-d57f-4da0-a103-0b38e53e0a31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:16.978556 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86a387-d57f-4da0-a103-0b38e53e0a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:16.978971 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d86a387-d57f-4da0-a103-0b38e53e0a31 admin admin] PATH_INFO: `/v3/projects/5d86e85269514d2aa2989a89ec12fff4/users/74e7203d5da8460dbf37448d09ad5a7d/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:16.995734 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86a387-d57f-4da0-a103-0b38e53e0a31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d86e85269514d2aa2989a89ec12fff4, user_id=74e7203d5da8460dbf37448d09ad5a7d, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:16.998747 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d86a387-d57f-4da0-a103-0b38e53e0a31 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:17.100988 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5fb0e-ecbd-4bed-a088-cceaa2c2ee72 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:17.103902 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-22a5fb0e-ecbd-4bed-a088-cceaa2c2ee72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:17.127319 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5fb0e-ecbd-4bed-a088-cceaa2c2ee72 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:17.133828 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1506f33-976d-4185-b333-3a8d53f075e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:17.134776 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1506f33-976d-4185-b333-3a8d53f075e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:17.135059 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1506f33-976d-4185-b333-3a8d53f075e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:17.135370 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1506f33-976d-4185-b333-3a8d53f075e3 admin admin] PATH_INFO: `/v3/projects/04635ea0fba34beeaa77741c47879649` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:17.136571 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1506f33-976d-4185-b333-3a8d53f075e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04635ea0fba34beeaa77741c47879649)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:17.139256 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1506f33-976d-4185-b333-3a8d53f075e3 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:17.153946 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1077/2171] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:12:16 2022] PUT /identity/v3/projects/5d86e85269514d2aa2989a89ec12fff4/users/74e7203d5da8460dbf37448d09ad5a7d/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:17.164346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8b1e2-d9dc-40ae-98a0-abafe6e2cfc9 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:17.164840 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8b1e2-d9dc-40ae-98a0-abafe6e2cfc9 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:17.165112 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8b1e2-d9dc-40ae-98a0-abafe6e2cfc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:17.206195 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-3bf8b1e2-d9dc-40ae-98a0-abafe6e2cfc9 None None] MFA Rules not processed for user `74e7203d5da8460dbf37448d09ad5a7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:17.207700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-3bf8b1e2-d9dc-40ae-98a0-abafe6e2cfc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:17.312918 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1078/2172] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:17 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:12:17.317461 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8b1e2-d9dc-40ae-98a0-abafe6e2cfc9 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:17.353545 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-d1506f33-976d-4185-b333-3a8d53f075e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04635ea0fba34beeaa77741c47879649', 'request_id': 'req-d1506f33-976d-4185-b333-3a8d53f075e3'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:17.363919 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-d1506f33-976d-4185-b333-3a8d53f075e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04635ea0fba34beeaa77741c47879649', 'request_id': 'req-d1506f33-976d-4185-b333-3a8d53f075e3'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:17.424725 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8b1e2-d9dc-40ae-98a0-abafe6e2cfc9 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:17.442271 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-d1506f33-976d-4185-b333-3a8d53f075e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04635ea0fba34beeaa77741c47879649', 'request_id': 'req-d1506f33-976d-4185-b333-3a8d53f075e3'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:17.463410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-d1506f33-976d-4185-b333-3a8d53f075e3 admin admin] The token cache is being invalidate because project 04635ea0fba34beeaa77741c47879649 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:12:17.464126 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-d1506f33-976d-4185-b333-3a8d53f075e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:17.465041 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-d1506f33-976d-4185-b333-3a8d53f075e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:17.472723 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1095/2173] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:12:17 2022] DELETE /identity/v3/projects/04635ea0fba34beeaa77741c47879649 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:12:17.474550 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a6a1b-5552-4c99-9991-98fe20929602 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:17.474993 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a6a1b-5552-4c99-9991-98fe20929602 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:17.475449 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a6a1b-5552-4c99-9991-98fe20929602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:17.501306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-c95a6a1b-5552-4c99-9991-98fe20929602 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:17.503849 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-c95a6a1b-5552-4c99-9991-98fe20929602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:17.527538 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12537296-7eec-47e0-8a28-9a4857ae40f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:17.529193 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12537296-7eec-47e0-8a28-9a4857ae40f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:17.529864 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12537296-7eec-47e0-8a28-9a4857ae40f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:17.530268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12537296-7eec-47e0-8a28-9a4857ae40f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:17.531015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12537296-7eec-47e0-8a28-9a4857ae40f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:17.533383 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12537296-7eec-47e0-8a28-9a4857ae40f9 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:17.544888 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1096/2174] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:17.551682 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43978247-e7ec-4fbf-8ed6-7901c4e8196b None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:17.552164 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43978247-e7ec-4fbf-8ed6-7901c4e8196b None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:17.552633 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43978247-e7ec-4fbf-8ed6-7901c4e8196b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:17.632068 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-43978247-e7ec-4fbf-8ed6-7901c4e8196b None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:17.640152 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-43978247-e7ec-4fbf-8ed6-7901c4e8196b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:17.646962 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1079/2175] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:12:17 2022] POST /identity/v3/projects => generated 409 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:12:17.648365 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12537296-7eec-47e0-8a28-9a4857ae40f9 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:17.668265 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-12537296-7eec-47e0-8a28-9a4857ae40f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:17.782056 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12537296-7eec-47e0-8a28-9a4857ae40f9 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:17.787774 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d85d51-b621-46d5-b71b-1c3203222773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:17.788589 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d85d51-b621-46d5-b71b-1c3203222773 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:17.788922 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d85d51-b621-46d5-b71b-1c3203222773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:17.789196 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d85d51-b621-46d5-b71b-1c3203222773 admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:17.790014 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d85d51-b621-46d5-b71b-1c3203222773 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:17.792132 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d85d51-b621-46d5-b71b-1c3203222773 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:17.904567 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1097/2176] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:17.921845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43978247-e7ec-4fbf-8ed6-7901c4e8196b None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:17.922014 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1080/2177] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:12:17 2022] POST /identity/v3/users => generated 311 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:12:17.922787 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d85d51-b621-46d5-b71b-1c3203222773 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:17.941421 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d85d51-b621-46d5-b71b-1c3203222773 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:17.942433 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43978247-e7ec-4fbf-8ed6-7901c4e8196b None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:17.948934 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db28a10-4af6-43cd-81d7-2139b44a311d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:17.949877 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db28a10-4af6-43cd-81d7-2139b44a311d admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:17.950218 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db28a10-4af6-43cd-81d7-2139b44a311d admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:17.950628 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db28a10-4af6-43cd-81d7-2139b44a311d admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:17.951604 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db28a10-4af6-43cd-81d7-2139b44a311d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:17.953608 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db28a10-4af6-43cd-81d7-2139b44a311d admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:17.959554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91408c24-6ab7-4daa-af81-e73d5933b3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:17.960537 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91408c24-6ab7-4daa-af81-e73d5933b3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:17.961197 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91408c24-6ab7-4daa-af81-e73d5933b3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:17.961844 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91408c24-6ab7-4daa-af81-e73d5933b3d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:17.965034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91408c24-6ab7-4daa-af81-e73d5933b3d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:12:17.970325 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91408c24-6ab7-4daa-af81-e73d5933b3d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:17.972548 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91408c24-6ab7-4daa-af81-e73d5933b3d7 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:17.972715 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1081/2178] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:17 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:17.979884 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db28a10-4af6-43cd-81d7-2139b44a311d admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:18.005992 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db28a10-4af6-43cd-81d7-2139b44a311d admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:18.006301 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1098/2179] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:12:18.011063 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91408c24-6ab7-4daa-af81-e73d5933b3d7 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:18.035968 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08465f1-b288-4646-b716-cac60b232297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:18.036928 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08465f1-b288-4646-b716-cac60b232297 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:18.037299 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08465f1-b288-4646-b716-cac60b232297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:18.037792 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08465f1-b288-4646-b716-cac60b232297 admin admin] PATH_INFO: `/v3/projects/37342270e0ca404a9d36b9667e5ccd2a/users/9f4707e3f8944bcd86fc2e3ec7a68350/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:18.055685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91408c24-6ab7-4daa-af81-e73d5933b3d7 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:18.072165 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da8995-fbe2-49b8-a8f4-25cf50ac0d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:18.072984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da8995-fbe2-49b8-a8f4-25cf50ac0d83 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:18.073406 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da8995-fbe2-49b8-a8f4-25cf50ac0d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:18.073839 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da8995-fbe2-49b8-a8f4-25cf50ac0d83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:18.074485 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08465f1-b288-4646-b716-cac60b232297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37342270e0ca404a9d36b9667e5ccd2a, user_id=9f4707e3f8944bcd86fc2e3ec7a68350, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:18.074875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da8995-fbe2-49b8-a8f4-25cf50ac0d83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:18.091167 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08465f1-b288-4646-b716-cac60b232297 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:18.091679 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da8995-fbe2-49b8-a8f4-25cf50ac0d83 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:18.172386 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1082/2180] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:12:17 2022] PUT /identity/v3/projects/37342270e0ca404a9d36b9667e5ccd2a/users/9f4707e3f8944bcd86fc2e3ec7a68350/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:18.176748 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08465f1-b288-4646-b716-cac60b232297 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:18.238470 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1099/2181] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:12:18 2022] POST /identity/v3/projects => generated 393 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:12:18.239889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da8995-fbe2-49b8-a8f4-25cf50ac0d83 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:18.257524 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08465f1-b288-4646-b716-cac60b232297 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:18.341335 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28e13d-8649-48e1-9b7b-fd71ed11883a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:18.342287 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28e13d-8649-48e1-9b7b-fd71ed11883a admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:18.342589 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28e13d-8649-48e1-9b7b-fd71ed11883a admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:18.342669 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28e13d-8649-48e1-9b7b-fd71ed11883a admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:18.343548 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28e13d-8649-48e1-9b7b-fd71ed11883a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:18.345165 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28e13d-8649-48e1-9b7b-fd71ed11883a admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:18.355775 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da8995-fbe2-49b8-a8f4-25cf50ac0d83 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:18.364366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1083/2182] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:12:18.367919 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e70165-b7d6-47b3-a2a7-a39fd4d25a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:18.368769 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e70165-b7d6-47b3-a2a7-a39fd4d25a1a admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:18.369365 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e70165-b7d6-47b3-a2a7-a39fd4d25a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:18.369819 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e70165-b7d6-47b3-a2a7-a39fd4d25a1a admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:18.370602 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e70165-b7d6-47b3-a2a7-a39fd4d25a1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:18.373941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e70165-b7d6-47b3-a2a7-a39fd4d25a1a admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:18.379921 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28e13d-8649-48e1-9b7b-fd71ed11883a admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:18.407693 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28e13d-8649-48e1-9b7b-fd71ed11883a admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:18.410705 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8530e-cf93-4175-a8e0-b5a49b5a17b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:18.411427 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8530e-cf93-4175-a8e0-b5a49b5a17b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:18.411772 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8530e-cf93-4175-a8e0-b5a49b5a17b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:18.412008 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8530e-cf93-4175-a8e0-b5a49b5a17b6 admin admin] PATH_INFO: `/v3/projects/37342270e0ca404a9d36b9667e5ccd2a/users/9f4707e3f8944bcd86fc2e3ec7a68350/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:18.416882 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8530e-cf93-4175-a8e0-b5a49b5a17b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37342270e0ca404a9d36b9667e5ccd2a, user_id=9f4707e3f8944bcd86fc2e3ec7a68350, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:18.420929 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8530e-cf93-4175-a8e0-b5a49b5a17b6 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:18.435442 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1084/2183] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:12:18 2022] PUT /identity/v3/projects/37342270e0ca404a9d36b9667e5ccd2a/users/9f4707e3f8944bcd86fc2e3ec7a68350/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:18.447570 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bb3c1-c8bc-4d57-866b-1543a5601f53 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:18.448017 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bb3c1-c8bc-4d57-866b-1543a5601f53 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:18.448748 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7bb3c1-c8bc-4d57-866b-1543a5601f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:18.489968 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-9a7bb3c1-c8bc-4d57-866b-1543a5601f53 None None] MFA Rules not processed for user `9f4707e3f8944bcd86fc2e3ec7a68350`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:18.491575 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-9a7bb3c1-c8bc-4d57-866b-1543a5601f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:18.584786 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1100/2184] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:12:18 2022] POST /identity/v3/users => generated 297 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:12:18.586215 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1085/2185] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:18 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:18.590522 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bb3c1-c8bc-4d57-866b-1543a5601f53 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:18.599640 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e70165-b7d6-47b3-a2a7-a39fd4d25a1a admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:18.601832 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-88e70165-b7d6-47b3-a2a7-a39fd4d25a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:18.677292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e70165-b7d6-47b3-a2a7-a39fd4d25a1a admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:18.681866 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7bb3c1-c8bc-4d57-866b-1543a5601f53 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:18.687547 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5637692-ea6d-4780-8922-f2005e22763e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:18.688282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5637692-ea6d-4780-8922-f2005e22763e admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:18.688736 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5637692-ea6d-4780-8922-f2005e22763e admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:18.689176 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5637692-ea6d-4780-8922-f2005e22763e admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:18.690209 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5637692-ea6d-4780-8922-f2005e22763e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:18.692468 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5637692-ea6d-4780-8922-f2005e22763e admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:18.710967 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1086/2186] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:12:18.711909 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5637692-ea6d-4780-8922-f2005e22763e admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:18.724763 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5637692-ea6d-4780-8922-f2005e22763e admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:18.729625 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215feff-acad-4bb4-8658-bfe8775e9866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:18.730239 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215feff-acad-4bb4-8658-bfe8775e9866 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:18.730514 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215feff-acad-4bb4-8658-bfe8775e9866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:18.730792 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3215feff-acad-4bb4-8658-bfe8775e9866 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:18.732300 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215feff-acad-4bb4-8658-bfe8775e9866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:18.733990 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3215feff-acad-4bb4-8658-bfe8775e9866 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:18.738875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465edc4-a221-4d63-9256-d6f734bd867e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:18.739704 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465edc4-a221-4d63-9256-d6f734bd867e service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:18.739980 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465edc4-a221-4d63-9256-d6f734bd867e service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:18.740291 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465edc4-a221-4d63-9256-d6f734bd867e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:18.756665 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1087/2187] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:18.758390 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215feff-acad-4bb4-8658-bfe8775e9866 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:18.762357 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465edc4-a221-4d63-9256-d6f734bd867e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:18.764777 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465edc4-a221-4d63-9256-d6f734bd867e service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:18.770974 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3215feff-acad-4bb4-8658-bfe8775e9866 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:18.781202 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1101/2188] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:18 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:12:18.783625 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbea36a-ed04-4447-9047-31f2062d7b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:18.783996 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:18.784133 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbea36a-ed04-4447-9047-31f2062d7b30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:18.784297 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbea36a-ed04-4447-9047-31f2062d7b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:18.784620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbea36a-ed04-4447-9047-31f2062d7b30 admin admin] PATH_INFO: `/v3/projects/c2f3415974d14b9e99cdc9903e5277b8/users/d40e92ce7c0e4b6d9a126a8dce2ee73e/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:18.802175 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbea36a-ed04-4447-9047-31f2062d7b30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2f3415974d14b9e99cdc9903e5277b8, user_id=d40e92ce7c0e4b6d9a126a8dce2ee73e, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:18.805167 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbea36a-ed04-4447-9047-31f2062d7b30 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:18.889376 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1088/2189] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:12:18 2022] PUT /identity/v3/projects/c2f3415974d14b9e99cdc9903e5277b8/users/d40e92ce7c0e4b6d9a126a8dce2ee73e/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:12:18.901271 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54bec8-12f0-4b7e-9d29-870060c3c0a2 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:18.901676 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54bec8-12f0-4b7e-9d29-870060c3c0a2 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:18.901860 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba54bec8-12f0-4b7e-9d29-870060c3c0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:18.938317 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-ba54bec8-12f0-4b7e-9d29-870060c3c0a2 None None] MFA Rules not processed for user `d40e92ce7c0e4b6d9a126a8dce2ee73e`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:18.940031 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-ba54bec8-12f0-4b7e-9d29-870060c3c0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:19.025149 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1102/2190] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:19.030279 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbea36a-ed04-4447-9047-31f2062d7b30 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:19.119916 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbea36a-ed04-4447-9047-31f2062d7b30 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:19.126059 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20177145-b11a-4ba6-8669-5cf26629fe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:19.126818 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20177145-b11a-4ba6-8669-5cf26629fe2a admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:19.127104 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20177145-b11a-4ba6-8669-5cf26629fe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:19.127407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20177145-b11a-4ba6-8669-5cf26629fe2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:19.128050 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20177145-b11a-4ba6-8669-5cf26629fe2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:19.130066 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20177145-b11a-4ba6-8669-5cf26629fe2a admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:19.233082 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1089/2191] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:12:19 2022] POST /identity/v3/projects => generated 393 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:12:19.241818 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54bec8-12f0-4b7e-9d29-870060c3c0a2 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:19.277343 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba54bec8-12f0-4b7e-9d29-870060c3c0a2 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:19.327280 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20177145-b11a-4ba6-8669-5cf26629fe2a admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:19.329963 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-20177145-b11a-4ba6-8669-5cf26629fe2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:19.441729 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ae407-730a-43cf-8401-fcc613d9aef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:19.443659 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20177145-b11a-4ba6-8669-5cf26629fe2a admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:19.444389 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ae407-730a-43cf-8401-fcc613d9aef1 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:19.445049 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ae407-730a-43cf-8401-fcc613d9aef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:19.451865 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ae407-730a-43cf-8401-fcc613d9aef1 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:19.452334 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd591f-27fc-41c0-a29b-8aa82aeecc1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:19.452334 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd591f-27fc-41c0-a29b-8aa82aeecc1e service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:19.452334 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd591f-27fc-41c0-a29b-8aa82aeecc1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:19.452334 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd591f-27fc-41c0-a29b-8aa82aeecc1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:19.452644 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-46dd591f-27fc-41c0-a29b-8aa82aeecc1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:19.452724 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ae407-730a-43cf-8401-fcc613d9aef1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:19.455440 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736ae407-730a-43cf-8401-fcc613d9aef1 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:19.471981 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:19.531518 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd591f-27fc-41c0-a29b-8aa82aeecc1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:19.542707 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd591f-27fc-41c0-a29b-8aa82aeecc1e service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:19.555343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1090/2192] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:19 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:12:19.579457 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1103/2193] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:12:19 2022] POST /identity/v3/users => generated 303 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:12:19.584647 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd591f-27fc-41c0-a29b-8aa82aeecc1e service cinder] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:19.604804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd591f-27fc-41c0-a29b-8aa82aeecc1e service cinder] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:19.611710 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423eaa00-2a54-4aa6-adb7-4bbae49d079a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:19.612419 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423eaa00-2a54-4aa6-adb7-4bbae49d079a admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:19.613063 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423eaa00-2a54-4aa6-adb7-4bbae49d079a admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:19.613063 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423eaa00-2a54-4aa6-adb7-4bbae49d079a admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:19.613856 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423eaa00-2a54-4aa6-adb7-4bbae49d079a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:19.617565 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423eaa00-2a54-4aa6-adb7-4bbae49d079a admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:19.631174 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1091/2194] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:19.634981 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ae407-730a-43cf-8401-fcc613d9aef1 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:19.650406 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736ae407-730a-43cf-8401-fcc613d9aef1 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:19.657726 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501014f-07c2-42e4-9a87-f4a4d72efedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:19.658646 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501014f-07c2-42e4-9a87-f4a4d72efedd admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:19.659042 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501014f-07c2-42e4-9a87-f4a4d72efedd admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:19.659502 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501014f-07c2-42e4-9a87-f4a4d72efedd admin admin] PATH_INFO: `/v3/projects/c1243c901d52464788754fed978a8db0/users/ee8279e2fa0a416289729f994e1a882a/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:19.685418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501014f-07c2-42e4-9a87-f4a4d72efedd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1243c901d52464788754fed978a8db0, user_id=ee8279e2fa0a416289729f994e1a882a, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:19.692393 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501014f-07c2-42e4-9a87-f4a4d72efedd admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:19.767212 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1104/2195] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:12:19 2022] PUT /identity/v3/projects/c1243c901d52464788754fed978a8db0/users/ee8279e2fa0a416289729f994e1a882a/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:19.771644 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423eaa00-2a54-4aa6-adb7-4bbae49d079a admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:19.796848 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423eaa00-2a54-4aa6-adb7-4bbae49d079a admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:19.861928 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585b3ecd-9cc6-4ce4-928c-be04c13a863e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:19.862579 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b3ecd-9cc6-4ce4-928c-be04c13a863e admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:19.862856 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b3ecd-9cc6-4ce4-928c-be04c13a863e admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:19.863173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b3ecd-9cc6-4ce4-928c-be04c13a863e admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:19.864094 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585b3ecd-9cc6-4ce4-928c-be04c13a863e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:19.865775 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585b3ecd-9cc6-4ce4-928c-be04c13a863e admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:19.885428 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1092/2196] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:19 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:12:19.893256 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501014f-07c2-42e4-9a87-f4a4d72efedd admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:19.914644 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501014f-07c2-42e4-9a87-f4a4d72efedd admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:19.923790 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea416874-c0c4-479f-852a-677fc0daed98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:19.924970 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea416874-c0c4-479f-852a-677fc0daed98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:19.925494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea416874-c0c4-479f-852a-677fc0daed98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:19.929046 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea416874-c0c4-479f-852a-677fc0daed98 admin admin] PATH_INFO: `/v3/projects/c1243c901d52464788754fed978a8db0/users/ee8279e2fa0a416289729f994e1a882a/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:19.929046 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea416874-c0c4-479f-852a-677fc0daed98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1243c901d52464788754fed978a8db0, user_id=ee8279e2fa0a416289729f994e1a882a, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:19.931630 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea416874-c0c4-479f-852a-677fc0daed98 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:19.958737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1105/2197] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:12:19 2022] PUT /identity/v3/projects/c1243c901d52464788754fed978a8db0/users/ee8279e2fa0a416289729f994e1a882a/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:19.961208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9d6ef-3aff-48fe-9030-1c7dff2dff3c None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:19.961811 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9d6ef-3aff-48fe-9030-1c7dff2dff3c None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:19.962310 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9d6ef-3aff-48fe-9030-1c7dff2dff3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:19.998883 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-d3c9d6ef-3aff-48fe-9030-1c7dff2dff3c None None] MFA Rules not processed for user `ee8279e2fa0a416289729f994e1a882a`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:20.000388 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-d3c9d6ef-3aff-48fe-9030-1c7dff2dff3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:20.117742 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1093/2198] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:19 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:20.363149 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea416874-c0c4-479f-852a-677fc0daed98 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:20.453675 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea416874-c0c4-479f-852a-677fc0daed98 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:20.459801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9943d-a28b-443e-88d1-e5baee779320 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:20.460859 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9943d-a28b-443e-88d1-e5baee779320 service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:20.461331 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9943d-a28b-443e-88d1-e5baee779320 service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:20.461803 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e9943d-a28b-443e-88d1-e5baee779320 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:20.472854 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9943d-a28b-443e-88d1-e5baee779320 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:20.474453 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e9943d-a28b-443e-88d1-e5baee779320 service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:20.496068 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1106/2199] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:20 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:12:20.627681 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9d6ef-3aff-48fe-9030-1c7dff2dff3c None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:20.642294 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9d6ef-3aff-48fe-9030-1c7dff2dff3c None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:20.646842 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c5d166-3f72-4903-95cd-de564899d7de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:20.648754 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5d166-3f72-4903-95cd-de564899d7de service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:20.648754 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5d166-3f72-4903-95cd-de564899d7de service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:20.648754 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c5d166-3f72-4903-95cd-de564899d7de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:20.722772 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5d166-3f72-4903-95cd-de564899d7de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:20.724504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c5d166-3f72-4903-95cd-de564899d7de service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:20.734764 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1094/2200] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:20 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:12:20.811237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9943d-a28b-443e-88d1-e5baee779320 service cinder] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:20.812773 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-42e9943d-a28b-443e-88d1-e5baee779320 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:20.894980 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e9943d-a28b-443e-88d1-e5baee779320 service cinder] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:20.900368 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b7eff-858a-4f0f-ab72-05fb5d371f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:20.901500 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b7eff-858a-4f0f-ab72-05fb5d371f35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:20.901948 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b7eff-858a-4f0f-ab72-05fb5d371f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:20.902441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b7eff-858a-4f0f-ab72-05fb5d371f35 admin admin] PATH_INFO: `/v3/users/8260bc632db74635ac673e9314a772f3` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:20.904089 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b7eff-858a-4f0f-ab72-05fb5d371f35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8260bc632db74635ac673e9314a772f3)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:20.906085 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b7eff-858a-4f0f-ab72-05fb5d371f35 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:21.021198 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:21.109850 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:21.199186 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-bb6b7eff-858a-4f0f-ab72-05fb5d371f35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8260bc632db74635ac673e9314a772f3'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:21.208937 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-bb6b7eff-858a-4f0f-ab72-05fb5d371f35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8260bc632db74635ac673e9314a772f3'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:21.311045 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-bb6b7eff-858a-4f0f-ab72-05fb5d371f35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8260bc632db74635ac673e9314a772f3'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:21.311878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-bb6b7eff-858a-4f0f-ab72-05fb5d371f35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8260bc632db74635ac673e9314a772f3'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:21.312949 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-bb6b7eff-858a-4f0f-ab72-05fb5d371f35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8260bc632db74635ac673e9314a772f3'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:21.333921 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1107/2201] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:12:20 2022] DELETE /identity/v3/users/8260bc632db74635ac673e9314a772f3 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:21.338975 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe98d95-c2f7-44e6-ae3a-db0fc76f655a None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:21.339399 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe98d95-c2f7-44e6-ae3a-db0fc76f655a None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:21.339761 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe98d95-c2f7-44e6-ae3a-db0fc76f655a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:21.364764 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-ffe98d95-c2f7-44e6-ae3a-db0fc76f655a None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:21.365960 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-ffe98d95-c2f7-44e6-ae3a-db0fc76f655a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:21.439622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1095/2202] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:21.449254 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b7eff-858a-4f0f-ab72-05fb5d371f35 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:21.463717 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-bb6b7eff-858a-4f0f-ab72-05fb5d371f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:21.569877 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b7eff-858a-4f0f-ab72-05fb5d371f35 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:21.569877 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adecc4-2dfa-479c-aed0-99ba6c342c57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:21.569877 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adecc4-2dfa-479c-aed0-99ba6c342c57 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:21.569877 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adecc4-2dfa-479c-aed0-99ba6c342c57 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:21.570739 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39adecc4-2dfa-479c-aed0-99ba6c342c57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:21.581627 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39adecc4-2dfa-479c-aed0-99ba6c342c57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:21.583550 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39adecc4-2dfa-479c-aed0-99ba6c342c57 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:21.597195 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1108/2203] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:12:22.115749 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:22.333467 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe98d95-c2f7-44e6-ae3a-db0fc76f655a None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:22.335585 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-ffe98d95-c2f7-44e6-ae3a-db0fc76f655a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:22.358469 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe98d95-c2f7-44e6-ae3a-db0fc76f655a None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:22.364718 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa0c6e-9427-40df-97fa-8fe08d13029c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:22.365835 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa0c6e-9427-40df-97fa-8fe08d13029c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:22.366265 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa0c6e-9427-40df-97fa-8fe08d13029c admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:22.366754 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa0c6e-9427-40df-97fa-8fe08d13029c admin admin] PATH_INFO: `/v3/projects/0d32ba55a3134a41aaebfc4ca9c28770` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:22.368956 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa0c6e-9427-40df-97fa-8fe08d13029c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d32ba55a3134a41aaebfc4ca9c28770)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:22.373152 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa0c6e-9427-40df-97fa-8fe08d13029c admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:22.469741 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:22.507240 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-23fa0c6e-9427-40df-97fa-8fe08d13029c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d32ba55a3134a41aaebfc4ca9c28770', 'request_id': 'req-23fa0c6e-9427-40df-97fa-8fe08d13029c'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:22.517893 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-23fa0c6e-9427-40df-97fa-8fe08d13029c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d32ba55a3134a41aaebfc4ca9c28770', 'request_id': 'req-23fa0c6e-9427-40df-97fa-8fe08d13029c'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:22.531019 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-23fa0c6e-9427-40df-97fa-8fe08d13029c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d32ba55a3134a41aaebfc4ca9c28770', 'request_id': 'req-23fa0c6e-9427-40df-97fa-8fe08d13029c'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:22.605763 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-23fa0c6e-9427-40df-97fa-8fe08d13029c admin admin] The token cache is being invalidate because project 0d32ba55a3134a41aaebfc4ca9c28770 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:12:22.607280 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-23fa0c6e-9427-40df-97fa-8fe08d13029c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:22.610889 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-23fa0c6e-9427-40df-97fa-8fe08d13029c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:22.612462 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1096/2204] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:12:22 2022] DELETE /identity/v3/projects/0d32ba55a3134a41aaebfc4ca9c28770 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:12:22.618882 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adecc4-2dfa-479c-aed0-99ba6c342c57 service neutron] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:22.634042 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39adecc4-2dfa-479c-aed0-99ba6c342c57 service neutron] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:22.764664 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aff595-7a77-409a-a9af-b4df5cd98bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:22.765319 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aff595-7a77-409a-a9af-b4df5cd98bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:22.765804 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aff595-7a77-409a-a9af-b4df5cd98bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:22.766081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aff595-7a77-409a-a9af-b4df5cd98bcb admin admin] PATH_INFO: `/v3/users/736b00712abf4047b22beeab1b4d3cec` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:22.779753 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aff595-7a77-409a-a9af-b4df5cd98bcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=736b00712abf4047b22beeab1b4d3cec)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:22.779753 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aff595-7a77-409a-a9af-b4df5cd98bcb admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:23.289068 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-98aff595-7a77-409a-a9af-b4df5cd98bcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '736b00712abf4047b22beeab1b4d3cec'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:23.297214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-98aff595-7a77-409a-a9af-b4df5cd98bcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '736b00712abf4047b22beeab1b4d3cec'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:23.452737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-98aff595-7a77-409a-a9af-b4df5cd98bcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '736b00712abf4047b22beeab1b4d3cec'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:23.453669 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-98aff595-7a77-409a-a9af-b4df5cd98bcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '736b00712abf4047b22beeab1b4d3cec'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:23.454487 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-98aff595-7a77-409a-a9af-b4df5cd98bcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '736b00712abf4047b22beeab1b4d3cec'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:23.476063 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1109/2205] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:12:22 2022] DELETE /identity/v3/users/736b00712abf4047b22beeab1b4d3cec => generated 0 bytes in 857 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:23.481974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:23.978634 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:24.222454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa0c6e-9427-40df-97fa-8fe08d13029c admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:24.224186 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-23fa0c6e-9427-40df-97fa-8fe08d13029c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:24.240254 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa0c6e-9427-40df-97fa-8fe08d13029c admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:24.333179 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767fc771-3f19-48a4-bd07-0f46e0fe42fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:24.333555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fc771-3f19-48a4-bd07-0f46e0fe42fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:24.333838 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fc771-3f19-48a4-bd07-0f46e0fe42fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:24.334113 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fc771-3f19-48a4-bd07-0f46e0fe42fd admin admin] PATH_INFO: `/v3/projects/f7eb698dc30045ac9dd5f25293d43654` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:24.335458 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767fc771-3f19-48a4-bd07-0f46e0fe42fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7eb698dc30045ac9dd5f25293d43654)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:24.337424 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767fc771-3f19-48a4-bd07-0f46e0fe42fd admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:24.457911 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:24.502002 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-767fc771-3f19-48a4-bd07-0f46e0fe42fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7eb698dc30045ac9dd5f25293d43654', 'request_id': 'req-767fc771-3f19-48a4-bd07-0f46e0fe42fd'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:24.511963 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-767fc771-3f19-48a4-bd07-0f46e0fe42fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7eb698dc30045ac9dd5f25293d43654', 'request_id': 'req-767fc771-3f19-48a4-bd07-0f46e0fe42fd'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:24.531024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-767fc771-3f19-48a4-bd07-0f46e0fe42fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7eb698dc30045ac9dd5f25293d43654', 'request_id': 'req-767fc771-3f19-48a4-bd07-0f46e0fe42fd'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:24.658569 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-767fc771-3f19-48a4-bd07-0f46e0fe42fd admin admin] The token cache is being invalidate because project f7eb698dc30045ac9dd5f25293d43654 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:12:24.658854 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-767fc771-3f19-48a4-bd07-0f46e0fe42fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:24.659630 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-767fc771-3f19-48a4-bd07-0f46e0fe42fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:24.661178 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1097/2206] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:12:24 2022] DELETE /identity/v3/projects/f7eb698dc30045ac9dd5f25293d43654 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:24.666715 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2bd79-f91b-4ddd-838d-f261010310b8 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:24.667513 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2bd79-f91b-4ddd-838d-f261010310b8 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:24.668025 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a2bd79-f91b-4ddd-838d-f261010310b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:24.704684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-e4a2bd79-f91b-4ddd-838d-f261010310b8 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:24.706266 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-e4a2bd79-f91b-4ddd-838d-f261010310b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:24.798872 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1110/2207] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:24.812152 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83957a-8782-4964-bd38-4111ac64b644 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:24.812696 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83957a-8782-4964-bd38-4111ac64b644 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:24.813133 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83957a-8782-4964-bd38-4111ac64b644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:24.842782 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-9e83957a-8782-4964-bd38-4111ac64b644 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:24.844667 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-9e83957a-8782-4964-bd38-4111ac64b644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:24.853212 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1098/2208] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:24.860688 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2bd79-f91b-4ddd-838d-f261010310b8 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:24.876589 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a2bd79-f91b-4ddd-838d-f261010310b8 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:24.881599 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579baf92-d8df-496c-97aa-d70262c983d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:24.882239 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579baf92-d8df-496c-97aa-d70262c983d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:24.882522 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579baf92-d8df-496c-97aa-d70262c983d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:24.882773 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579baf92-d8df-496c-97aa-d70262c983d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:24.883771 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579baf92-d8df-496c-97aa-d70262c983d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:12:24.888510 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579baf92-d8df-496c-97aa-d70262c983d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:24.888510 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579baf92-d8df-496c-97aa-d70262c983d6 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:24.904347 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1111/2209] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:12:24.905717 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83957a-8782-4964-bd38-4111ac64b644 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:24.915574 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83957a-8782-4964-bd38-4111ac64b644 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:24.932499 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb222a5-c220-4988-bc63-882f75591ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:24.933127 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb222a5-c220-4988-bc63-882f75591ccd admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:24.933410 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb222a5-c220-4988-bc63-882f75591ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:24.933685 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb222a5-c220-4988-bc63-882f75591ccd admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:24.940303 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb222a5-c220-4988-bc63-882f75591ccd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:24.943947 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb222a5-c220-4988-bc63-882f75591ccd admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:25.046515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:25.111309 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1099/2210] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:12:24 2022] POST /identity/v3/projects => generated 363 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:12:25.115755 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579baf92-d8df-496c-97aa-d70262c983d6 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:25.131745 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579baf92-d8df-496c-97aa-d70262c983d6 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:25.210724 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2531f-b03f-43a3-85ba-cd92dbb4778e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:25.211441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2531f-b03f-43a3-85ba-cd92dbb4778e admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:25.211709 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2531f-b03f-43a3-85ba-cd92dbb4778e admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:25.212173 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2531f-b03f-43a3-85ba-cd92dbb4778e admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:25.215428 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2531f-b03f-43a3-85ba-cd92dbb4778e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:25.218263 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2531f-b03f-43a3-85ba-cd92dbb4778e admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:25.330201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1112/2211] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:12:25 2022] POST /identity/v3/users => generated 282 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:12:25.331874 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb222a5-c220-4988-bc63-882f75591ccd admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:25.345412 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb222a5-c220-4988-bc63-882f75591ccd admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:25.351550 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f0b66-b637-42c7-b966-2901d221c41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:25.352258 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f0b66-b637-42c7-b966-2901d221c41e admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:25.353086 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f0b66-b637-42c7-b966-2901d221c41e admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:25.353086 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f0b66-b637-42c7-b966-2901d221c41e admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:25.353689 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f0b66-b637-42c7-b966-2901d221c41e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:25.355418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f0b66-b637-42c7-b966-2901d221c41e admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:25.368674 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1100/2212] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:12:25.373139 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2531f-b03f-43a3-85ba-cd92dbb4778e admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:25.384911 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2531f-b03f-43a3-85ba-cd92dbb4778e admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:25.400382 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:25.410560 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083d77cb-e4d7-48c8-9cda-7e4195877151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:25.410560 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d77cb-e4d7-48c8-9cda-7e4195877151 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:25.410560 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d77cb-e4d7-48c8-9cda-7e4195877151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:25.410560 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083d77cb-e4d7-48c8-9cda-7e4195877151 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:25.410986 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d77cb-e4d7-48c8-9cda-7e4195877151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:25.410986 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083d77cb-e4d7-48c8-9cda-7e4195877151 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:25.426244 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1113/2213] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:25.428662 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f0b66-b637-42c7-b966-2901d221c41e admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:25.440338 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f0b66-b637-42c7-b966-2901d221c41e admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:25.445401 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843857c-1dbc-4029-9495-5eb598934017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:25.446076 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843857c-1dbc-4029-9495-5eb598934017 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:25.446351 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843857c-1dbc-4029-9495-5eb598934017 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:25.446873 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843857c-1dbc-4029-9495-5eb598934017 admin admin] PATH_INFO: `/v3/projects/d786f7237f584935a1215fca5a1a8c9c/users/2f81f322a1024cffbdcca790be4cb883/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:25.466207 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843857c-1dbc-4029-9495-5eb598934017 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d786f7237f584935a1215fca5a1a8c9c, user_id=2f81f322a1024cffbdcca790be4cb883, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:25.469778 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843857c-1dbc-4029-9495-5eb598934017 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:25.526424 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1101/2214] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:12:25 2022] PUT /identity/v3/projects/d786f7237f584935a1215fca5a1a8c9c/users/2f81f322a1024cffbdcca790be4cb883/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:25.538407 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68849210-60f8-4621-b43b-f0de0e8685ef None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:25.539232 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68849210-60f8-4621-b43b-f0de0e8685ef None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:25.539724 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68849210-60f8-4621-b43b-f0de0e8685ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:25.578777 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-68849210-60f8-4621-b43b-f0de0e8685ef None None] MFA Rules not processed for user `2f81f322a1024cffbdcca790be4cb883`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:25.580209 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-68849210-60f8-4621-b43b-f0de0e8685ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:25.666151 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1114/2215] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:25.670945 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843857c-1dbc-4029-9495-5eb598934017 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:25.747949 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843857c-1dbc-4029-9495-5eb598934017 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:25.753070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca211649-84b2-4cfc-b822-7878977cf616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:25.755171 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca211649-84b2-4cfc-b822-7878977cf616 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:25.755171 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca211649-84b2-4cfc-b822-7878977cf616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:25.755171 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca211649-84b2-4cfc-b822-7878977cf616 admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:25.755171 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca211649-84b2-4cfc-b822-7878977cf616 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:25.756799 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca211649-84b2-4cfc-b822-7878977cf616 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:25.907202 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1102/2216] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:12:25 2022] POST /identity/v3/projects => generated 365 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:12:25.909693 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68849210-60f8-4621-b43b-f0de0e8685ef None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:25.921530 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68849210-60f8-4621-b43b-f0de0e8685ef None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:26.000257 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ae2a1-a24e-481c-a6d9-1b1248981d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:26.001177 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ae2a1-a24e-481c-a6d9-1b1248981d22 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:26.001532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ae2a1-a24e-481c-a6d9-1b1248981d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:26.001880 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ae2a1-a24e-481c-a6d9-1b1248981d22 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:26.002709 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ae2a1-a24e-481c-a6d9-1b1248981d22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:26.008344 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ae2a1-a24e-481c-a6d9-1b1248981d22 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:26.158631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1115/2217] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:12:25 2022] POST /identity/v3/users => generated 289 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:12:26.165698 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca211649-84b2-4cfc-b822-7878977cf616 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:26.180599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca211649-84b2-4cfc-b822-7878977cf616 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:26.186404 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6794d4-88e5-4dc4-9ae6-e44d9778b23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:26.187018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6794d4-88e5-4dc4-9ae6-e44d9778b23f admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:26.187379 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6794d4-88e5-4dc4-9ae6-e44d9778b23f admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:26.187651 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6794d4-88e5-4dc4-9ae6-e44d9778b23f admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:26.188373 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6794d4-88e5-4dc4-9ae6-e44d9778b23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:26.190069 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6794d4-88e5-4dc4-9ae6-e44d9778b23f admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:26.203773 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1103/2218] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:26.208329 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ae2a1-a24e-481c-a6d9-1b1248981d22 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:26.219625 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ae2a1-a24e-481c-a6d9-1b1248981d22 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:26.229814 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e8229-4fa1-4753-9d49-5a5fffe8bbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:26.230502 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e8229-4fa1-4753-9d49-5a5fffe8bbed admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:26.230782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e8229-4fa1-4753-9d49-5a5fffe8bbed admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:26.231058 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06e8229-4fa1-4753-9d49-5a5fffe8bbed admin admin] PATH_INFO: `/v3/projects/ecf78a890d3c4174ae744a7a9d7e60cf/users/aed04b03d09a4103919a88a8d1881b85/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:26.252523 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:26.257066 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06e8229-4fa1-4753-9d49-5a5fffe8bbed admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecf78a890d3c4174ae744a7a9d7e60cf, user_id=aed04b03d09a4103919a88a8d1881b85, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:26.260175 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06e8229-4fa1-4753-9d49-5a5fffe8bbed admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:26.371851 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1116/2219] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:12:26 2022] PUT /identity/v3/projects/ecf78a890d3c4174ae744a7a9d7e60cf/users/aed04b03d09a4103919a88a8d1881b85/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:26.380547 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6794d4-88e5-4dc4-9ae6-e44d9778b23f admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:26.394917 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6794d4-88e5-4dc4-9ae6-e44d9778b23f admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:26.458136 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:26.464301 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e549c6f3-6ef8-49d1-babe-526b0f038f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:26.464988 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549c6f3-6ef8-49d1-babe-526b0f038f46 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:26.465271 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549c6f3-6ef8-49d1-babe-526b0f038f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:26.465645 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e549c6f3-6ef8-49d1-babe-526b0f038f46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:26.467317 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e549c6f3-6ef8-49d1-babe-526b0f038f46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:26.468901 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e549c6f3-6ef8-49d1-babe-526b0f038f46 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:26.497530 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1104/2220] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:26.497701 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e8229-4fa1-4753-9d49-5a5fffe8bbed admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:26.503318 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06e8229-4fa1-4753-9d49-5a5fffe8bbed admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:26.508519 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751196d-1eac-400e-8cad-6b71d8910299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:26.509220 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751196d-1eac-400e-8cad-6b71d8910299 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:26.509497 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751196d-1eac-400e-8cad-6b71d8910299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:26.509773 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751196d-1eac-400e-8cad-6b71d8910299 admin admin] PATH_INFO: `/v3/projects/ecf78a890d3c4174ae744a7a9d7e60cf/users/aed04b03d09a4103919a88a8d1881b85/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:26.512080 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f751196d-1eac-400e-8cad-6b71d8910299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecf78a890d3c4174ae744a7a9d7e60cf, user_id=aed04b03d09a4103919a88a8d1881b85, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:26.516203 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f751196d-1eac-400e-8cad-6b71d8910299 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:26.527269 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1117/2221] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:12:26 2022] PUT /identity/v3/projects/ecf78a890d3c4174ae744a7a9d7e60cf/users/aed04b03d09a4103919a88a8d1881b85/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:26.542708 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8db6d3-12d9-48eb-97c9-3c47316f4e78 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:26.543027 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8db6d3-12d9-48eb-97c9-3c47316f4e78 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:26.543306 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8db6d3-12d9-48eb-97c9-3c47316f4e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:26.579342 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-6e8db6d3-12d9-48eb-97c9-3c47316f4e78 None None] MFA Rules not processed for user `aed04b03d09a4103919a88a8d1881b85`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:26.580776 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-6e8db6d3-12d9-48eb-97c9-3c47316f4e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:26.668623 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1105/2222] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:26 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:26.680336 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751196d-1eac-400e-8cad-6b71d8910299 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:26.682119 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-f751196d-1eac-400e-8cad-6b71d8910299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:26.725698 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8db6d3-12d9-48eb-97c9-3c47316f4e78 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:26.727224 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-6e8db6d3-12d9-48eb-97c9-3c47316f4e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:26.745766 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751196d-1eac-400e-8cad-6b71d8910299 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:26.751148 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c6322-0083-4990-a347-160edf175423 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:26.751777 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c6322-0083-4990-a347-160edf175423 service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:26.752083 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c6322-0083-4990-a347-160edf175423 service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:26.752355 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c6322-0083-4990-a347-160edf175423 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:26.762112 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c6322-0083-4990-a347-160edf175423 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:26.765650 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c6322-0083-4990-a347-160edf175423 service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:26.777368 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1118/2223] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:26 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:12:26.815880 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8db6d3-12d9-48eb-97c9-3c47316f4e78 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:26.823594 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98c176-de59-4a6a-92e4-31fd152f6f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:26.826567 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98c176-de59-4a6a-92e4-31fd152f6f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:26.827549 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98c176-de59-4a6a-92e4-31fd152f6f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:26.827549 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a98c176-de59-4a6a-92e4-31fd152f6f62 admin admin] PATH_INFO: `/v3/users/d40e92ce7c0e4b6d9a126a8dce2ee73e` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:26.833165 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a98c176-de59-4a6a-92e4-31fd152f6f62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d40e92ce7c0e4b6d9a126a8dce2ee73e)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:26.833165 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a98c176-de59-4a6a-92e4-31fd152f6f62 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:26.949185 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2ae34-d865-49e2-a616-5b52fb9fffb0 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:26.949464 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2ae34-d865-49e2-a616-5b52fb9fffb0 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:26.949734 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d2ae34-d865-49e2-a616-5b52fb9fffb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:26.971205 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-c6d2ae34-d865-49e2-a616-5b52fb9fffb0 None None] MFA Rules not processed for user `2cad680ebdab4fd4996f39f2e08eabb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:26.972507 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-c6d2ae34-d865-49e2-a616-5b52fb9fffb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:27.036274 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1119/2224] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:12:27.044567 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2ae34-d865-49e2-a616-5b52fb9fffb0 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:27.045760 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-8a98c176-de59-4a6a-92e4-31fd152f6f62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd40e92ce7c0e4b6d9a126a8dce2ee73e'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:27.046066 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-c6d2ae34-d865-49e2-a616-5b52fb9fffb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:27.046574 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-8a98c176-de59-4a6a-92e4-31fd152f6f62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd40e92ce7c0e4b6d9a126a8dce2ee73e'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:27.054677 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-8a98c176-de59-4a6a-92e4-31fd152f6f62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd40e92ce7c0e4b6d9a126a8dce2ee73e'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:27.055418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-8a98c176-de59-4a6a-92e4-31fd152f6f62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd40e92ce7c0e4b6d9a126a8dce2ee73e'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:27.061669 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d2ae34-d865-49e2-a616-5b52fb9fffb0 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:27.068356 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f15e5-5f52-41e8-9ed0-a74f6f7e9f1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:27.069273 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f15e5-5f52-41e8-9ed0-a74f6f7e9f1d service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:27.069577 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f15e5-5f52-41e8-9ed0-a74f6f7e9f1d service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:27.069947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f15e5-5f52-41e8-9ed0-a74f6f7e9f1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:27.072011 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-2e0f15e5-5f52-41e8-9ed0-a74f6f7e9f1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:27.137058 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f15e5-5f52-41e8-9ed0-a74f6f7e9f1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:27.140213 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f15e5-5f52-41e8-9ed0-a74f6f7e9f1d service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:27.149349 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1120/2225] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:12:27.165951 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-8a98c176-de59-4a6a-92e4-31fd152f6f62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd40e92ce7c0e4b6d9a126a8dce2ee73e'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:27.200432 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1106/2226] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:12:26 2022] DELETE /identity/v3/users/d40e92ce7c0e4b6d9a126a8dce2ee73e => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:27.202140 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9976754-c2cb-4318-a9c9-2e8998506d4f None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:27.202680 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9976754-c2cb-4318-a9c9-2e8998506d4f None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:27.202680 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9976754-c2cb-4318-a9c9-2e8998506d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:27.225193 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-f9976754-c2cb-4318-a9c9-2e8998506d4f None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:27.226502 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-f9976754-c2cb-4318-a9c9-2e8998506d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:27.315315 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1121/2227] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:27.331836 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98c176-de59-4a6a-92e4-31fd152f6f62 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:27.333724 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-8a98c176-de59-4a6a-92e4-31fd152f6f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:27.410105 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a98c176-de59-4a6a-92e4-31fd152f6f62 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:27.413701 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06debeb5-3ffa-49f3-a1c2-475618955d9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:27.414318 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06debeb5-3ffa-49f3-a1c2-475618955d9f service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:27.414602 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06debeb5-3ffa-49f3-a1c2-475618955d9f service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:27.414873 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06debeb5-3ffa-49f3-a1c2-475618955d9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:27.426409 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06debeb5-3ffa-49f3-a1c2-475618955d9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:27.427921 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06debeb5-3ffa-49f3-a1c2-475618955d9f service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:27.441171 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1107/2228] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:12:27.823895 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:27.912254 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9976754-c2cb-4318-a9c9-2e8998506d4f None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:27.912254 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-f9976754-c2cb-4318-a9c9-2e8998506d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:27.925821 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9976754-c2cb-4318-a9c9-2e8998506d4f None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:27.930701 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0240e2-20de-4f7c-8e52-cbb768ffad84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:27.937436 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0240e2-20de-4f7c-8e52-cbb768ffad84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:27.937436 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0240e2-20de-4f7c-8e52-cbb768ffad84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:27.937436 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0240e2-20de-4f7c-8e52-cbb768ffad84 admin admin] PATH_INFO: `/v3/users/74e7203d5da8460dbf37448d09ad5a7d` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:27.937436 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0240e2-20de-4f7c-8e52-cbb768ffad84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74e7203d5da8460dbf37448d09ad5a7d)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:27.937436 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0240e2-20de-4f7c-8e52-cbb768ffad84 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:28.030426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06debeb5-3ffa-49f3-a1c2-475618955d9f service neutron] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:28.031904 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-06debeb5-3ffa-49f3-a1c2-475618955d9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:28.050204 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06debeb5-3ffa-49f3-a1c2-475618955d9f service neutron] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:28.052575 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c5b40-99b9-4520-86c9-ab13c7327ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:28.053298 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c5b40-99b9-4520-86c9-ab13c7327ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:28.053661 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c5b40-99b9-4520-86c9-ab13c7327ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:28.054005 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c5b40-99b9-4520-86c9-ab13c7327ce4 admin admin] PATH_INFO: `/v3/projects/c2f3415974d14b9e99cdc9903e5277b8` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:28.055195 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c5b40-99b9-4520-86c9-ab13c7327ce4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2f3415974d14b9e99cdc9903e5277b8)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:28.057155 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c5b40-99b9-4520-86c9-ab13c7327ce4 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:28.206215 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:28.290553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-fd0240e2-20de-4f7c-8e52-cbb768ffad84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74e7203d5da8460dbf37448d09ad5a7d'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:28.296269 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-f99c5b40-99b9-4520-86c9-ab13c7327ce4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2f3415974d14b9e99cdc9903e5277b8', 'request_id': 'req-f99c5b40-99b9-4520-86c9-ab13c7327ce4'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:28.299151 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-fd0240e2-20de-4f7c-8e52-cbb768ffad84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74e7203d5da8460dbf37448d09ad5a7d'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:28.302696 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-f99c5b40-99b9-4520-86c9-ab13c7327ce4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2f3415974d14b9e99cdc9903e5277b8', 'request_id': 'req-f99c5b40-99b9-4520-86c9-ab13c7327ce4'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:28.309152 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-f99c5b40-99b9-4520-86c9-ab13c7327ce4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2f3415974d14b9e99cdc9903e5277b8', 'request_id': 'req-f99c5b40-99b9-4520-86c9-ab13c7327ce4'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:28.400262 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-fd0240e2-20de-4f7c-8e52-cbb768ffad84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74e7203d5da8460dbf37448d09ad5a7d'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:28.401059 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-fd0240e2-20de-4f7c-8e52-cbb768ffad84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74e7203d5da8460dbf37448d09ad5a7d'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:28.401486 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-fd0240e2-20de-4f7c-8e52-cbb768ffad84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74e7203d5da8460dbf37448d09ad5a7d'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:28.422905 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1122/2229] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:12:27 2022] DELETE /identity/v3/users/74e7203d5da8460dbf37448d09ad5a7d => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:28.429934 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1b975-f0b3-4926-a61b-5665288922dd None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:28.430476 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1b975-f0b3-4926-a61b-5665288922dd None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:28.431031 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1b975-f0b3-4926-a61b-5665288922dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:28.457837 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-f9d1b975-f0b3-4926-a61b-5665288922dd None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:28.459191 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-f9d1b975-f0b3-4926-a61b-5665288922dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:28.533992 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1123/2230] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:12:28.545074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1b975-f0b3-4926-a61b-5665288922dd None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:28.550692 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-f9d1b975-f0b3-4926-a61b-5665288922dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:28.585414 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-f99c5b40-99b9-4520-86c9-ab13c7327ce4 admin admin] The token cache is being invalidate because project c2f3415974d14b9e99cdc9903e5277b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:12:28.585903 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-f99c5b40-99b9-4520-86c9-ab13c7327ce4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:28.586896 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-f99c5b40-99b9-4520-86c9-ab13c7327ce4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:28.591022 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1108/2231] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:12:28 2022] DELETE /identity/v3/projects/c2f3415974d14b9e99cdc9903e5277b8 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:12:28.596302 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c5b40-99b9-4520-86c9-ab13c7327ce4 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:28.599254 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-f99c5b40-99b9-4520-86c9-ab13c7327ce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:28.649954 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1b975-f0b3-4926-a61b-5665288922dd None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:28.655454 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e8ad3-5656-4d27-851d-47e71cf77601 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:28.656180 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e8ad3-5656-4d27-851d-47e71cf77601 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:28.656484 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e8ad3-5656-4d27-851d-47e71cf77601 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:28.656758 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9e8ad3-5656-4d27-851d-47e71cf77601 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:28.658603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-1d9e8ad3-5656-4d27-851d-47e71cf77601 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:28.677244 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9e8ad3-5656-4d27-851d-47e71cf77601 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:28.678415 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9e8ad3-5656-4d27-851d-47e71cf77601 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:28.692154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1124/2232] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:12:28.700912 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c5b40-99b9-4520-86c9-ab13c7327ce4 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:28.709562 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb09446-1c28-4408-8371-b8aac3638181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:28.710740 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb09446-1c28-4408-8371-b8aac3638181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:28.711034 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb09446-1c28-4408-8371-b8aac3638181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:28.711445 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb09446-1c28-4408-8371-b8aac3638181 admin admin] PATH_INFO: `/v3/users/ee8279e2fa0a416289729f994e1a882a` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:28.713155 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb09446-1c28-4408-8371-b8aac3638181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee8279e2fa0a416289729f994e1a882a)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:28.714819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb09446-1c28-4408-8371-b8aac3638181 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:28.986013 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-4cb09446-1c28-4408-8371-b8aac3638181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee8279e2fa0a416289729f994e1a882a'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:28.986755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-4cb09446-1c28-4408-8371-b8aac3638181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee8279e2fa0a416289729f994e1a882a'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:28.997530 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-4cb09446-1c28-4408-8371-b8aac3638181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee8279e2fa0a416289729f994e1a882a'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:28.999387 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-4cb09446-1c28-4408-8371-b8aac3638181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee8279e2fa0a416289729f994e1a882a'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:29.108694 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-4cb09446-1c28-4408-8371-b8aac3638181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee8279e2fa0a416289729f994e1a882a'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:29.130356 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1109/2233] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:12:28 2022] DELETE /identity/v3/users/ee8279e2fa0a416289729f994e1a882a => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:12:29.261676 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e8ad3-5656-4d27-851d-47e71cf77601 service neutron] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:29.265141 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-1d9e8ad3-5656-4d27-851d-47e71cf77601 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:29.287993 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9e8ad3-5656-4d27-851d-47e71cf77601 service neutron] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:29.356737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7f6c6-0cb3-47a9-8518-861616e8cec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:29.357459 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7f6c6-0cb3-47a9-8518-861616e8cec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:29.357742 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7f6c6-0cb3-47a9-8518-861616e8cec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:29.358009 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7f6c6-0cb3-47a9-8518-861616e8cec1 admin admin] PATH_INFO: `/v3/projects/5d86e85269514d2aa2989a89ec12fff4` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:29.359250 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7f6c6-0cb3-47a9-8518-861616e8cec1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d86e85269514d2aa2989a89ec12fff4)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:29.361171 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7f6c6-0cb3-47a9-8518-861616e8cec1 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:29.511020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-87e7f6c6-0cb3-47a9-8518-861616e8cec1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d86e85269514d2aa2989a89ec12fff4', 'request_id': 'req-87e7f6c6-0cb3-47a9-8518-861616e8cec1'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:29.517113 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-87e7f6c6-0cb3-47a9-8518-861616e8cec1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d86e85269514d2aa2989a89ec12fff4', 'request_id': 'req-87e7f6c6-0cb3-47a9-8518-861616e8cec1'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:29.634934 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-87e7f6c6-0cb3-47a9-8518-861616e8cec1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d86e85269514d2aa2989a89ec12fff4', 'request_id': 'req-87e7f6c6-0cb3-47a9-8518-861616e8cec1'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:29.647973 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-87e7f6c6-0cb3-47a9-8518-861616e8cec1 admin admin] The token cache is being invalidate because project 5d86e85269514d2aa2989a89ec12fff4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:12:29.648491 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-87e7f6c6-0cb3-47a9-8518-861616e8cec1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:29.649623 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-87e7f6c6-0cb3-47a9-8518-861616e8cec1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:29.652015 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1125/2234] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:12:29 2022] DELETE /identity/v3/projects/5d86e85269514d2aa2989a89ec12fff4 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:29.656841 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb09446-1c28-4408-8371-b8aac3638181 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:29.658552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-4cb09446-1c28-4408-8371-b8aac3638181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:29.674370 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb09446-1c28-4408-8371-b8aac3638181 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:29.677574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7f6c6-0cb3-47a9-8518-861616e8cec1 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:29.685699 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-87e7f6c6-0cb3-47a9-8518-861616e8cec1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:29.773146 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dbc7ec-b92c-48a6-8cc9-06c2e904fafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:29.773965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbc7ec-b92c-48a6-8cc9-06c2e904fafd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:29.774407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbc7ec-b92c-48a6-8cc9-06c2e904fafd admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:29.774694 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dbc7ec-b92c-48a6-8cc9-06c2e904fafd admin admin] PATH_INFO: `/v3/users/9f4707e3f8944bcd86fc2e3ec7a68350` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:29.776251 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dbc7ec-b92c-48a6-8cc9-06c2e904fafd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f4707e3f8944bcd86fc2e3ec7a68350)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:29.779281 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dbc7ec-b92c-48a6-8cc9-06c2e904fafd admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:29.798938 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7f6c6-0cb3-47a9-8518-861616e8cec1 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:29.805417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c69ef48-be4a-46f0-a156-e07284a54833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:29.806623 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69ef48-be4a-46f0-a156-e07284a54833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:29.807323 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69ef48-be4a-46f0-a156-e07284a54833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:29.807609 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c69ef48-be4a-46f0-a156-e07284a54833 admin admin] PATH_INFO: `/v3/projects/c1243c901d52464788754fed978a8db0` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:29.809222 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c69ef48-be4a-46f0-a156-e07284a54833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1243c901d52464788754fed978a8db0)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:29.813166 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c69ef48-be4a-46f0-a156-e07284a54833 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:30.039825 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-69dbc7ec-b92c-48a6-8cc9-06c2e904fafd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f4707e3f8944bcd86fc2e3ec7a68350'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:30.040384 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-69dbc7ec-b92c-48a6-8cc9-06c2e904fafd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f4707e3f8944bcd86fc2e3ec7a68350'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:30.048933 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-69dbc7ec-b92c-48a6-8cc9-06c2e904fafd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f4707e3f8944bcd86fc2e3ec7a68350'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:30.049775 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-69dbc7ec-b92c-48a6-8cc9-06c2e904fafd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f4707e3f8944bcd86fc2e3ec7a68350'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:30.068892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-4c69ef48-be4a-46f0-a156-e07284a54833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1243c901d52464788754fed978a8db0', 'request_id': 'req-4c69ef48-be4a-46f0-a156-e07284a54833'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:30.076375 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-4c69ef48-be4a-46f0-a156-e07284a54833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1243c901d52464788754fed978a8db0', 'request_id': 'req-4c69ef48-be4a-46f0-a156-e07284a54833'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:30.143055 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-69dbc7ec-b92c-48a6-8cc9-06c2e904fafd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f4707e3f8944bcd86fc2e3ec7a68350'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:30.168104 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1110/2235] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:12:29 2022] DELETE /identity/v3/users/9f4707e3f8944bcd86fc2e3ec7a68350 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:30.224421 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:30.225679 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-4c69ef48-be4a-46f0-a156-e07284a54833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1243c901d52464788754fed978a8db0', 'request_id': 'req-4c69ef48-be4a-46f0-a156-e07284a54833'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:30.239503 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-4c69ef48-be4a-46f0-a156-e07284a54833 admin admin] The token cache is being invalidate because project c1243c901d52464788754fed978a8db0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:12:30.239817 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-4c69ef48-be4a-46f0-a156-e07284a54833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:30.240526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-4c69ef48-be4a-46f0-a156-e07284a54833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:30.242188 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1126/2236] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:12:29 2022] DELETE /identity/v3/projects/c1243c901d52464788754fed978a8db0 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:30.248808 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c187020-328e-434a-a0a6-295f01a24db9 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:30.249079 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c187020-328e-434a-a0a6-295f01a24db9 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:30.249376 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c187020-328e-434a-a0a6-295f01a24db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:30.271477 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-6c187020-328e-434a-a0a6-295f01a24db9 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:30.272798 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-6c187020-328e-434a-a0a6-295f01a24db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:30.337163 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1111/2237] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:30.345969 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd2439-30c9-4430-9089-fd839dcf5dd9 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:30.346688 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd2439-30c9-4430-9089-fd839dcf5dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:30.346688 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd2439-30c9-4430-9089-fd839dcf5dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:30.368554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-32dd2439-30c9-4430-9089-fd839dcf5dd9 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:30.369948 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-32dd2439-30c9-4430-9089-fd839dcf5dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:30.378674 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1127/2238] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:30.382902 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c187020-328e-434a-a0a6-295f01a24db9 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:30.392912 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c187020-328e-434a-a0a6-295f01a24db9 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:30.397515 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b392788-581c-43a7-bd46-32ddfad32824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:30.398127 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b392788-581c-43a7-bd46-32ddfad32824 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:30.398402 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b392788-581c-43a7-bd46-32ddfad32824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:30.404701 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b392788-581c-43a7-bd46-32ddfad32824 admin admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:30.404701 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b392788-581c-43a7-bd46-32ddfad32824 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:12:30.404701 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b392788-581c-43a7-bd46-32ddfad32824 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:30.404701 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b392788-581c-43a7-bd46-32ddfad32824 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:30.413832 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1112/2239] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:12:30.418773 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd2439-30c9-4430-9089-fd839dcf5dd9 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:30.428789 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd2439-30c9-4430-9089-fd839dcf5dd9 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:30.437216 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca444c2-166b-4f50-9812-14bdedcdc872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:30.437216 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca444c2-166b-4f50-9812-14bdedcdc872 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:30.437216 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca444c2-166b-4f50-9812-14bdedcdc872 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:30.437216 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca444c2-166b-4f50-9812-14bdedcdc872 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:30.437657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca444c2-166b-4f50-9812-14bdedcdc872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:30.438679 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca444c2-166b-4f50-9812-14bdedcdc872 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:30.523979 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1128/2240] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:12:30 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:12:30.529033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b392788-581c-43a7-bd46-32ddfad32824 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:30.540863 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b392788-581c-43a7-bd46-32ddfad32824 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:30.629519 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:30.629908 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694cf65-bc37-447f-9773-fb01a13cc626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:30.630524 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694cf65-bc37-447f-9773-fb01a13cc626 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:30.630806 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694cf65-bc37-447f-9773-fb01a13cc626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:30.631081 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5694cf65-bc37-447f-9773-fb01a13cc626 admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:30.631737 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5694cf65-bc37-447f-9773-fb01a13cc626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:30.633962 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5694cf65-bc37-447f-9773-fb01a13cc626 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:30.684933 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca444c2-166b-4f50-9812-14bdedcdc872 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:30.687411 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-5ca444c2-166b-4f50-9812-14bdedcdc872 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:30.704530 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca444c2-166b-4f50-9812-14bdedcdc872 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:30.707222 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1113/2241] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:12:30 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:12:30.711514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6922545f-f95d-4091-b72f-2a50960f259a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:30.712281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922545f-f95d-4091-b72f-2a50960f259a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:30.712605 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694cf65-bc37-447f-9773-fb01a13cc626 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:30.719716 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922545f-f95d-4091-b72f-2a50960f259a admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:30.719867 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6922545f-f95d-4091-b72f-2a50960f259a admin admin] PATH_INFO: `/v3/projects/37342270e0ca404a9d36b9667e5ccd2a` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:30.721368 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922545f-f95d-4091-b72f-2a50960f259a admin admin] RBAC: Authorizing `identity:delete_project(project_id=37342270e0ca404a9d36b9667e5ccd2a)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:30.723640 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6922545f-f95d-4091-b72f-2a50960f259a admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:30.726629 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5694cf65-bc37-447f-9773-fb01a13cc626 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:30.733464 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9496bd-8bf6-44af-b77e-23d91502d8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:30.738862 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9496bd-8bf6-44af-b77e-23d91502d8bd admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:30.738862 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9496bd-8bf6-44af-b77e-23d91502d8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:30.738862 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9496bd-8bf6-44af-b77e-23d91502d8bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:30.738862 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9496bd-8bf6-44af-b77e-23d91502d8bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:30.738862 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9496bd-8bf6-44af-b77e-23d91502d8bd admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:30.753800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1114/2242] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:30.754981 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9496bd-8bf6-44af-b77e-23d91502d8bd admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:30.766223 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9496bd-8bf6-44af-b77e-23d91502d8bd admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:30.771353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f9ebd-01d0-4e6d-b4b2-53d0c19f3c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:30.771978 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f9ebd-01d0-4e6d-b4b2-53d0c19f3c82 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:30.772259 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f9ebd-01d0-4e6d-b4b2-53d0c19f3c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:30.772531 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f9ebd-01d0-4e6d-b4b2-53d0c19f3c82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:30.773181 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f9ebd-01d0-4e6d-b4b2-53d0c19f3c82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:30.774972 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f9ebd-01d0-4e6d-b4b2-53d0c19f3c82 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:30.786787 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1115/2243] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:12:30.791003 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f9ebd-01d0-4e6d-b4b2-53d0c19f3c82 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:30.802353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f9ebd-01d0-4e6d-b4b2-53d0c19f3c82 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:30.814690 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-6922545f-f95d-4091-b72f-2a50960f259a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37342270e0ca404a9d36b9667e5ccd2a', 'request_id': 'req-6922545f-f95d-4091-b72f-2a50960f259a'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:30.820547 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-6922545f-f95d-4091-b72f-2a50960f259a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37342270e0ca404a9d36b9667e5ccd2a', 'request_id': 'req-6922545f-f95d-4091-b72f-2a50960f259a'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:30.872569 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4df2b0e-2359-4217-8843-228a721f70f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:30.873346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df2b0e-2359-4217-8843-228a721f70f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:30.873703 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df2b0e-2359-4217-8843-228a721f70f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:30.874545 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4df2b0e-2359-4217-8843-228a721f70f2 admin admin] PATH_INFO: `/v3/projects/70ec4361173545078c436083e9c618a6/users/d3f1092857c845edbcae21dacaef9d08/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:30.882513 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-6922545f-f95d-4091-b72f-2a50960f259a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37342270e0ca404a9d36b9667e5ccd2a', 'request_id': 'req-6922545f-f95d-4091-b72f-2a50960f259a'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:30.895998 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df2b0e-2359-4217-8843-228a721f70f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70ec4361173545078c436083e9c618a6, user_id=d3f1092857c845edbcae21dacaef9d08, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:30.906952 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4df2b0e-2359-4217-8843-228a721f70f2 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:30.907087 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-6922545f-f95d-4091-b72f-2a50960f259a admin admin] The token cache is being invalidate because project 37342270e0ca404a9d36b9667e5ccd2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:12:30.907087 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-6922545f-f95d-4091-b72f-2a50960f259a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:30.907087 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-6922545f-f95d-4091-b72f-2a50960f259a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:30.907087 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1129/2244] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:12:30 2022] DELETE /identity/v3/projects/37342270e0ca404a9d36b9667e5ccd2a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:12:30.910381 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54629959-54a0-4945-ab9f-3a8b430906d7 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:30.910690 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54629959-54a0-4945-ab9f-3a8b430906d7 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:30.911003 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54629959-54a0-4945-ab9f-3a8b430906d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:30.930893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-54629959-54a0-4945-ab9f-3a8b430906d7 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:30.932650 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-54629959-54a0-4945-ab9f-3a8b430906d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:30.940832 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1130/2245] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:12:30.950744 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1d144-d354-4c8c-be2c-98938d869fc4 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:30.951239 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1d144-d354-4c8c-be2c-98938d869fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:30.953304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e1d144-d354-4c8c-be2c-98938d869fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:30.978153 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-47e1d144-d354-4c8c-be2c-98938d869fc4 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:30.978153 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-47e1d144-d354-4c8c-be2c-98938d869fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:30.983864 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1131/2246] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:12:30.988709 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1d144-d354-4c8c-be2c-98938d869fc4 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:30.999057 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e1d144-d354-4c8c-be2c-98938d869fc4 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:31.003486 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1116/2247] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:12:30 2022] PUT /identity/v3/projects/70ec4361173545078c436083e9c618a6/users/d3f1092857c845edbcae21dacaef9d08/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:12:31.015223 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327eb2d8-c413-4283-a8c4-5eb9faa11abc None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:31.016565 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327eb2d8-c413-4283-a8c4-5eb9faa11abc None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:31.016851 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327eb2d8-c413-4283-a8c4-5eb9faa11abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:31.047969 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-327eb2d8-c413-4283-a8c4-5eb9faa11abc None None] MFA Rules not processed for user `d3f1092857c845edbcae21dacaef9d08`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:31.049203 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-327eb2d8-c413-4283-a8c4-5eb9faa11abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:31.064666 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adfa9fc-f94d-46e0-b095-ebb6749ce96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:31.065616 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfa9fc-f94d-46e0-b095-ebb6749ce96f admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:31.065899 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfa9fc-f94d-46e0-b095-ebb6749ce96f admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:31.066167 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfa9fc-f94d-46e0-b095-ebb6749ce96f admin admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:31.066864 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adfa9fc-f94d-46e0-b095-ebb6749ce96f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:12:31.067672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adfa9fc-f94d-46e0-b095-ebb6749ce96f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:31.069621 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adfa9fc-f94d-46e0-b095-ebb6749ce96f admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:31.084614 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1132/2248] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:12:31.089134 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adfa9fc-f94d-46e0-b095-ebb6749ce96f admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:31.100729 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adfa9fc-f94d-46e0-b095-ebb6749ce96f admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:31.108801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980703f-4261-475e-8e43-9a93aac70841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:31.109505 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980703f-4261-475e-8e43-9a93aac70841 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:31.109898 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980703f-4261-475e-8e43-9a93aac70841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:31.110307 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8980703f-4261-475e-8e43-9a93aac70841 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:31.110971 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980703f-4261-475e-8e43-9a93aac70841 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:31.113407 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8980703f-4261-475e-8e43-9a93aac70841 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:31.132964 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1117/2249] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:31.134295 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327eb2d8-c413-4283-a8c4-5eb9faa11abc None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:31.140346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-327eb2d8-c413-4283-a8c4-5eb9faa11abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:31.157009 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327eb2d8-c413-4283-a8c4-5eb9faa11abc None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:31.163036 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068769e0-cf74-4bb7-ac0b-371e2ea012d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:31.164038 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068769e0-cf74-4bb7-ac0b-371e2ea012d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:31.164385 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068769e0-cf74-4bb7-ac0b-371e2ea012d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:31.164713 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068769e0-cf74-4bb7-ac0b-371e2ea012d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:31.165546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068769e0-cf74-4bb7-ac0b-371e2ea012d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:31.167757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068769e0-cf74-4bb7-ac0b-371e2ea012d8 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:31.231171 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1133/2250] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:12:31 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:12:31.231930 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980703f-4261-475e-8e43-9a93aac70841 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:31.237838 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-8980703f-4261-475e-8e43-9a93aac70841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:31.244287 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1118/2251] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:12:31 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:12:31.245691 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068769e0-cf74-4bb7-ac0b-371e2ea012d8 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:31.319195 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8980703f-4261-475e-8e43-9a93aac70841 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:31.325801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2101f4b-d0d4-4034-9627-6b7b6b9bbf45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:31.326842 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2101f4b-d0d4-4034-9627-6b7b6b9bbf45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:31.327194 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2101f4b-d0d4-4034-9627-6b7b6b9bbf45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:31.327457 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2101f4b-d0d4-4034-9627-6b7b6b9bbf45 admin admin] PATH_INFO: `/v3/users/2f81f322a1024cffbdcca790be4cb883` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:31.328188 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068769e0-cf74-4bb7-ac0b-371e2ea012d8 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:31.328907 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2101f4b-d0d4-4034-9627-6b7b6b9bbf45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f81f322a1024cffbdcca790be4cb883)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:31.333553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2101f4b-d0d4-4034-9627-6b7b6b9bbf45 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:31.341032 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57ed24-36c5-4144-8ff1-9ad3c50b6c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:31.341935 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57ed24-36c5-4144-8ff1-9ad3c50b6c69 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:31.342439 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57ed24-36c5-4144-8ff1-9ad3c50b6c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:31.342946 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a57ed24-36c5-4144-8ff1-9ad3c50b6c69 admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:31.343809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57ed24-36c5-4144-8ff1-9ad3c50b6c69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:31.345782 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a57ed24-36c5-4144-8ff1-9ad3c50b6c69 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:31.446299 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1119/2252] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:12:31 2022] POST /identity/v3/users => generated 287 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:12:31.447212 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57ed24-36c5-4144-8ff1-9ad3c50b6c69 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:31.458114 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a57ed24-36c5-4144-8ff1-9ad3c50b6c69 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:31.463670 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1eb0a-94eb-412e-8b7f-5318de10e608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:31.464389 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1eb0a-94eb-412e-8b7f-5318de10e608 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:31.464650 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1eb0a-94eb-412e-8b7f-5318de10e608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:31.464924 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1eb0a-94eb-412e-8b7f-5318de10e608 admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:31.466353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1eb0a-94eb-412e-8b7f-5318de10e608 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:31.468883 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e1eb0a-94eb-412e-8b7f-5318de10e608 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:31.534923 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-d2101f4b-d0d4-4034-9627-6b7b6b9bbf45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f81f322a1024cffbdcca790be4cb883'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:31.542019 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-d2101f4b-d0d4-4034-9627-6b7b6b9bbf45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f81f322a1024cffbdcca790be4cb883'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:31.589740 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1120/2253] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:12:31 2022] POST /identity/v3/users => generated 288 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:12:31.593436 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1eb0a-94eb-412e-8b7f-5318de10e608 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:31.602325 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1eb0a-94eb-412e-8b7f-5318de10e608 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:31.612702 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cafd9-d438-4720-ae74-061ed1e127f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:31.614865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cafd9-d438-4720-ae74-061ed1e127f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:31.614865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cafd9-d438-4720-ae74-061ed1e127f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:31.614865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908cafd9-d438-4720-ae74-061ed1e127f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:31.614865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cafd9-d438-4720-ae74-061ed1e127f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:31.616165 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908cafd9-d438-4720-ae74-061ed1e127f4 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:31.629034 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1121/2254] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:31.629918 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cafd9-d438-4720-ae74-061ed1e127f4 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:31.640298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-d2101f4b-d0d4-4034-9627-6b7b6b9bbf45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f81f322a1024cffbdcca790be4cb883'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:31.640927 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-d2101f4b-d0d4-4034-9627-6b7b6b9bbf45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f81f322a1024cffbdcca790be4cb883'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:31.641525 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-d2101f4b-d0d4-4034-9627-6b7b6b9bbf45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f81f322a1024cffbdcca790be4cb883'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:31.642230 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908cafd9-d438-4720-ae74-061ed1e127f4 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:31.647694 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662fc10-7f9c-4c9f-b8f6-186ba90d4ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:31.648693 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662fc10-7f9c-4c9f-b8f6-186ba90d4ebb admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:31.649065 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662fc10-7f9c-4c9f-b8f6-186ba90d4ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:31.649378 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662fc10-7f9c-4c9f-b8f6-186ba90d4ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:31.650379 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662fc10-7f9c-4c9f-b8f6-186ba90d4ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:31.651962 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662fc10-7f9c-4c9f-b8f6-186ba90d4ebb admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:31.664641 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1134/2255] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:12:31 2022] DELETE /identity/v3/users/2f81f322a1024cffbdcca790be4cb883 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:31.669707 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2101f4b-d0d4-4034-9627-6b7b6b9bbf45 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:31.669856 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1122/2256] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:31.669955 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-d2101f4b-d0d4-4034-9627-6b7b6b9bbf45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:31.670982 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d6745-d980-4fb1-a74e-88a85ef8ebb9 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:31.671562 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d6745-d980-4fb1-a74e-88a85ef8ebb9 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:31.671734 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d6745-d980-4fb1-a74e-88a85ef8ebb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:31.695553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-aa3d6745-d980-4fb1-a74e-88a85ef8ebb9 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:31.700574 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-aa3d6745-d980-4fb1-a74e-88a85ef8ebb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:31.740470 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2101f4b-d0d4-4034-9627-6b7b6b9bbf45 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:31.746346 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f24aa-be55-4076-a5fe-4644809ef26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:31.747315 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f24aa-be55-4076-a5fe-4644809ef26b admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:31.748381 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f24aa-be55-4076-a5fe-4644809ef26b admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:31.748660 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2f24aa-be55-4076-a5fe-4644809ef26b admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:31.749321 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f24aa-be55-4076-a5fe-4644809ef26b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:31.750925 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2f24aa-be55-4076-a5fe-4644809ef26b admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:31.759711 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1123/2257] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:12:31.760742 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d6745-d980-4fb1-a74e-88a85ef8ebb9 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:31.761834 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1135/2258] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:31.763960 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-aa3d6745-d980-4fb1-a74e-88a85ef8ebb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:31.772510 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f24aa-be55-4076-a5fe-4644809ef26b admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:31.786851 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d6745-d980-4fb1-a74e-88a85ef8ebb9 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:31.786981 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2f24aa-be55-4076-a5fe-4644809ef26b admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:31.789870 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:31.790046 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1114168d-cfb1-4444-93cd-d0996cff5b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:31.790735 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114168d-cfb1-4444-93cd-d0996cff5b3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:31.791002 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114168d-cfb1-4444-93cd-d0996cff5b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:31.791742 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114168d-cfb1-4444-93cd-d0996cff5b3b admin admin] PATH_INFO: `/v3/projects/47b6f105989f41a7b4a56be357f583f1/users/14dcdf67d4d34156b1fa6dcd9571aa95/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:31.791925 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e17cf-34c3-4ab9-bb73-b58b476c33f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:31.792476 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e17cf-34c3-4ab9-bb73-b58b476c33f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:31.792969 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e17cf-34c3-4ab9-bb73-b58b476c33f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:31.793339 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e17cf-34c3-4ab9-bb73-b58b476c33f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:31.794123 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e17cf-34c3-4ab9-bb73-b58b476c33f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:31.795979 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e17cf-34c3-4ab9-bb73-b58b476c33f2 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:31.807678 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1124/2259] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:31.808657 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e17cf-34c3-4ab9-bb73-b58b476c33f2 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:31.810671 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-243e17cf-34c3-4ab9-bb73-b58b476c33f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:31.811829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1114168d-cfb1-4444-93cd-d0996cff5b3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=47b6f105989f41a7b4a56be357f583f1, user_id=14dcdf67d4d34156b1fa6dcd9571aa95, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:31.814647 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1114168d-cfb1-4444-93cd-d0996cff5b3b admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:31.876292 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e17cf-34c3-4ab9-bb73-b58b476c33f2 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:31.880293 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef379e-7266-48f4-a399-c8f0f195b1c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:31.884824 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef379e-7266-48f4-a399-c8f0f195b1c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:31.884824 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef379e-7266-48f4-a399-c8f0f195b1c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:31.884824 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef379e-7266-48f4-a399-c8f0f195b1c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:31.894285 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef379e-7266-48f4-a399-c8f0f195b1c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:31.895859 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef379e-7266-48f4-a399-c8f0f195b1c3 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:31.911094 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1125/2260] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:12:31.911956 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef379e-7266-48f4-a399-c8f0f195b1c3 service neutron] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:31.922742 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef379e-7266-48f4-a399-c8f0f195b1c3 service neutron] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:31.927430 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e98be-4cea-4156-900e-9f008ac822ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:31.928088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e98be-4cea-4156-900e-9f008ac822ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:31.928360 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e98be-4cea-4156-900e-9f008ac822ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:31.928776 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e98be-4cea-4156-900e-9f008ac822ba admin admin] PATH_INFO: `/v3/projects/60cb546a1d144c24872c85b257901aba/users/571ed8f5f40e45cb86107f6a99fea0bf/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:31.938502 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:31.946288 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1136/2261] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:12:31 2022] PUT /identity/v3/projects/47b6f105989f41a7b4a56be357f583f1/users/14dcdf67d4d34156b1fa6dcd9571aa95/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:31.952398 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e75542-fef5-48fe-8ca3-d093b347241f None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:31.952709 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e75542-fef5-48fe-8ca3-d093b347241f None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:31.953053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e75542-fef5-48fe-8ca3-d093b347241f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:31.953725 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e98be-4cea-4156-900e-9f008ac822ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=60cb546a1d144c24872c85b257901aba, user_id=571ed8f5f40e45cb86107f6a99fea0bf, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:31.956503 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e98be-4cea-4156-900e-9f008ac822ba admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:31.976362 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-18e75542-fef5-48fe-8ca3-d093b347241f None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:31.977621 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-18e75542-fef5-48fe-8ca3-d093b347241f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:32.046819 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1137/2262] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:12:32.068038 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1126/2263] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:12:31 2022] PUT /identity/v3/projects/60cb546a1d144c24872c85b257901aba/users/571ed8f5f40e45cb86107f6a99fea0bf/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:32.068312 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e75542-fef5-48fe-8ca3-d093b347241f None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:32.132631 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e86219-67a6-4aaf-927e-f90d78718965 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:32.132928 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e86219-67a6-4aaf-927e-f90d78718965 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:32.133481 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e86219-67a6-4aaf-927e-f90d78718965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:32.145810 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e75542-fef5-48fe-8ca3-d093b347241f None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:32.164858 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-b3e86219-67a6-4aaf-927e-f90d78718965 None None] MFA Rules not processed for user `571ed8f5f40e45cb86107f6a99fea0bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:32.169293 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-b3e86219-67a6-4aaf-927e-f90d78718965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:32.205136 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb131c-466a-46bd-bf38-8fbe309615ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:32.205972 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb131c-466a-46bd-bf38-8fbe309615ae service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:32.206703 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb131c-466a-46bd-bf38-8fbe309615ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:32.206703 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb131c-466a-46bd-bf38-8fbe309615ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:32.253875 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1127/2264] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:12:32.258863 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e86219-67a6-4aaf-927e-f90d78718965 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:32.292879 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb131c-466a-46bd-bf38-8fbe309615ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:32.292879 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb131c-466a-46bd-bf38-8fbe309615ae service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:32.303786 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1138/2265] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:12:32.354796 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e86219-67a6-4aaf-927e-f90d78718965 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:32.363007 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe1787-74da-4706-8030-b81e14b3729a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:32.363915 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe1787-74da-4706-8030-b81e14b3729a admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:32.364361 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe1787-74da-4706-8030-b81e14b3729a admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:32.364708 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe1787-74da-4706-8030-b81e14b3729a admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:32.365659 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe1787-74da-4706-8030-b81e14b3729a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:32.368172 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe1787-74da-4706-8030-b81e14b3729a admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:32.540267 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1128/2266] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:12:32 2022] POST /identity/v3/projects => generated 377 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:12:32.546021 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb131c-466a-46bd-bf38-8fbe309615ae service neutron] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:32.562825 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb131c-466a-46bd-bf38-8fbe309615ae service neutron] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:32.565618 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe1787-74da-4706-8030-b81e14b3729a admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:32.569528 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-13fe1787-74da-4706-8030-b81e14b3729a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:32.665252 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d5057-f6db-4933-aaca-bc07a28da340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:32.666002 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d5057-f6db-4933-aaca-bc07a28da340 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:32.666375 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d5057-f6db-4933-aaca-bc07a28da340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:32.666744 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d5057-f6db-4933-aaca-bc07a28da340 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:32.667595 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d5057-f6db-4933-aaca-bc07a28da340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:32.671472 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d5057-f6db-4933-aaca-bc07a28da340 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:32.709468 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe1787-74da-4706-8030-b81e14b3729a admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:32.714658 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de442c-65df-409c-8ff6-4bb1233cd659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:32.715357 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de442c-65df-409c-8ff6-4bb1233cd659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:32.716181 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de442c-65df-409c-8ff6-4bb1233cd659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:32.716450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de442c-65df-409c-8ff6-4bb1233cd659 admin admin] PATH_INFO: `/v3/projects/d786f7237f584935a1215fca5a1a8c9c` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:32.717638 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de442c-65df-409c-8ff6-4bb1233cd659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d786f7237f584935a1215fca5a1a8c9c)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:32.719620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de442c-65df-409c-8ff6-4bb1233cd659 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:32.807687 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1139/2267] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:12:32 2022] POST /identity/v3/users => generated 295 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:12:32.811639 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d5057-f6db-4933-aaca-bc07a28da340 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:32.830023 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d5057-f6db-4933-aaca-bc07a28da340 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:32.832462 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddf0c5-4549-4859-9f41-bb662e9badd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:32.834889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddf0c5-4549-4859-9f41-bb662e9badd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:32.834889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddf0c5-4549-4859-9f41-bb662e9badd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:32.834889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ddf0c5-4549-4859-9f41-bb662e9badd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:32.835213 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ddf0c5-4549-4859-9f41-bb662e9badd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:32.837192 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ddf0c5-4549-4859-9f41-bb662e9badd5 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:32.851908 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1140/2268] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:12:32.860647 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddf0c5-4549-4859-9f41-bb662e9badd5 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:32.862032 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-78de442c-65df-409c-8ff6-4bb1233cd659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd786f7237f584935a1215fca5a1a8c9c', 'request_id': 'req-78de442c-65df-409c-8ff6-4bb1233cd659'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:32.872313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ddf0c5-4549-4859-9f41-bb662e9badd5 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:32.876107 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-78de442c-65df-409c-8ff6-4bb1233cd659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd786f7237f584935a1215fca5a1a8c9c', 'request_id': 'req-78de442c-65df-409c-8ff6-4bb1233cd659'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:32.888428 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-78de442c-65df-409c-8ff6-4bb1233cd659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd786f7237f584935a1215fca5a1a8c9c', 'request_id': 'req-78de442c-65df-409c-8ff6-4bb1233cd659'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:32.932706 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:32.960882 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e128de-a494-4fbd-a12c-449c1f22659c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:32.961537 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e128de-a494-4fbd-a12c-449c1f22659c admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:32.961813 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e128de-a494-4fbd-a12c-449c1f22659c admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:32.962081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e128de-a494-4fbd-a12c-449c1f22659c admin admin] PATH_INFO: `/v3/projects/8dd30b72490d4c968079cc586f12a861/users/afec3823cbce4e7996ef2a2da2de78b9/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:32.979238 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e128de-a494-4fbd-a12c-449c1f22659c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dd30b72490d4c968079cc586f12a861, user_id=afec3823cbce4e7996ef2a2da2de78b9, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:32.982936 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e128de-a494-4fbd-a12c-449c1f22659c admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:32.994822 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-78de442c-65df-409c-8ff6-4bb1233cd659 admin admin] The token cache is being invalidate because project d786f7237f584935a1215fca5a1a8c9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:12:32.995014 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-78de442c-65df-409c-8ff6-4bb1233cd659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:32.995833 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-78de442c-65df-409c-8ff6-4bb1233cd659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:32.997505 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1129/2269] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:12:32 2022] DELETE /identity/v3/projects/d786f7237f584935a1215fca5a1a8c9c => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:33.002465 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de442c-65df-409c-8ff6-4bb1233cd659 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:33.003969 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-78de442c-65df-409c-8ff6-4bb1233cd659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:33.018341 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de442c-65df-409c-8ff6-4bb1233cd659 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:33.023498 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a91668-0cd3-4c81-b19f-726e6386fdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:33.024123 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a91668-0cd3-4c81-b19f-726e6386fdc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:33.024400 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a91668-0cd3-4c81-b19f-726e6386fdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:33.024671 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a91668-0cd3-4c81-b19f-726e6386fdc3 admin admin] PATH_INFO: `/v3/users/aed04b03d09a4103919a88a8d1881b85` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:33.025848 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a91668-0cd3-4c81-b19f-726e6386fdc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aed04b03d09a4103919a88a8d1881b85)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:33.027862 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a91668-0cd3-4c81-b19f-726e6386fdc3 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:33.139092 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:33.145985 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1141/2270] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:12:32 2022] PUT /identity/v3/projects/8dd30b72490d4c968079cc586f12a861/users/afec3823cbce4e7996ef2a2da2de78b9/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:33.149930 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e128de-a494-4fbd-a12c-449c1f22659c admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:33.151590 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-e3e128de-a494-4fbd-a12c-449c1f22659c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:33.227502 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e128de-a494-4fbd-a12c-449c1f22659c admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:33.232680 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c5cfb-cbb3-4a95-8d8a-96d3bcdd8e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:33.233647 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c5cfb-cbb3-4a95-8d8a-96d3bcdd8e2c admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:33.233942 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c5cfb-cbb3-4a95-8d8a-96d3bcdd8e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:33.234265 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9c5cfb-cbb3-4a95-8d8a-96d3bcdd8e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:33.234778 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c5cfb-cbb3-4a95-8d8a-96d3bcdd8e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:33.236446 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9c5cfb-cbb3-4a95-8d8a-96d3bcdd8e2c admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:33.254800 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1142/2271] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:33.256493 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c5cfb-cbb3-4a95-8d8a-96d3bcdd8e2c admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:33.274976 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9c5cfb-cbb3-4a95-8d8a-96d3bcdd8e2c admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:33.296245 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad887034-4bcd-4da4-8f1c-7612a1a378fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:33.297109 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad887034-4bcd-4da4-8f1c-7612a1a378fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:33.297417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad887034-4bcd-4da4-8f1c-7612a1a378fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:33.297682 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad887034-4bcd-4da4-8f1c-7612a1a378fc admin admin] PATH_INFO: `/v3/projects/8dd30b72490d4c968079cc586f12a861/users/afec3823cbce4e7996ef2a2da2de78b9/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:33.299989 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad887034-4bcd-4da4-8f1c-7612a1a378fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dd30b72490d4c968079cc586f12a861, user_id=afec3823cbce4e7996ef2a2da2de78b9, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:33.304394 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad887034-4bcd-4da4-8f1c-7612a1a378fc admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:33.316901 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1143/2272] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:12:33 2022] PUT /identity/v3/projects/8dd30b72490d4c968079cc586f12a861/users/afec3823cbce4e7996ef2a2da2de78b9/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:33.318055 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-c1a91668-0cd3-4c81-b19f-726e6386fdc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aed04b03d09a4103919a88a8d1881b85'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:33.318747 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-c1a91668-0cd3-4c81-b19f-726e6386fdc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aed04b03d09a4103919a88a8d1881b85'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:33.328827 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5b211-482d-4edf-b690-b127c4225e4a None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:33.332924 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-c1a91668-0cd3-4c81-b19f-726e6386fdc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aed04b03d09a4103919a88a8d1881b85'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:33.333298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5b211-482d-4edf-b690-b127c4225e4a None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:33.333298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5b211-482d-4edf-b690-b127c4225e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:33.333436 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-c1a91668-0cd3-4c81-b19f-726e6386fdc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aed04b03d09a4103919a88a8d1881b85'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:33.377626 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-6ea5b211-482d-4edf-b690-b127c4225e4a None None] MFA Rules not processed for user `afec3823cbce4e7996ef2a2da2de78b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:33.378901 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-6ea5b211-482d-4edf-b690-b127c4225e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:33.458385 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-c1a91668-0cd3-4c81-b19f-726e6386fdc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aed04b03d09a4103919a88a8d1881b85'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:33.485580 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1130/2273] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:12:33 2022] DELETE /identity/v3/users/aed04b03d09a4103919a88a8d1881b85 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:33.489128 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1144/2274] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:33.502746 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a91668-0cd3-4c81-b19f-726e6386fdc3 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:33.504597 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-c1a91668-0cd3-4c81-b19f-726e6386fdc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:33.588687 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a91668-0cd3-4c81-b19f-726e6386fdc3 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:33.602398 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578f44a-7c1c-4861-afdd-e974f94b0f62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:33.603736 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578f44a-7c1c-4861-afdd-e974f94b0f62 service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:33.604033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578f44a-7c1c-4861-afdd-e974f94b0f62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:33.604315 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578f44a-7c1c-4861-afdd-e974f94b0f62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:33.606662 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-9578f44a-7c1c-4861-afdd-e974f94b0f62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:33.688458 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578f44a-7c1c-4861-afdd-e974f94b0f62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:33.689966 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9578f44a-7c1c-4861-afdd-e974f94b0f62 service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:33.701226 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1131/2275] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:12:33.715334 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:33.875401 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:34.027317 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5b211-482d-4edf-b690-b127c4225e4a None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:34.030115 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-6ea5b211-482d-4edf-b690-b127c4225e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:34.135878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5b211-482d-4edf-b690-b127c4225e4a None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:34.211374 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb0030-acb6-4670-8795-21a83ee60717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:34.212047 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb0030-acb6-4670-8795-21a83ee60717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:34.212313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb0030-acb6-4670-8795-21a83ee60717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:34.212611 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb0030-acb6-4670-8795-21a83ee60717 admin admin] PATH_INFO: `/v3/projects/ecf78a890d3c4174ae744a7a9d7e60cf` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:34.213792 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb0030-acb6-4670-8795-21a83ee60717 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecf78a890d3c4174ae744a7a9d7e60cf)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:34.216413 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb0030-acb6-4670-8795-21a83ee60717 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:34.435435 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-97bb0030-acb6-4670-8795-21a83ee60717 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecf78a890d3c4174ae744a7a9d7e60cf', 'request_id': 'req-97bb0030-acb6-4670-8795-21a83ee60717'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:34.453084 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-97bb0030-acb6-4670-8795-21a83ee60717 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecf78a890d3c4174ae744a7a9d7e60cf', 'request_id': 'req-97bb0030-acb6-4670-8795-21a83ee60717'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:34.543524 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-97bb0030-acb6-4670-8795-21a83ee60717 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecf78a890d3c4174ae744a7a9d7e60cf', 'request_id': 'req-97bb0030-acb6-4670-8795-21a83ee60717'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:34.564121 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-97bb0030-acb6-4670-8795-21a83ee60717 admin admin] The token cache is being invalidate because project ecf78a890d3c4174ae744a7a9d7e60cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:12:34.564630 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-97bb0030-acb6-4670-8795-21a83ee60717 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:34.565651 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-97bb0030-acb6-4670-8795-21a83ee60717 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:34.567532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1145/2276] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:12:34 2022] DELETE /identity/v3/projects/ecf78a890d3c4174ae744a7a9d7e60cf => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:34.572680 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6102aa-c07f-43b4-abdd-348a26e56398 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:34.573215 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6102aa-c07f-43b4-abdd-348a26e56398 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:34.573215 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6102aa-c07f-43b4-abdd-348a26e56398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:34.598044 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-6f6102aa-c07f-43b4-abdd-348a26e56398 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:34.599737 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-6f6102aa-c07f-43b4-abdd-348a26e56398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:34.629174 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:34.680359 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1132/2277] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:12:34.689899 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086379f-1a8b-4b0e-b918-6fc03b4376b6 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:34.690187 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086379f-1a8b-4b0e-b918-6fc03b4376b6 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:34.690445 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a086379f-1a8b-4b0e-b918-6fc03b4376b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:34.712188 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-a086379f-1a8b-4b0e-b918-6fc03b4376b6 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:34.713437 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-a086379f-1a8b-4b0e-b918-6fc03b4376b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:34.722750 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1146/2278] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:34.727354 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6102aa-c07f-43b4-abdd-348a26e56398 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:34.740197 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6102aa-c07f-43b4-abdd-348a26e56398 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:34.745519 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd42e9-b385-418a-a2db-e948e3458e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:34.746141 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd42e9-b385-418a-a2db-e948e3458e7f admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:34.746416 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd42e9-b385-418a-a2db-e948e3458e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:34.746797 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd42e9-b385-418a-a2db-e948e3458e7f admin admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:34.748750 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd42e9-b385-418a-a2db-e948e3458e7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:12:34.749057 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd42e9-b385-418a-a2db-e948e3458e7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:34.750879 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bd42e9-b385-418a-a2db-e948e3458e7f admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:34.764677 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1133/2279] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:12:34.769590 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086379f-1a8b-4b0e-b918-6fc03b4376b6 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:34.780101 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a086379f-1a8b-4b0e-b918-6fc03b4376b6 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:34.785086 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143cde36-9f80-406d-ba62-64b992f45018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:34.785709 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143cde36-9f80-406d-ba62-64b992f45018 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:34.785990 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143cde36-9f80-406d-ba62-64b992f45018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:34.786359 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143cde36-9f80-406d-ba62-64b992f45018 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:34.787020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143cde36-9f80-406d-ba62-64b992f45018 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:34.789066 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143cde36-9f80-406d-ba62-64b992f45018 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:34.916383 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1147/2280] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:12:34 2022] POST /identity/v3/projects => generated 389 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:12:34.923966 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd42e9-b385-418a-a2db-e948e3458e7f admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:34.932386 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd42e9-b385-418a-a2db-e948e3458e7f admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:34.967017 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:34.991395 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f66da-a60a-4196-b81b-ab5ef5b45176 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:34.991771 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f66da-a60a-4196-b81b-ab5ef5b45176 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:34.992122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f66da-a60a-4196-b81b-ab5ef5b45176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:35.034984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-5f0f66da-a60a-4196-b81b-ab5ef5b45176 None None] MFA Rules not processed for user `14dcdf67d4d34156b1fa6dcd9571aa95`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:35.036410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-5f0f66da-a60a-4196-b81b-ab5ef5b45176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:35.065167 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6609ba-20d9-4011-8755-e7526b42a00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:35.066112 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6609ba-20d9-4011-8755-e7526b42a00f admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:35.066634 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6609ba-20d9-4011-8755-e7526b42a00f admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:35.067518 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6609ba-20d9-4011-8755-e7526b42a00f admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:35.068963 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6609ba-20d9-4011-8755-e7526b42a00f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:35.071588 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6609ba-20d9-4011-8755-e7526b42a00f admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:35.159262 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1148/2281] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:35.161354 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f66da-a60a-4196-b81b-ab5ef5b45176 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:35.163075 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-5f0f66da-a60a-4196-b81b-ab5ef5b45176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:35.178889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f66da-a60a-4196-b81b-ab5ef5b45176 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:35.188344 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8576e-db89-4cc4-8d1c-350f9226a55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:35.188344 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8576e-db89-4cc4-8d1c-350f9226a55b admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:35.188344 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8576e-db89-4cc4-8d1c-350f9226a55b admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:35.190265 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8576e-db89-4cc4-8d1c-350f9226a55b admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:35.191078 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8576e-db89-4cc4-8d1c-350f9226a55b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:35.193316 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8576e-db89-4cc4-8d1c-350f9226a55b admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:35.248468 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1134/2282] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:12:34 2022] POST /identity/v3/users => generated 295 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:12:35.249503 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6609ba-20d9-4011-8755-e7526b42a00f admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:35.266979 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6609ba-20d9-4011-8755-e7526b42a00f admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:35.275231 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81300e9f-3a3f-435a-863f-fa091f2d93a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:35.275882 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81300e9f-3a3f-435a-863f-fa091f2d93a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:35.276238 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81300e9f-3a3f-435a-863f-fa091f2d93a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:35.276706 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81300e9f-3a3f-435a-863f-fa091f2d93a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:35.277437 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81300e9f-3a3f-435a-863f-fa091f2d93a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:35.279870 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81300e9f-3a3f-435a-863f-fa091f2d93a3 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:35.294513 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1135/2283] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:35.298614 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81300e9f-3a3f-435a-863f-fa091f2d93a3 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:35.310342 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81300e9f-3a3f-435a-863f-fa091f2d93a3 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:35.320210 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa77be-855a-474a-836c-766e5b79e0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:35.320528 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa77be-855a-474a-836c-766e5b79e0ac admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:35.321055 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa77be-855a-474a-836c-766e5b79e0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:35.321433 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa77be-855a-474a-836c-766e5b79e0ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:35.322487 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa77be-855a-474a-836c-766e5b79e0ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:35.323209 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1149/2284] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:12:35 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:12:35.328699 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa77be-855a-474a-836c-766e5b79e0ac admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:35.336627 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8576e-db89-4cc4-8d1c-350f9226a55b admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:35.345882 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1136/2285] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:35.350302 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa77be-855a-474a-836c-766e5b79e0ac admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:35.370499 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa77be-855a-474a-836c-766e5b79e0ac admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:35.431660 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8576e-db89-4cc4-8d1c-350f9226a55b admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:35.439293 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298fd54-3ba2-4039-9184-5bb4d136721b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:35.447018 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298fd54-3ba2-4039-9184-5bb4d136721b admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:35.447018 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298fd54-3ba2-4039-9184-5bb4d136721b admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:35.447018 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298fd54-3ba2-4039-9184-5bb4d136721b admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:35.447018 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298fd54-3ba2-4039-9184-5bb4d136721b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:35.447018 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3298fd54-3ba2-4039-9184-5bb4d136721b admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:35.454424 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35eccc0-cec6-4656-9463-bd66968622ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:35.455248 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35eccc0-cec6-4656-9463-bd66968622ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:35.455993 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35eccc0-cec6-4656-9463-bd66968622ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:35.458017 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35eccc0-cec6-4656-9463-bd66968622ca admin admin] PATH_INFO: `/v3/projects/bd93a999aa9d49c587e2a4040cb67529/users/8d4d68beaa1c437fa60f38aa1293dd10/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:35.489003 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35eccc0-cec6-4656-9463-bd66968622ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd93a999aa9d49c587e2a4040cb67529, user_id=8d4d68beaa1c437fa60f38aa1293dd10, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:35.503003 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35eccc0-cec6-4656-9463-bd66968622ca admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:35.537779 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:35.546196 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1150/2286] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:12:35 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:12:35.550475 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298fd54-3ba2-4039-9184-5bb4d136721b admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:35.561566 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298fd54-3ba2-4039-9184-5bb4d136721b admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:35.567250 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852b55e-28a5-4b05-90f5-23f4f017d8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:35.568012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852b55e-28a5-4b05-90f5-23f4f017d8e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:35.568296 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852b55e-28a5-4b05-90f5-23f4f017d8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:35.568653 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852b55e-28a5-4b05-90f5-23f4f017d8e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:35.569339 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852b55e-28a5-4b05-90f5-23f4f017d8e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:35.572051 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852b55e-28a5-4b05-90f5-23f4f017d8e8 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:35.584272 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1151/2287] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:12:35.594533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852b55e-28a5-4b05-90f5-23f4f017d8e8 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:35.600835 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852b55e-28a5-4b05-90f5-23f4f017d8e8 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:35.607432 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1137/2288] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:12:35 2022] PUT /identity/v3/projects/bd93a999aa9d49c587e2a4040cb67529/users/8d4d68beaa1c437fa60f38aa1293dd10/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:35.618960 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df497a2b-14c4-4d96-84ee-5521c2a0544f None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:35.619247 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df497a2b-14c4-4d96-84ee-5521c2a0544f None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:35.619525 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df497a2b-14c4-4d96-84ee-5521c2a0544f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:35.657169 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-df497a2b-14c4-4d96-84ee-5521c2a0544f None None] MFA Rules not processed for user `8d4d68beaa1c437fa60f38aa1293dd10`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:35.658450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-df497a2b-14c4-4d96-84ee-5521c2a0544f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:35.687936 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b7676-bfef-4c28-93af-ad5e52615faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:35.688721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b7676-bfef-4c28-93af-ad5e52615faa admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:35.689090 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b7676-bfef-4c28-93af-ad5e52615faa admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:35.689480 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089b7676-bfef-4c28-93af-ad5e52615faa admin admin] PATH_INFO: `/v3/projects/57affd7bc716407d8134b1c7d6bd1963/users/55d3c39383194941a41852f160e9dde4/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:35.716871 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b7676-bfef-4c28-93af-ad5e52615faa admin admin] RBAC: Authorizing `identity:create_grant(project_id=57affd7bc716407d8134b1c7d6bd1963, user_id=55d3c39383194941a41852f160e9dde4, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:35.720398 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089b7676-bfef-4c28-93af-ad5e52615faa admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:35.744984 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1138/2289] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:35 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:12:35.750660 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df497a2b-14c4-4d96-84ee-5521c2a0544f None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:35.769703 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df497a2b-14c4-4d96-84ee-5521c2a0544f None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:35.775646 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69c81b-2759-40ee-9346-36a00aa866d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:35.776616 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69c81b-2759-40ee-9346-36a00aa866d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:35.776925 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69c81b-2759-40ee-9346-36a00aa866d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:35.777818 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69c81b-2759-40ee-9346-36a00aa866d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:35.779311 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69c81b-2759-40ee-9346-36a00aa866d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:35.782416 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69c81b-2759-40ee-9346-36a00aa866d1 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:35.794742 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1152/2290] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:12:35 2022] PUT /identity/v3/projects/57affd7bc716407d8134b1c7d6bd1963/users/55d3c39383194941a41852f160e9dde4/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:35.800363 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b7676-bfef-4c28-93af-ad5e52615faa admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:35.876689 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1139/2291] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:12:35 2022] POST /identity/v3/projects => generated 389 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:12:35.877204 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69c81b-2759-40ee-9346-36a00aa866d1 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:35.880394 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-aa69c81b-2759-40ee-9346-36a00aa866d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:35.905394 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089b7676-bfef-4c28-93af-ad5e52615faa admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:35.954022 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69c81b-2759-40ee-9346-36a00aa866d1 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:35.957933 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e772d-c0ff-429f-baef-880fdf7c904a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:35.958622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e772d-c0ff-429f-baef-880fdf7c904a service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:35.958909 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e772d-c0ff-429f-baef-880fdf7c904a service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:35.959211 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e772d-c0ff-429f-baef-880fdf7c904a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:35.961136 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-bc4e772d-c0ff-429f-baef-880fdf7c904a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:35.982171 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11be647-4667-4b55-bc45-bb64942f21fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:35.983198 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11be647-4667-4b55-bc45-bb64942f21fb admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:35.983198 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11be647-4667-4b55-bc45-bb64942f21fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:35.983198 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11be647-4667-4b55-bc45-bb64942f21fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:35.983803 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11be647-4667-4b55-bc45-bb64942f21fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:35.985418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11be647-4667-4b55-bc45-bb64942f21fb admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:35.999666 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1153/2292] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:35.999666 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11be647-4667-4b55-bc45-bb64942f21fb admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:36.010065 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11be647-4667-4b55-bc45-bb64942f21fb admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:36.015244 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a33f2-4ada-4dd1-b35f-0f89855e6800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:36.016675 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a33f2-4ada-4dd1-b35f-0f89855e6800 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:36.016675 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a33f2-4ada-4dd1-b35f-0f89855e6800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:36.016675 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a33f2-4ada-4dd1-b35f-0f89855e6800 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:36.021992 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a33f2-4ada-4dd1-b35f-0f89855e6800 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:36.021992 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a33f2-4ada-4dd1-b35f-0f89855e6800 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:36.035995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e772d-c0ff-429f-baef-880fdf7c904a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:36.037471 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e772d-c0ff-429f-baef-880fdf7c904a service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:36.048531 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1140/2293] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:12:36.050137 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165aba2-8aa1-4780-bba4-e5856150d1bc None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:36.050419 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165aba2-8aa1-4780-bba4-e5856150d1bc None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:36.050690 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5165aba2-8aa1-4780-bba4-e5856150d1bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:36.072453 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-5165aba2-8aa1-4780-bba4-e5856150d1bc None None] MFA Rules not processed for user `3659772c227a4a179d30340e9573d556`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:36.073841 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-5165aba2-8aa1-4780-bba4-e5856150d1bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:36.122526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1154/2294] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:12:35 2022] POST /identity/v3/users => generated 301 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:12:36.130686 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a33f2-4ada-4dd1-b35f-0f89855e6800 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:36.141762 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a33f2-4ada-4dd1-b35f-0f89855e6800 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:36.147010 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6b87a-9cee-4799-81bd-27ab9a569fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:36.154036 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6b87a-9cee-4799-81bd-27ab9a569fd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:36.154036 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6b87a-9cee-4799-81bd-27ab9a569fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:36.154036 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a6b87a-9cee-4799-81bd-27ab9a569fd5 admin admin] PATH_INFO: `/v3/projects/57affd7bc716407d8134b1c7d6bd1963/users/55d3c39383194941a41852f160e9dde4/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:36.154036 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6b87a-9cee-4799-81bd-27ab9a569fd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57affd7bc716407d8134b1c7d6bd1963, user_id=55d3c39383194941a41852f160e9dde4, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:36.154427 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1141/2295] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:36.154532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a6b87a-9cee-4799-81bd-27ab9a569fd5 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:36.158153 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165aba2-8aa1-4780-bba4-e5856150d1bc None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:36.167412 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1155/2296] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:12:36 2022] PUT /identity/v3/projects/57affd7bc716407d8134b1c7d6bd1963/users/55d3c39383194941a41852f160e9dde4/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:36.177803 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5165aba2-8aa1-4780-bba4-e5856150d1bc None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:36.241654 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:36.252004 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7b8c0-5217-458f-a146-2e6098ff600e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:36.252850 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7b8c0-5217-458f-a146-2e6098ff600e admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:36.253605 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7b8c0-5217-458f-a146-2e6098ff600e admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:36.254068 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd7b8c0-5217-458f-a146-2e6098ff600e admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:36.254899 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7b8c0-5217-458f-a146-2e6098ff600e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:36.257036 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd7b8c0-5217-458f-a146-2e6098ff600e admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:36.269555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1142/2297] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:36.282482 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6b87a-9cee-4799-81bd-27ab9a569fd5 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:36.298973 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a6b87a-9cee-4799-81bd-27ab9a569fd5 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:36.305635 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d741e5-29bb-4889-b0df-c1beb9296e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:36.306579 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d741e5-29bb-4889-b0df-c1beb9296e63 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:36.306579 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d741e5-29bb-4889-b0df-c1beb9296e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:36.306875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d741e5-29bb-4889-b0df-c1beb9296e63 admin admin] PATH_INFO: `/v3/projects/b7df80a3cf3f4d08a8eb00b02ff9668e/users/79ca8742058a4db7b284997e7f54cbb5/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:36.329730 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d741e5-29bb-4889-b0df-c1beb9296e63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7df80a3cf3f4d08a8eb00b02ff9668e, user_id=79ca8742058a4db7b284997e7f54cbb5, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:36.333604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d741e5-29bb-4889-b0df-c1beb9296e63 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:36.344204 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:36.504137 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1156/2298] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:12:36 2022] PUT /identity/v3/projects/b7df80a3cf3f4d08a8eb00b02ff9668e/users/79ca8742058a4db7b284997e7f54cbb5/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:12:36.508464 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7b8c0-5217-458f-a146-2e6098ff600e admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:36.521130 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd7b8c0-5217-458f-a146-2e6098ff600e admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:36.602109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbbb52-5ca8-45cf-9083-3e1d75069605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:36.602724 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbbb52-5ca8-45cf-9083-3e1d75069605 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:36.603001 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbbb52-5ca8-45cf-9083-3e1d75069605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:36.603307 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbbb52-5ca8-45cf-9083-3e1d75069605 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:36.604247 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dbbb52-5ca8-45cf-9083-3e1d75069605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:36.607632 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dbbb52-5ca8-45cf-9083-3e1d75069605 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:36.628719 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1143/2299] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:36.630180 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d741e5-29bb-4889-b0df-c1beb9296e63 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:36.661180 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d741e5-29bb-4889-b0df-c1beb9296e63 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:36.667897 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f691c00-0919-4614-9565-1ad941c18425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:36.669463 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f691c00-0919-4614-9565-1ad941c18425 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:36.669947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f691c00-0919-4614-9565-1ad941c18425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:36.670364 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f691c00-0919-4614-9565-1ad941c18425 admin admin] PATH_INFO: `/v3/projects/b7df80a3cf3f4d08a8eb00b02ff9668e/users/79ca8742058a4db7b284997e7f54cbb5/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:36.672766 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f691c00-0919-4614-9565-1ad941c18425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7df80a3cf3f4d08a8eb00b02ff9668e, user_id=79ca8742058a4db7b284997e7f54cbb5, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:36.677159 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f691c00-0919-4614-9565-1ad941c18425 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:36.690213 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1157/2300] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:12:36 2022] PUT /identity/v3/projects/b7df80a3cf3f4d08a8eb00b02ff9668e/users/79ca8742058a4db7b284997e7f54cbb5/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:36.702029 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91150b52-95ea-45f0-85e7-05e751f6a5e0 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:36.702398 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91150b52-95ea-45f0-85e7-05e751f6a5e0 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:36.702751 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91150b52-95ea-45f0-85e7-05e751f6a5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:36.754219 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-91150b52-95ea-45f0-85e7-05e751f6a5e0 None None] MFA Rules not processed for user `79ca8742058a4db7b284997e7f54cbb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:36.755618 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-91150b52-95ea-45f0-85e7-05e751f6a5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:36.846618 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1144/2301] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:36 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:12:36.854811 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f691c00-0919-4614-9565-1ad941c18425 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:36.860664 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:36.864168 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-0f691c00-0919-4614-9565-1ad941c18425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:37.032501 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f691c00-0919-4614-9565-1ad941c18425 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:37.038005 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af11c45-40b5-42bf-817b-cf8df459370a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:37.038615 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af11c45-40b5-42bf-817b-cf8df459370a service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:37.039313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af11c45-40b5-42bf-817b-cf8df459370a service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:37.039313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af11c45-40b5-42bf-817b-cf8df459370a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:37.058573 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af11c45-40b5-42bf-817b-cf8df459370a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:37.065624 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af11c45-40b5-42bf-817b-cf8df459370a service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:37.085500 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1158/2302] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:36 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:12:37.240100 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91150b52-95ea-45f0-85e7-05e751f6a5e0 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:37.351022 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91150b52-95ea-45f0-85e7-05e751f6a5e0 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:37.373146 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e4773-c7f8-4d9f-9d73-6f8c3cc45808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:37.373956 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e4773-c7f8-4d9f-9d73-6f8c3cc45808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:37.374318 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e4773-c7f8-4d9f-9d73-6f8c3cc45808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:37.374595 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e4773-c7f8-4d9f-9d73-6f8c3cc45808 admin admin] PATH_INFO: `/v3/users/8d4d68beaa1c437fa60f38aa1293dd10` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:37.376282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e4773-c7f8-4d9f-9d73-6f8c3cc45808 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d4d68beaa1c437fa60f38aa1293dd10)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:37.383415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e4773-c7f8-4d9f-9d73-6f8c3cc45808 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:37.681191 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-938e4773-c7f8-4d9f-9d73-6f8c3cc45808 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d4d68beaa1c437fa60f38aa1293dd10'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:37.683975 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-938e4773-c7f8-4d9f-9d73-6f8c3cc45808 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d4d68beaa1c437fa60f38aa1293dd10'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:37.697845 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-938e4773-c7f8-4d9f-9d73-6f8c3cc45808 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d4d68beaa1c437fa60f38aa1293dd10'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:37.697997 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:37.699036 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-938e4773-c7f8-4d9f-9d73-6f8c3cc45808 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d4d68beaa1c437fa60f38aa1293dd10'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:37.802321 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-938e4773-c7f8-4d9f-9d73-6f8c3cc45808 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d4d68beaa1c437fa60f38aa1293dd10'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:37.850796 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1145/2303] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:12:37 2022] DELETE /identity/v3/users/8d4d68beaa1c437fa60f38aa1293dd10 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:37.861915 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25daa3-c970-4b03-bfee-94624abc3c1b None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:37.861915 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25daa3-c970-4b03-bfee-94624abc3c1b None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:37.861915 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25daa3-c970-4b03-bfee-94624abc3c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:37.912410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-1f25daa3-c970-4b03-bfee-94624abc3c1b None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:37.913888 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-1f25daa3-c970-4b03-bfee-94624abc3c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:37.994087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b2f57-dbd6-4386-b9b2-9e6b7dd23d3f None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:37.995235 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b2f57-dbd6-4386-b9b2-9e6b7dd23d3f None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:37.995741 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b2f57-dbd6-4386-b9b2-9e6b7dd23d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:38.058225 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-0c1b2f57-dbd6-4386-b9b2-9e6b7dd23d3f None None] MFA Rules not processed for user `55d3c39383194941a41852f160e9dde4`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:38.061648 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-0c1b2f57-dbd6-4386-b9b2-9e6b7dd23d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:38.071844 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1159/2304] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:38.093978 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25daa3-c970-4b03-bfee-94624abc3c1b None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:38.097723 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-1f25daa3-c970-4b03-bfee-94624abc3c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:38.189119 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25daa3-c970-4b03-bfee-94624abc3c1b None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:38.194494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbf668-ce1c-48da-b645-25f5ff980961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:38.196302 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbf668-ce1c-48da-b645-25f5ff980961 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:38.196584 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbf668-ce1c-48da-b645-25f5ff980961 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:38.196842 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbf668-ce1c-48da-b645-25f5ff980961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:38.219557 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbf668-ce1c-48da-b645-25f5ff980961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:38.232801 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbbf668-ce1c-48da-b645-25f5ff980961 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:38.268237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1160/2305] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:12:38.280180 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1146/2306] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:38.282643 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbf668-ce1c-48da-b645-25f5ff980961 service neutron] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:38.285128 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-0cbbf668-ce1c-48da-b645-25f5ff980961 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:38.291681 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e68dd1-1e23-4fe6-836d-8c7995c410e1 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:38.292040 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e68dd1-1e23-4fe6-836d-8c7995c410e1 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:38.293190 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e68dd1-1e23-4fe6-836d-8c7995c410e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:38.329531 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-49e68dd1-1e23-4fe6-836d-8c7995c410e1 None None] MFA Rules not processed for user `14dcdf67d4d34156b1fa6dcd9571aa95`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:38.330802 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-49e68dd1-1e23-4fe6-836d-8c7995c410e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:38.361165 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbf668-ce1c-48da-b645-25f5ff980961 service neutron] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:38.367243 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94a7d7-9863-4422-88fa-88ac334d8e28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:38.367793 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94a7d7-9863-4422-88fa-88ac334d8e28 service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:38.368067 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94a7d7-9863-4422-88fa-88ac334d8e28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:38.372314 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94a7d7-9863-4422-88fa-88ac334d8e28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:38.377385 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-9d94a7d7-9863-4422-88fa-88ac334d8e28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:38.451353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1147/2307] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:38.485930 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94a7d7-9863-4422-88fa-88ac334d8e28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:38.490218 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94a7d7-9863-4422-88fa-88ac334d8e28 service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:38.508558 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1161/2308] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:38 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:12:38.544298 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e68dd1-1e23-4fe6-836d-8c7995c410e1 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:38.547002 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-49e68dd1-1e23-4fe6-836d-8c7995c410e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:38.613855 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:38.675895 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e68dd1-1e23-4fe6-836d-8c7995c410e1 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:38.689211 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7edfe-870f-4cf6-809d-791f3d638196 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:38.690907 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7edfe-870f-4cf6-809d-791f3d638196 service nova] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:38.691395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7edfe-870f-4cf6-809d-791f3d638196 service nova] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:38.692263 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7edfe-870f-4cf6-809d-791f3d638196 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:38.694939 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-0cc7edfe-870f-4cf6-809d-791f3d638196 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:38.708776 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7edfe-870f-4cf6-809d-791f3d638196 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:38.711453 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7edfe-870f-4cf6-809d-791f3d638196 service nova] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:38.726805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1148/2309] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:12:39.312934 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94a7d7-9863-4422-88fa-88ac334d8e28 service cinder] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:39.314987 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-9d94a7d7-9863-4422-88fa-88ac334d8e28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:39.345695 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94a7d7-9863-4422-88fa-88ac334d8e28 service cinder] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:39.354371 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0df5b9-a277-49d6-8c16-c891895674b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:39.357525 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0df5b9-a277-49d6-8c16-c891895674b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:39.358049 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0df5b9-a277-49d6-8c16-c891895674b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:39.358618 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0df5b9-a277-49d6-8c16-c891895674b1 admin admin] PATH_INFO: `/v3/projects/bd93a999aa9d49c587e2a4040cb67529` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:39.363553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0df5b9-a277-49d6-8c16-c891895674b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd93a999aa9d49c587e2a4040cb67529)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:39.383664 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0df5b9-a277-49d6-8c16-c891895674b1 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:39.412868 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:39.562642 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-ee0df5b9-a277-49d6-8c16-c891895674b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd93a999aa9d49c587e2a4040cb67529', 'request_id': 'req-ee0df5b9-a277-49d6-8c16-c891895674b1'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:39.569209 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-ee0df5b9-a277-49d6-8c16-c891895674b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd93a999aa9d49c587e2a4040cb67529', 'request_id': 'req-ee0df5b9-a277-49d6-8c16-c891895674b1'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:39.714871 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-ee0df5b9-a277-49d6-8c16-c891895674b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd93a999aa9d49c587e2a4040cb67529', 'request_id': 'req-ee0df5b9-a277-49d6-8c16-c891895674b1'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:39.737968 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-ee0df5b9-a277-49d6-8c16-c891895674b1 admin admin] The token cache is being invalidate because project bd93a999aa9d49c587e2a4040cb67529 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:12:39.738292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-ee0df5b9-a277-49d6-8c16-c891895674b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:39.747945 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-ee0df5b9-a277-49d6-8c16-c891895674b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:39.752753 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1162/2310] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:12:39 2022] DELETE /identity/v3/projects/bd93a999aa9d49c587e2a4040cb67529 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:39.754509 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7edfe-870f-4cf6-809d-791f3d638196 service nova] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:39.775940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7edfe-870f-4cf6-809d-791f3d638196 service nova] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:39.944872 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d21439-03bd-40ff-b171-407cb370c327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:39.946050 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d21439-03bd-40ff-b171-407cb370c327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:39.946549 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d21439-03bd-40ff-b171-407cb370c327 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:39.947047 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d21439-03bd-40ff-b171-407cb370c327 admin admin] PATH_INFO: `/v3/users/79ca8742058a4db7b284997e7f54cbb5` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:39.951438 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d21439-03bd-40ff-b171-407cb370c327 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79ca8742058a4db7b284997e7f54cbb5)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:39.954535 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d21439-03bd-40ff-b171-407cb370c327 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:40.451484 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-b6d21439-03bd-40ff-b171-407cb370c327 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79ca8742058a4db7b284997e7f54cbb5'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:40.452318 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-b6d21439-03bd-40ff-b171-407cb370c327 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79ca8742058a4db7b284997e7f54cbb5'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:40.470196 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-b6d21439-03bd-40ff-b171-407cb370c327 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79ca8742058a4db7b284997e7f54cbb5'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:40.474747 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-b6d21439-03bd-40ff-b171-407cb370c327 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79ca8742058a4db7b284997e7f54cbb5'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:40.535503 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:40.556900 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-b6d21439-03bd-40ff-b171-407cb370c327 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79ca8742058a4db7b284997e7f54cbb5'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:40.606160 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1149/2311] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:12:39 2022] DELETE /identity/v3/users/79ca8742058a4db7b284997e7f54cbb5 => generated 0 bytes in 852 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:41.112402 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2172bd-0364-4e38-914c-4b1e57a5c190 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:41.113344 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2172bd-0364-4e38-914c-4b1e57a5c190 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:41.113824 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2172bd-0364-4e38-914c-4b1e57a5c190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:41.152551 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-7c2172bd-0364-4e38-914c-4b1e57a5c190 None None] MFA Rules not processed for user `ae9fc5f06a0441da80e656fa1e88db5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:41.154617 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-7c2172bd-0364-4e38-914c-4b1e57a5c190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:41.254295 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1163/2312] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Aug 24 17:12:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:41.316745 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d21439-03bd-40ff-b171-407cb370c327 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:41.318267 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-b6d21439-03bd-40ff-b171-407cb370c327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:41.411495 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d21439-03bd-40ff-b171-407cb370c327 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:41.417689 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea6091-65b2-4b19-925d-a182dde37262 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c067bc2d84b741d08ac47e40adae4b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:41.419381 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea6091-65b2-4b19-925d-a182dde37262 service swift] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:41.419834 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea6091-65b2-4b19-925d-a182dde37262 service swift] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:41.420262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea6091-65b2-4b19-925d-a182dde37262 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:41.447243 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea6091-65b2-4b19-925d-a182dde37262 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:41.447243 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea6091-65b2-4b19-925d-a182dde37262 service swift] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:41.463340 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1150/2313] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Aug 24 17:12:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:12:41.594896 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2172bd-0364-4e38-914c-4b1e57a5c190 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:41.597733 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-7c2172bd-0364-4e38-914c-4b1e57a5c190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:41.812438 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2172bd-0364-4e38-914c-4b1e57a5c190 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:41.828070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb69b83-b4d6-4399-a1b1-e7edd8a45d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:41.828070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb69b83-b4d6-4399-a1b1-e7edd8a45d08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:41.828070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb69b83-b4d6-4399-a1b1-e7edd8a45d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:41.828831 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb69b83-b4d6-4399-a1b1-e7edd8a45d08 admin admin] PATH_INFO: `/v3/projects/b7df80a3cf3f4d08a8eb00b02ff9668e` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:41.830772 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb69b83-b4d6-4399-a1b1-e7edd8a45d08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7df80a3cf3f4d08a8eb00b02ff9668e)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:41.833007 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb69b83-b4d6-4399-a1b1-e7edd8a45d08 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:41.987676 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:42.056037 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0eb69b83-b4d6-4399-a1b1-e7edd8a45d08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7df80a3cf3f4d08a8eb00b02ff9668e', 'request_id': 'req-0eb69b83-b4d6-4399-a1b1-e7edd8a45d08'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:42.075595 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0eb69b83-b4d6-4399-a1b1-e7edd8a45d08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7df80a3cf3f4d08a8eb00b02ff9668e', 'request_id': 'req-0eb69b83-b4d6-4399-a1b1-e7edd8a45d08'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:42.212299 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0eb69b83-b4d6-4399-a1b1-e7edd8a45d08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7df80a3cf3f4d08a8eb00b02ff9668e', 'request_id': 'req-0eb69b83-b4d6-4399-a1b1-e7edd8a45d08'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:42.238163 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0eb69b83-b4d6-4399-a1b1-e7edd8a45d08 admin admin] The token cache is being invalidate because project b7df80a3cf3f4d08a8eb00b02ff9668e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:12:42.238510 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0eb69b83-b4d6-4399-a1b1-e7edd8a45d08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:42.239231 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0eb69b83-b4d6-4399-a1b1-e7edd8a45d08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:42.240900 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1164/2314] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:12:41 2022] DELETE /identity/v3/projects/b7df80a3cf3f4d08a8eb00b02ff9668e => generated 0 bytes in 647 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:42.245754 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dfec2-467f-4ca6-bb1a-b70d234b6f36 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:42.246168 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dfec2-467f-4ca6-bb1a-b70d234b6f36 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:42.246513 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12dfec2-467f-4ca6-bb1a-b70d234b6f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:42.270371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-e12dfec2-467f-4ca6-bb1a-b70d234b6f36 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:42.271845 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-e12dfec2-467f-4ca6-bb1a-b70d234b6f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:42.347644 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1151/2315] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:42.355794 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9dfcc1-45dd-4f87-ab33-b0cfafc53887 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:42.356366 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9dfcc1-45dd-4f87-ab33-b0cfafc53887 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:42.357618 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9dfcc1-45dd-4f87-ab33-b0cfafc53887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:42.385288 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-fa9dfcc1-45dd-4f87-ab33-b0cfafc53887 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:42.386987 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-fa9dfcc1-45dd-4f87-ab33-b0cfafc53887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:42.397254 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1165/2316] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:42.404171 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12dfec2-467f-4ca6-bb1a-b70d234b6f36 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:42.418905 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12dfec2-467f-4ca6-bb1a-b70d234b6f36 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:42.426522 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2022c6-182d-4a0e-938a-9dc15fc287bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:42.427695 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2022c6-182d-4a0e-938a-9dc15fc287bb admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:42.428194 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2022c6-182d-4a0e-938a-9dc15fc287bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:42.429047 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2022c6-182d-4a0e-938a-9dc15fc287bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:42.430193 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2022c6-182d-4a0e-938a-9dc15fc287bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:12:42.430726 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2022c6-182d-4a0e-938a-9dc15fc287bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:42.432904 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2022c6-182d-4a0e-938a-9dc15fc287bb admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:42.482319 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1152/2317] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:12:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:12:42.487022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9dfcc1-45dd-4f87-ab33-b0cfafc53887 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:42.508591 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9dfcc1-45dd-4f87-ab33-b0cfafc53887 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:42.517438 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11a66e-04d0-456f-bae3-f82eb603a3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:42.518882 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11a66e-04d0-456f-bae3-f82eb603a3bf admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:42.519306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11a66e-04d0-456f-bae3-f82eb603a3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:42.519581 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11a66e-04d0-456f-bae3-f82eb603a3bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:42.521252 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae11a66e-04d0-456f-bae3-f82eb603a3bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:42.523241 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae11a66e-04d0-456f-bae3-f82eb603a3bf admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:42.623704 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1166/2318] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:12:42 2022] POST /identity/v3/projects => generated 379 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:12:42.629240 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2022c6-182d-4a0e-938a-9dc15fc287bb admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:42.647875 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2022c6-182d-4a0e-938a-9dc15fc287bb admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:42.911999 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700f666-e726-4382-8c87-8f330c4a26d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:42.912843 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700f666-e726-4382-8c87-8f330c4a26d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:42.914649 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700f666-e726-4382-8c87-8f330c4a26d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:42.916636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700f666-e726-4382-8c87-8f330c4a26d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:42.921103 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700f666-e726-4382-8c87-8f330c4a26d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:42.928931 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700f666-e726-4382-8c87-8f330c4a26d4 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:43.686783 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:43.742724 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1153/2319] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:12:42 2022] POST /identity/v3/users => generated 290 bytes in 1115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:12:43.747570 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11a66e-04d0-456f-bae3-f82eb603a3bf admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:43.806496 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae11a66e-04d0-456f-bae3-f82eb603a3bf admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:43.823623 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f7d5f-f462-4e27-8be8-9e92e0962a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:43.824390 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f7d5f-f462-4e27-8be8-9e92e0962a99 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:43.824835 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f7d5f-f462-4e27-8be8-9e92e0962a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:43.825203 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717f7d5f-f462-4e27-8be8-9e92e0962a99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:43.825975 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f7d5f-f462-4e27-8be8-9e92e0962a99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:43.829057 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717f7d5f-f462-4e27-8be8-9e92e0962a99 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:43.846617 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1167/2320] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:43.853393 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700f666-e726-4382-8c87-8f330c4a26d4 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:43.888882 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700f666-e726-4382-8c87-8f330c4a26d4 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:43.897008 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3848d3-492b-46d0-bb97-c1ea88584beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:43.898049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3848d3-492b-46d0-bb97-c1ea88584beb admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:43.898566 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3848d3-492b-46d0-bb97-c1ea88584beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:43.899601 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3848d3-492b-46d0-bb97-c1ea88584beb admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:43.906184 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3848d3-492b-46d0-bb97-c1ea88584beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:43.906184 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3848d3-492b-46d0-bb97-c1ea88584beb admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:43.932756 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1154/2321] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:43 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:43.938606 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f7d5f-f462-4e27-8be8-9e92e0962a99 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:43.961066 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717f7d5f-f462-4e27-8be8-9e92e0962a99 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:43.968105 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f7741-95f3-447c-9a19-97e04d275e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:43.970881 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f7741-95f3-447c-9a19-97e04d275e7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:43.971214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f7741-95f3-447c-9a19-97e04d275e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:43.972110 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2f7741-95f3-447c-9a19-97e04d275e7a admin admin] PATH_INFO: `/v3/projects/c4748cdf923743e6be3c8d4599ae3fd7/users/c5f8b993305247a9be072d5d1def4abe/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:43.995861 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f7741-95f3-447c-9a19-97e04d275e7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4748cdf923743e6be3c8d4599ae3fd7, user_id=c5f8b993305247a9be072d5d1def4abe, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:44.000331 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2f7741-95f3-447c-9a19-97e04d275e7a admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:44.162518 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1168/2322] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:12:43 2022] PUT /identity/v3/projects/c4748cdf923743e6be3c8d4599ae3fd7/users/c5f8b993305247a9be072d5d1def4abe/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:44.173462 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ea891-2d56-4249-a2e5-1956a9f69bf5 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:44.173809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ea891-2d56-4249-a2e5-1956a9f69bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:44.174127 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ea891-2d56-4249-a2e5-1956a9f69bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:44.247638 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-9d9ea891-2d56-4249-a2e5-1956a9f69bf5 None None] MFA Rules not processed for user `c5f8b993305247a9be072d5d1def4abe`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:44.249651 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-9d9ea891-2d56-4249-a2e5-1956a9f69bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:44.430362 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1155/2323] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:44.435152 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f7741-95f3-447c-9a19-97e04d275e7a admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:44.538344 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2f7741-95f3-447c-9a19-97e04d275e7a admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:44.550070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f3558-1cd8-4604-b3d2-3ce503c78ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:44.561610 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f3558-1cd8-4604-b3d2-3ce503c78ac7 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:44.562911 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f3558-1cd8-4604-b3d2-3ce503c78ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:44.563668 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f3558-1cd8-4604-b3d2-3ce503c78ac7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:44.566102 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f3558-1cd8-4604-b3d2-3ce503c78ac7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:44.572540 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f3558-1cd8-4604-b3d2-3ce503c78ac7 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:44.577896 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:44.763854 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1169/2324] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:12:44 2022] POST /identity/v3/projects => generated 383 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:12:44.780694 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ea891-2d56-4249-a2e5-1956a9f69bf5 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:44.803614 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9ea891-2d56-4249-a2e5-1956a9f69bf5 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:44.976684 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5fb22-9666-42c3-8bf1-d572e2de5340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:44.976684 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5fb22-9666-42c3-8bf1-d572e2de5340 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:44.976684 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5fb22-9666-42c3-8bf1-d572e2de5340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:44.976684 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5fb22-9666-42c3-8bf1-d572e2de5340 admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:44.977246 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5fb22-9666-42c3-8bf1-d572e2de5340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:44.977246 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5fb22-9666-42c3-8bf1-d572e2de5340 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:45.023096 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f3558-1cd8-4604-b3d2-3ce503c78ac7 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:45.027195 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-b50f3558-1cd8-4604-b3d2-3ce503c78ac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:45.048912 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f3558-1cd8-4604-b3d2-3ce503c78ac7 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:45.054180 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28939bcb-f777-4665-95a8-0a4de39b410e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:45.055331 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28939bcb-f777-4665-95a8-0a4de39b410e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:45.055815 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28939bcb-f777-4665-95a8-0a4de39b410e admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:45.056323 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28939bcb-f777-4665-95a8-0a4de39b410e admin admin] PATH_INFO: `/v3/users/d3f1092857c845edbcae21dacaef9d08` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:45.057843 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28939bcb-f777-4665-95a8-0a4de39b410e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3f1092857c845edbcae21dacaef9d08)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:45.060074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28939bcb-f777-4665-95a8-0a4de39b410e admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:45.171467 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1156/2325] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:12:44 2022] POST /identity/v3/users => generated 298 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:12:45.175479 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5fb22-9666-42c3-8bf1-d572e2de5340 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:45.200776 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5fb22-9666-42c3-8bf1-d572e2de5340 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:45.207758 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b213b2-158a-4321-bad5-4d28e506f6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:45.208843 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b213b2-158a-4321-bad5-4d28e506f6cf admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:45.219362 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b213b2-158a-4321-bad5-4d28e506f6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:45.219362 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b213b2-158a-4321-bad5-4d28e506f6cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:45.219362 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b213b2-158a-4321-bad5-4d28e506f6cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:45.219362 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b213b2-158a-4321-bad5-4d28e506f6cf admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:45.230991 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1157/2326] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:45.235714 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b213b2-158a-4321-bad5-4d28e506f6cf admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:45.248332 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b213b2-158a-4321-bad5-4d28e506f6cf admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:45.253893 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66e3ed-ab47-4445-a7cc-8c81041c0ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:45.254872 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66e3ed-ab47-4445-a7cc-8c81041c0ae4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:45.255380 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66e3ed-ab47-4445-a7cc-8c81041c0ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:45.255869 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66e3ed-ab47-4445-a7cc-8c81041c0ae4 admin admin] PATH_INFO: `/v3/projects/9765156bc73f4b1c825f38e68fc96816/users/f6a04bf0f4424770a677d6a5eb667a86/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:45.294171 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f66e3ed-ab47-4445-a7cc-8c81041c0ae4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9765156bc73f4b1c825f38e68fc96816, user_id=f6a04bf0f4424770a677d6a5eb667a86, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:45.297829 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f66e3ed-ab47-4445-a7cc-8c81041c0ae4 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:45.426882 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-28939bcb-f777-4665-95a8-0a4de39b410e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3f1092857c845edbcae21dacaef9d08'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:45.430283 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1158/2327] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:12:45 2022] PUT /identity/v3/projects/9765156bc73f4b1c825f38e68fc96816/users/f6a04bf0f4424770a677d6a5eb667a86/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:45.437545 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66e3ed-ab47-4445-a7cc-8c81041c0ae4 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:45.460367 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-28939bcb-f777-4665-95a8-0a4de39b410e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3f1092857c845edbcae21dacaef9d08'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:45.618190 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-28939bcb-f777-4665-95a8-0a4de39b410e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3f1092857c845edbcae21dacaef9d08'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:45.619836 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-28939bcb-f777-4665-95a8-0a4de39b410e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3f1092857c845edbcae21dacaef9d08'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:45.621248 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-28939bcb-f777-4665-95a8-0a4de39b410e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3f1092857c845edbcae21dacaef9d08'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:45.720090 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1170/2328] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:12:45 2022] DELETE /identity/v3/users/d3f1092857c845edbcae21dacaef9d08 => generated 0 bytes in 698 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:12:45.725474 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbc31e-35b0-4342-a6f3-6fc976c2a9ed None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:45.725799 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbc31e-35b0-4342-a6f3-6fc976c2a9ed None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:45.726025 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbc31e-35b0-4342-a6f3-6fc976c2a9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:45.738489 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66e3ed-ab47-4445-a7cc-8c81041c0ae4 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:45.815133 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-0acbc31e-35b0-4342-a6f3-6fc976c2a9ed None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:45.816420 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-0acbc31e-35b0-4342-a6f3-6fc976c2a9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:45.880847 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea4602-5bf9-4969-b306-db5dbe97a3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:45.881707 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea4602-5bf9-4969-b306-db5dbe97a3af admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:45.882085 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea4602-5bf9-4969-b306-db5dbe97a3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:45.882515 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea4602-5bf9-4969-b306-db5dbe97a3af admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:45.883731 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea4602-5bf9-4969-b306-db5dbe97a3af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:45.885975 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea4602-5bf9-4969-b306-db5dbe97a3af admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:45.901106 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1159/2329] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 465 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:45.908518 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea4602-5bf9-4969-b306-db5dbe97a3af admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:45.912933 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-64ea4602-5bf9-4969-b306-db5dbe97a3af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:45.945072 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea4602-5bf9-4969-b306-db5dbe97a3af admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:45.960633 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a35a2-faac-4991-ab9b-863020f66111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:45.961459 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a35a2-faac-4991-ab9b-863020f66111 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:45.961741 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a35a2-faac-4991-ab9b-863020f66111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:45.962012 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a35a2-faac-4991-ab9b-863020f66111 admin admin] PATH_INFO: `/v3/projects/9765156bc73f4b1c825f38e68fc96816/users/f6a04bf0f4424770a677d6a5eb667a86/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:45.965016 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a35a2-faac-4991-ab9b-863020f66111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9765156bc73f4b1c825f38e68fc96816, user_id=f6a04bf0f4424770a677d6a5eb667a86, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:45.973181 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1171/2330] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:45.975991 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938a35a2-faac-4991-ab9b-863020f66111 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:45.999393 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1160/2331] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:12:45 2022] PUT /identity/v3/projects/9765156bc73f4b1c825f38e68fc96816/users/f6a04bf0f4424770a677d6a5eb667a86/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:46.001267 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52b682-d058-4654-86ed-4f81ec7bae82 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:46.001559 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52b682-d058-4654-86ed-4f81ec7bae82 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:46.001837 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c52b682-d058-4654-86ed-4f81ec7bae82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:46.044991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-3c52b682-d058-4654-86ed-4f81ec7bae82 None None] MFA Rules not processed for user `f6a04bf0f4424770a677d6a5eb667a86`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:46.045769 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-3c52b682-d058-4654-86ed-4f81ec7bae82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:46.075812 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:46.103934 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a35a2-faac-4991-ab9b-863020f66111 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:46.106923 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-938a35a2-faac-4991-ab9b-863020f66111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:46.253246 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1172/2332] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:45 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:46.264127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52b682-d058-4654-86ed-4f81ec7bae82 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:46.265839 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-3c52b682-d058-4654-86ed-4f81ec7bae82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:46.302963 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a35a2-faac-4991-ab9b-863020f66111 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:46.319275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7c0b1-f8c0-4dac-94f0-74bab5884462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:46.319275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7c0b1-f8c0-4dac-94f0-74bab5884462 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:46.319275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7c0b1-f8c0-4dac-94f0-74bab5884462 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:46.319275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7c0b1-f8c0-4dac-94f0-74bab5884462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:46.447776 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a7c0b1-f8c0-4dac-94f0-74bab5884462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:46.451968 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a7c0b1-f8c0-4dac-94f0-74bab5884462 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:46.468623 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1161/2333] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:12:46.495486 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c52b682-d058-4654-86ed-4f81ec7bae82 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:46.513518 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4bdb9-b978-4135-9886-da76439644ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:46.514155 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4bdb9-b978-4135-9886-da76439644ad service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:46.514436 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4bdb9-b978-4135-9886-da76439644ad service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:46.514778 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e4bdb9-b978-4135-9886-da76439644ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:46.550179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4bdb9-b978-4135-9886-da76439644ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:46.551775 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e4bdb9-b978-4135-9886-da76439644ad service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:46.572200 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1173/2334] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:12:46.810620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7c0b1-f8c0-4dac-94f0-74bab5884462 service neutron] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:46.829042 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a7c0b1-f8c0-4dac-94f0-74bab5884462 service neutron] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:46.835186 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca968397-d8b1-41df-aafb-f018dba17791 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:46.835928 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca968397-d8b1-41df-aafb-f018dba17791 service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:46.836421 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca968397-d8b1-41df-aafb-f018dba17791 service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:46.836774 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca968397-d8b1-41df-aafb-f018dba17791 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:46.839539 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-ca968397-d8b1-41df-aafb-f018dba17791 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:46.961031 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:46.984740 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca968397-d8b1-41df-aafb-f018dba17791 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:46.986470 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca968397-d8b1-41df-aafb-f018dba17791 service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:47.001276 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1162/2335] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:12:48.011699 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4bdb9-b978-4135-9886-da76439644ad service cinder] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:48.013512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-76e4bdb9-b978-4135-9886-da76439644ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:48.031735 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e4bdb9-b978-4135-9886-da76439644ad service cinder] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:48.051228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16d60a-0aa4-4aff-82d1-99926f6ff245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:48.051228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16d60a-0aa4-4aff-82d1-99926f6ff245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:48.051228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16d60a-0aa4-4aff-82d1-99926f6ff245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:48.051228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16d60a-0aa4-4aff-82d1-99926f6ff245 admin admin] PATH_INFO: `/v3/projects/70ec4361173545078c436083e9c618a6` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:48.055443 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16d60a-0aa4-4aff-82d1-99926f6ff245 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70ec4361173545078c436083e9c618a6)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:48.058967 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16d60a-0aa4-4aff-82d1-99926f6ff245 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:48.332052 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-1d16d60a-0aa4-4aff-82d1-99926f6ff245 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70ec4361173545078c436083e9c618a6', 'request_id': 'req-1d16d60a-0aa4-4aff-82d1-99926f6ff245'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:48.341842 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-1d16d60a-0aa4-4aff-82d1-99926f6ff245 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70ec4361173545078c436083e9c618a6', 'request_id': 'req-1d16d60a-0aa4-4aff-82d1-99926f6ff245'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:48.406734 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca968397-d8b1-41df-aafb-f018dba17791 service cinder] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:48.423442 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-1d16d60a-0aa4-4aff-82d1-99926f6ff245 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70ec4361173545078c436083e9c618a6', 'request_id': 'req-1d16d60a-0aa4-4aff-82d1-99926f6ff245'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:48.431654 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca968397-d8b1-41df-aafb-f018dba17791 service cinder] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:48.445314 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-1d16d60a-0aa4-4aff-82d1-99926f6ff245 admin admin] The token cache is being invalidate because project 70ec4361173545078c436083e9c618a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:12:48.445660 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-1d16d60a-0aa4-4aff-82d1-99926f6ff245 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:48.446647 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-1d16d60a-0aa4-4aff-82d1-99926f6ff245 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:48.449112 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1174/2336] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:12:48 2022] DELETE /identity/v3/projects/70ec4361173545078c436083e9c618a6 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:48.455018 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16d60a-0aa4-4aff-82d1-99926f6ff245 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:48.458595 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-1d16d60a-0aa4-4aff-82d1-99926f6ff245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:48.549288 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061ae69c-eef1-4f61-80e1-ef1155273f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:48.550424 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ae69c-eef1-4f61-80e1-ef1155273f52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:48.550999 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ae69c-eef1-4f61-80e1-ef1155273f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:48.551742 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061ae69c-eef1-4f61-80e1-ef1155273f52 admin admin] PATH_INFO: `/v3/users/c5f8b993305247a9be072d5d1def4abe` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:48.555211 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ae69c-eef1-4f61-80e1-ef1155273f52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5f8b993305247a9be072d5d1def4abe)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:48.560691 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061ae69c-eef1-4f61-80e1-ef1155273f52 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:48.626805 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16d60a-0aa4-4aff-82d1-99926f6ff245 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:48.654962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c49ac3-9423-4f26-a20c-48b3816e57f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:48.656048 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c49ac3-9423-4f26-a20c-48b3816e57f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:48.656341 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c49ac3-9423-4f26-a20c-48b3816e57f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:48.656674 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c49ac3-9423-4f26-a20c-48b3816e57f6 admin admin] PATH_INFO: `/v3/users/571ed8f5f40e45cb86107f6a99fea0bf` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:48.658140 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c49ac3-9423-4f26-a20c-48b3816e57f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=571ed8f5f40e45cb86107f6a99fea0bf)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:48.660733 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c49ac3-9423-4f26-a20c-48b3816e57f6 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:48.891953 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-061ae69c-eef1-4f61-80e1-ef1155273f52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5f8b993305247a9be072d5d1def4abe'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:48.894047 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-061ae69c-eef1-4f61-80e1-ef1155273f52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5f8b993305247a9be072d5d1def4abe'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:48.905240 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:48.910153 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-061ae69c-eef1-4f61-80e1-ef1155273f52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5f8b993305247a9be072d5d1def4abe'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:48.914964 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-061ae69c-eef1-4f61-80e1-ef1155273f52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5f8b993305247a9be072d5d1def4abe'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:49.051306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-89c49ac3-9423-4f26-a20c-48b3816e57f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '571ed8f5f40e45cb86107f6a99fea0bf'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:49.082817 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-061ae69c-eef1-4f61-80e1-ef1155273f52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5f8b993305247a9be072d5d1def4abe'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:49.098348 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-89c49ac3-9423-4f26-a20c-48b3816e57f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '571ed8f5f40e45cb86107f6a99fea0bf'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:49.120976 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1163/2337] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:12:48 2022] DELETE /identity/v3/users/c5f8b993305247a9be072d5d1def4abe => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:49.120976 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fceaf-6d64-49bb-81b8-93880628127a None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:49.121267 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fceaf-6d64-49bb-81b8-93880628127a None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:49.121514 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fceaf-6d64-49bb-81b8-93880628127a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:49.168282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-3f2fceaf-6d64-49bb-81b8-93880628127a None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:49.176278 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-3f2fceaf-6d64-49bb-81b8-93880628127a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:49.223666 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-89c49ac3-9423-4f26-a20c-48b3816e57f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '571ed8f5f40e45cb86107f6a99fea0bf'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:49.227722 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-89c49ac3-9423-4f26-a20c-48b3816e57f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '571ed8f5f40e45cb86107f6a99fea0bf'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:49.227722 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-89c49ac3-9423-4f26-a20c-48b3816e57f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '571ed8f5f40e45cb86107f6a99fea0bf'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:49.293482 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1175/2338] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:12:48 2022] DELETE /identity/v3/users/571ed8f5f40e45cb86107f6a99fea0bf => generated 0 bytes in 839 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:12:49.388540 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1164/2339] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:49.458962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c49ac3-9423-4f26-a20c-48b3816e57f6 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:49.467225 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-89c49ac3-9423-4f26-a20c-48b3816e57f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:49.667966 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c49ac3-9423-4f26-a20c-48b3816e57f6 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:49.686230 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393f6a7-871f-40b2-bda4-8e46e6cd8418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:49.691349 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393f6a7-871f-40b2-bda4-8e46e6cd8418 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:49.692383 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393f6a7-871f-40b2-bda4-8e46e6cd8418 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:49.692545 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393f6a7-871f-40b2-bda4-8e46e6cd8418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:49.737585 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:49.865394 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393f6a7-871f-40b2-bda4-8e46e6cd8418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:49.867410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393f6a7-871f-40b2-bda4-8e46e6cd8418 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:49.880750 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1176/2340] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:12:50.851594 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fceaf-6d64-49bb-81b8-93880628127a None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:50.853297 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-3f2fceaf-6d64-49bb-81b8-93880628127a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:50.876632 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2fceaf-6d64-49bb-81b8-93880628127a None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:50.893685 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd754d-39e3-4a48-a824-b011a779d62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:50.895090 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd754d-39e3-4a48-a824-b011a779d62f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:50.895555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd754d-39e3-4a48-a824-b011a779d62f admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:50.895821 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd754d-39e3-4a48-a824-b011a779d62f admin admin] PATH_INFO: `/v3/users/cd2be7c406704510810e485bc3053916` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:50.899798 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd754d-39e3-4a48-a824-b011a779d62f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd2be7c406704510810e485bc3053916)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:50.902300 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd754d-39e3-4a48-a824-b011a779d62f admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:51.052888 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393f6a7-871f-40b2-bda4-8e46e6cd8418 service neutron] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:51.055952 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-a393f6a7-871f-40b2-bda4-8e46e6cd8418 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:51.107016 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393f6a7-871f-40b2-bda4-8e46e6cd8418 service neutron] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:51.121031 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf4f7f-3678-4002-91f8-d6ebd662e6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:51.122018 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf4f7f-3678-4002-91f8-d6ebd662e6f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:51.122531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf4f7f-3678-4002-91f8-d6ebd662e6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:51.123069 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf4f7f-3678-4002-91f8-d6ebd662e6f7 admin admin] PATH_INFO: `/v3/projects/60cb546a1d144c24872c85b257901aba` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:51.128456 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf4f7f-3678-4002-91f8-d6ebd662e6f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60cb546a1d144c24872c85b257901aba)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:51.131271 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf4f7f-3678-4002-91f8-d6ebd662e6f7 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:51.220840 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:51.237346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-3dbd754d-39e3-4a48-a824-b011a779d62f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd2be7c406704510810e485bc3053916'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:51.239607 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-3dbd754d-39e3-4a48-a824-b011a779d62f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd2be7c406704510810e485bc3053916'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:51.276538 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-3dbd754d-39e3-4a48-a824-b011a779d62f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd2be7c406704510810e485bc3053916'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:51.281247 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-3dbd754d-39e3-4a48-a824-b011a779d62f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd2be7c406704510810e485bc3053916'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:51.286545 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:51.351074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-bcbf4f7f-3678-4002-91f8-d6ebd662e6f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60cb546a1d144c24872c85b257901aba', 'request_id': 'req-bcbf4f7f-3678-4002-91f8-d6ebd662e6f7'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:51.363069 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-bcbf4f7f-3678-4002-91f8-d6ebd662e6f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60cb546a1d144c24872c85b257901aba', 'request_id': 'req-bcbf4f7f-3678-4002-91f8-d6ebd662e6f7'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:51.365503 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-3dbd754d-39e3-4a48-a824-b011a779d62f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd2be7c406704510810e485bc3053916'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:51.396188 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1165/2341] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:12:50 2022] DELETE /identity/v3/users/cd2be7c406704510810e485bc3053916 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:51.400675 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c489bd-443b-4b48-b1a1-cd4cc61f71d9 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:51.401012 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c489bd-443b-4b48-b1a1-cd4cc61f71d9 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:51.401188 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c489bd-443b-4b48-b1a1-cd4cc61f71d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:51.441162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-51c489bd-443b-4b48-b1a1-cd4cc61f71d9 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:51.442420 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-51c489bd-443b-4b48-b1a1-cd4cc61f71d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:51.453683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-bcbf4f7f-3678-4002-91f8-d6ebd662e6f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60cb546a1d144c24872c85b257901aba', 'request_id': 'req-bcbf4f7f-3678-4002-91f8-d6ebd662e6f7'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:51.472170 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-bcbf4f7f-3678-4002-91f8-d6ebd662e6f7 admin admin] The token cache is being invalidate because project 60cb546a1d144c24872c85b257901aba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:12:51.473854 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-bcbf4f7f-3678-4002-91f8-d6ebd662e6f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:51.476415 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-bcbf4f7f-3678-4002-91f8-d6ebd662e6f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:51.478596 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1177/2342] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:12:51 2022] DELETE /identity/v3/projects/60cb546a1d144c24872c85b257901aba => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:51.483865 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf4f7f-3678-4002-91f8-d6ebd662e6f7 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:51.491198 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-bcbf4f7f-3678-4002-91f8-d6ebd662e6f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:51.629266 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1166/2343] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:51.662591 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf4f7f-3678-4002-91f8-d6ebd662e6f7 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:51.676808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59d3d7-7320-44da-9fa5-2d2f85c64cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:51.677533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59d3d7-7320-44da-9fa5-2d2f85c64cdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:51.677809 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59d3d7-7320-44da-9fa5-2d2f85c64cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:51.678082 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f59d3d7-7320-44da-9fa5-2d2f85c64cdc admin admin] PATH_INFO: `/v3/users/afec3823cbce4e7996ef2a2da2de78b9` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:51.681239 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59d3d7-7320-44da-9fa5-2d2f85c64cdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=afec3823cbce4e7996ef2a2da2de78b9)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:51.683757 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f59d3d7-7320-44da-9fa5-2d2f85c64cdc admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:51.723208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c489bd-443b-4b48-b1a1-cd4cc61f71d9 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:51.726498 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-51c489bd-443b-4b48-b1a1-cd4cc61f71d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:51.851685 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c489bd-443b-4b48-b1a1-cd4cc61f71d9 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:51.859826 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baabf7b8-853e-46c3-b007-20c784d6f348 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:51.860598 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabf7b8-853e-46c3-b007-20c784d6f348 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:51.862722 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabf7b8-853e-46c3-b007-20c784d6f348 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:51.862999 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabf7b8-853e-46c3-b007-20c784d6f348 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:51.885415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baabf7b8-853e-46c3-b007-20c784d6f348 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:51.887670 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baabf7b8-853e-46c3-b007-20c784d6f348 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:51.894243 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-9f59d3d7-7320-44da-9fa5-2d2f85c64cdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afec3823cbce4e7996ef2a2da2de78b9'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:51.907197 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-9f59d3d7-7320-44da-9fa5-2d2f85c64cdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afec3823cbce4e7996ef2a2da2de78b9'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:51.912087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1167/2344] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:12:52.046342 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-9f59d3d7-7320-44da-9fa5-2d2f85c64cdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afec3823cbce4e7996ef2a2da2de78b9'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:52.047088 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-9f59d3d7-7320-44da-9fa5-2d2f85c64cdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afec3823cbce4e7996ef2a2da2de78b9'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:52.047812 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-9f59d3d7-7320-44da-9fa5-2d2f85c64cdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afec3823cbce4e7996ef2a2da2de78b9'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:52.077744 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1178/2345] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:12:51 2022] DELETE /identity/v3/users/afec3823cbce4e7996ef2a2da2de78b9 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:52.256530 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baabf7b8-853e-46c3-b007-20c784d6f348 service neutron] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:52.260547 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-baabf7b8-853e-46c3-b007-20c784d6f348 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:52.308983 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baabf7b8-853e-46c3-b007-20c784d6f348 service neutron] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:52.412738 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:52.497169 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3015769-763f-47e2-936f-e121aef31245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:52.499946 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3015769-763f-47e2-936f-e121aef31245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:52.502305 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3015769-763f-47e2-936f-e121aef31245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:52.504073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3015769-763f-47e2-936f-e121aef31245 admin admin] PATH_INFO: `/v3/projects/c4748cdf923743e6be3c8d4599ae3fd7` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:52.510977 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3015769-763f-47e2-936f-e121aef31245 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4748cdf923743e6be3c8d4599ae3fd7)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:52.518454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3015769-763f-47e2-936f-e121aef31245 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:52.739509 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-d3015769-763f-47e2-936f-e121aef31245 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4748cdf923743e6be3c8d4599ae3fd7', 'request_id': 'req-d3015769-763f-47e2-936f-e121aef31245'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:52.748528 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-d3015769-763f-47e2-936f-e121aef31245 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4748cdf923743e6be3c8d4599ae3fd7', 'request_id': 'req-d3015769-763f-47e2-936f-e121aef31245'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:52.759455 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-d3015769-763f-47e2-936f-e121aef31245 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4748cdf923743e6be3c8d4599ae3fd7', 'request_id': 'req-d3015769-763f-47e2-936f-e121aef31245'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:52.809339 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59d3d7-7320-44da-9fa5-2d2f85c64cdc admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:52.811896 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-9f59d3d7-7320-44da-9fa5-2d2f85c64cdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:52.841107 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-d3015769-763f-47e2-936f-e121aef31245 admin admin] The token cache is being invalidate because project c4748cdf923743e6be3c8d4599ae3fd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:12:52.841429 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-d3015769-763f-47e2-936f-e121aef31245 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:52.847551 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-d3015769-763f-47e2-936f-e121aef31245 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:52.849723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1168/2346] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:12:52 2022] DELETE /identity/v3/projects/c4748cdf923743e6be3c8d4599ae3fd7 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:52.859396 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3015769-763f-47e2-936f-e121aef31245 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:52.859396 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-d3015769-763f-47e2-936f-e121aef31245 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:52.874604 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:52.885921 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f59d3d7-7320-44da-9fa5-2d2f85c64cdc admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:52.974784 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27f1ea-1377-4c34-a082-5606011b2b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:52.975872 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27f1ea-1377-4c34-a082-5606011b2b17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:52.976365 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27f1ea-1377-4c34-a082-5606011b2b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:52.976917 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27f1ea-1377-4c34-a082-5606011b2b17 admin admin] PATH_INFO: `/v3/projects/e1350d448b7f4297948071554264eb81` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:52.978707 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d27f1ea-1377-4c34-a082-5606011b2b17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1350d448b7f4297948071554264eb81)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:52.981607 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d27f1ea-1377-4c34-a082-5606011b2b17 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:53.077218 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3015769-763f-47e2-936f-e121aef31245 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:53.092871 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45490f97-3697-4253-abe9-7f7659549e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:53.093517 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45490f97-3697-4253-abe9-7f7659549e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:53.093798 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45490f97-3697-4253-abe9-7f7659549e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:53.094073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45490f97-3697-4253-abe9-7f7659549e74 admin admin] PATH_INFO: `/v3/users/f6a04bf0f4424770a677d6a5eb667a86` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:53.098406 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45490f97-3697-4253-abe9-7f7659549e74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6a04bf0f4424770a677d6a5eb667a86)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:53.100441 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45490f97-3697-4253-abe9-7f7659549e74 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:53.267962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-9d27f1ea-1377-4c34-a082-5606011b2b17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1350d448b7f4297948071554264eb81', 'request_id': 'req-9d27f1ea-1377-4c34-a082-5606011b2b17'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:53.290134 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-9d27f1ea-1377-4c34-a082-5606011b2b17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1350d448b7f4297948071554264eb81', 'request_id': 'req-9d27f1ea-1377-4c34-a082-5606011b2b17'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:53.406309 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-9d27f1ea-1377-4c34-a082-5606011b2b17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1350d448b7f4297948071554264eb81', 'request_id': 'req-9d27f1ea-1377-4c34-a082-5606011b2b17'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:53.429674 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-9d27f1ea-1377-4c34-a082-5606011b2b17 admin admin] The token cache is being invalidate because project e1350d448b7f4297948071554264eb81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:12:53.430247 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-9d27f1ea-1377-4c34-a082-5606011b2b17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:53.433179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-9d27f1ea-1377-4c34-a082-5606011b2b17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:53.438110 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1179/2347] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:12:52 2022] DELETE /identity/v3/projects/e1350d448b7f4297948071554264eb81 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:53.439262 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27f1ea-1377-4c34-a082-5606011b2b17 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:53.455049 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-9d27f1ea-1377-4c34-a082-5606011b2b17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:53.499570 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-45490f97-3697-4253-abe9-7f7659549e74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6a04bf0f4424770a677d6a5eb667a86'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:53.500514 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-45490f97-3697-4253-abe9-7f7659549e74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6a04bf0f4424770a677d6a5eb667a86'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:53.534414 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-45490f97-3697-4253-abe9-7f7659549e74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6a04bf0f4424770a677d6a5eb667a86'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:53.535762 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-45490f97-3697-4253-abe9-7f7659549e74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6a04bf0f4424770a677d6a5eb667a86'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:53.647096 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d27f1ea-1377-4c34-a082-5606011b2b17 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:53.653860 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07d6151-3f49-4ff3-b778-0451ec95c04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:53.654651 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d6151-3f49-4ff3-b778-0451ec95c04b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:53.654941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d6151-3f49-4ff3-b778-0451ec95c04b admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:53.655278 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07d6151-3f49-4ff3-b778-0451ec95c04b admin admin] PATH_INFO: `/v3/projects/8dd30b72490d4c968079cc586f12a861` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:53.656865 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d6151-3f49-4ff3-b778-0451ec95c04b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dd30b72490d4c968079cc586f12a861)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:53.660282 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07d6151-3f49-4ff3-b778-0451ec95c04b admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:54.534403 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-45490f97-3697-4253-abe9-7f7659549e74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6a04bf0f4424770a677d6a5eb667a86'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:54.557563 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-a07d6151-3f49-4ff3-b778-0451ec95c04b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dd30b72490d4c968079cc586f12a861', 'request_id': 'req-a07d6151-3f49-4ff3-b778-0451ec95c04b'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:54.559665 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1169/2348] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:12:52 2022] DELETE /identity/v3/users/f6a04bf0f4424770a677d6a5eb667a86 => generated 0 bytes in 1706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:54.581181 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-a07d6151-3f49-4ff3-b778-0451ec95c04b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dd30b72490d4c968079cc586f12a861', 'request_id': 'req-a07d6151-3f49-4ff3-b778-0451ec95c04b'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:54.755717 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-a07d6151-3f49-4ff3-b778-0451ec95c04b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dd30b72490d4c968079cc586f12a861', 'request_id': 'req-a07d6151-3f49-4ff3-b778-0451ec95c04b'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:54.796236 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-a07d6151-3f49-4ff3-b778-0451ec95c04b admin admin] The token cache is being invalidate because project 8dd30b72490d4c968079cc586f12a861 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:12:54.798544 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-a07d6151-3f49-4ff3-b778-0451ec95c04b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:54.801022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-a07d6151-3f49-4ff3-b778-0451ec95c04b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:54.835841 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1180/2349] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:12:53 2022] DELETE /identity/v3/projects/8dd30b72490d4c968079cc586f12a861 => generated 0 bytes in 1381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:55.300655 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45490f97-3697-4253-abe9-7f7659549e74 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:55.302212 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-45490f97-3697-4253-abe9-7f7659549e74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:55.436428 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45490f97-3697-4253-abe9-7f7659549e74 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:55.445609 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b8cd2-1131-4583-a92e-1fedcefbe8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:55.446255 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b8cd2-1131-4583-a92e-1fedcefbe8ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:55.446537 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b8cd2-1131-4583-a92e-1fedcefbe8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:55.446815 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b8cd2-1131-4583-a92e-1fedcefbe8ea admin admin] PATH_INFO: `/v3/projects/9765156bc73f4b1c825f38e68fc96816` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:55.448274 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b8cd2-1131-4583-a92e-1fedcefbe8ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=9765156bc73f4b1c825f38e68fc96816)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:55.451888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997b8cd2-1131-4583-a92e-1fedcefbe8ea admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:55.650021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-997b8cd2-1131-4583-a92e-1fedcefbe8ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9765156bc73f4b1c825f38e68fc96816', 'request_id': 'req-997b8cd2-1131-4583-a92e-1fedcefbe8ea'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:55.660162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-997b8cd2-1131-4583-a92e-1fedcefbe8ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9765156bc73f4b1c825f38e68fc96816', 'request_id': 'req-997b8cd2-1131-4583-a92e-1fedcefbe8ea'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:55.670800 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-997b8cd2-1131-4583-a92e-1fedcefbe8ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9765156bc73f4b1c825f38e68fc96816', 'request_id': 'req-997b8cd2-1131-4583-a92e-1fedcefbe8ea'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:55.830803 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-997b8cd2-1131-4583-a92e-1fedcefbe8ea admin admin] The token cache is being invalidate because project 9765156bc73f4b1c825f38e68fc96816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:12:55.836487 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-997b8cd2-1131-4583-a92e-1fedcefbe8ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:55.840551 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-997b8cd2-1131-4583-a92e-1fedcefbe8ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:12:55.846837 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1170/2350] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:12:55 2022] DELETE /identity/v3/projects/9765156bc73f4b1c825f38e68fc96816 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:55.851718 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2473228-113b-47b7-ad28-da992c65fd92 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:55.852226 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2473228-113b-47b7-ad28-da992c65fd92 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:55.852327 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2473228-113b-47b7-ad28-da992c65fd92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:55.891192 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-c2473228-113b-47b7-ad28-da992c65fd92 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:55.892649 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-c2473228-113b-47b7-ad28-da992c65fd92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:55.980228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1181/2351] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:55.988256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1b6a1-4ed8-4483-93c3-bb0f87c247b2 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:55.988965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1b6a1-4ed8-4483-93c3-bb0f87c247b2 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:55.989461 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee1b6a1-4ed8-4483-93c3-bb0f87c247b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:56.015498 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-eee1b6a1-4ed8-4483-93c3-bb0f87c247b2 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:56.017107 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-eee1b6a1-4ed8-4483-93c3-bb0f87c247b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:56.035336 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1171/2352] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:56.037351 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2473228-113b-47b7-ad28-da992c65fd92 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:56.050095 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2473228-113b-47b7-ad28-da992c65fd92 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:56.062971 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3aae3-9397-40ae-9ece-502df67c2cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:56.063652 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3aae3-9397-40ae-9ece-502df67c2cbc admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:56.063930 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3aae3-9397-40ae-9ece-502df67c2cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:56.064254 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3aae3-9397-40ae-9ece-502df67c2cbc admin admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:56.064982 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3aae3-9397-40ae-9ece-502df67c2cbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:12:56.065285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3aae3-9397-40ae-9ece-502df67c2cbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:56.067177 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce3aae3-9397-40ae-9ece-502df67c2cbc admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:56.088248 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1182/2353] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:12:56.093824 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1b6a1-4ed8-4483-93c3-bb0f87c247b2 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:56.111039 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee1b6a1-4ed8-4483-93c3-bb0f87c247b2 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:56.117763 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea18e0-1d22-41da-94cd-d7f887aba558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:56.121218 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea18e0-1d22-41da-94cd-d7f887aba558 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:56.121218 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea18e0-1d22-41da-94cd-d7f887aba558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:56.121218 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea18e0-1d22-41da-94cd-d7f887aba558 admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:56.121218 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea18e0-1d22-41da-94cd-d7f887aba558 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:56.122333 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea18e0-1d22-41da-94cd-d7f887aba558 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:56.264762 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1172/2354] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:12:56 2022] POST /identity/v3/projects => generated 375 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:12:56.266370 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3aae3-9397-40ae-9ece-502df67c2cbc admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:56.283765 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3aae3-9397-40ae-9ece-502df67c2cbc admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:56.394791 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:56.420973 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921f173-9465-4b89-93e0-532e8087558f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:56.422203 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921f173-9465-4b89-93e0-532e8087558f admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:56.422203 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921f173-9465-4b89-93e0-532e8087558f admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:56.422203 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c921f173-9465-4b89-93e0-532e8087558f admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:56.423095 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921f173-9465-4b89-93e0-532e8087558f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:56.424845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c921f173-9465-4b89-93e0-532e8087558f admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:56.539813 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1183/2355] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:12:56 2022] POST /identity/v3/users => generated 288 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:12:56.544511 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea18e0-1d22-41da-94cd-d7f887aba558 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:56.562827 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea18e0-1d22-41da-94cd-d7f887aba558 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:56.572927 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151745c-f32d-4e1d-b3cd-8fabb9067465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:56.573919 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151745c-f32d-4e1d-b3cd-8fabb9067465 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:56.573919 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151745c-f32d-4e1d-b3cd-8fabb9067465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:56.574224 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151745c-f32d-4e1d-b3cd-8fabb9067465 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:56.575483 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151745c-f32d-4e1d-b3cd-8fabb9067465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:56.582613 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151745c-f32d-4e1d-b3cd-8fabb9067465 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:56.615938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1173/2356] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:56.620031 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921f173-9465-4b89-93e0-532e8087558f admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:56.634414 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c921f173-9465-4b89-93e0-532e8087558f admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:56.646606 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c1a81-d81a-4330-ad37-90761fe7310f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:56.648266 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c1a81-d81a-4330-ad37-90761fe7310f admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:56.648558 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c1a81-d81a-4330-ad37-90761fe7310f admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:56.649779 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c1a81-d81a-4330-ad37-90761fe7310f admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:56.650464 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c1a81-d81a-4330-ad37-90761fe7310f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:56.654436 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c1a81-d81a-4330-ad37-90761fe7310f admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:56.677357 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1184/2357] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:12:56.678654 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151745c-f32d-4e1d-b3cd-8fabb9067465 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:56.699571 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151745c-f32d-4e1d-b3cd-8fabb9067465 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:56.703678 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:56.711749 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea02c9-fe95-443d-b1fd-aa693430a848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:56.711749 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea02c9-fe95-443d-b1fd-aa693430a848 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:56.711749 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea02c9-fe95-443d-b1fd-aa693430a848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:56.711749 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea02c9-fe95-443d-b1fd-aa693430a848 admin admin] PATH_INFO: `/v3/projects/916983658d4947938bdc186d15092622/users/f8a9a3156bc944a6a2e1d9e60cc48ce1/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:56.733837 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea02c9-fe95-443d-b1fd-aa693430a848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=916983658d4947938bdc186d15092622, user_id=f8a9a3156bc944a6a2e1d9e60cc48ce1, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:56.741640 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea02c9-fe95-443d-b1fd-aa693430a848 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:56.903381 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1174/2358] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:12:56 2022] PUT /identity/v3/projects/916983658d4947938bdc186d15092622/users/f8a9a3156bc944a6a2e1d9e60cc48ce1/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:12:56.924223 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd20e32-1877-4aca-8c51-98031819642c None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:56.924820 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd20e32-1877-4aca-8c51-98031819642c None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:56.924820 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd20e32-1877-4aca-8c51-98031819642c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:56.964304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-0dd20e32-1877-4aca-8c51-98031819642c None None] MFA Rules not processed for user `f8a9a3156bc944a6a2e1d9e60cc48ce1`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:12:56.966603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-0dd20e32-1877-4aca-8c51-98031819642c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:57.081042 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1185/2359] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:12:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:12:57.086278 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea02c9-fe95-443d-b1fd-aa693430a848 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:12:57.088661 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-b2ea02c9-fe95-443d-b1fd-aa693430a848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:12:57.193392 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea02c9-fe95-443d-b1fd-aa693430a848 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:12:57.198445 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852de0db-4911-410d-b55e-2c690640133f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:12:57.199418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852de0db-4911-410d-b55e-2c690640133f service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:12:57.200326 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852de0db-4911-410d-b55e-2c690640133f service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:12:57.200753 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852de0db-4911-410d-b55e-2c690640133f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:12:57.212400 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852de0db-4911-410d-b55e-2c690640133f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:12:57.214496 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852de0db-4911-410d-b55e-2c690640133f service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:12:57.237888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1175/2360] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:12:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:12:57.664425 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:58.174632 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:12:59.953912 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:00.886670 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:01.057682 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:01.446849 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:01.567786 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:02.013198 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:02.242499 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:02.321449 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:03.052051 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:03.217851 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:03.600639 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:03.784511 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:04.554988 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:04.640247 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:05.252280 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:05.366519 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:05.395212 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:05.784138 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:05.863246 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:06.378184 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:06.451419 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:07.361089 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:07.535544 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698fdf6-c274-4c4a-bf7b-717fe3f631d6 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:07.536306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698fdf6-c274-4c4a-bf7b-717fe3f631d6 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:07.536306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698fdf6-c274-4c4a-bf7b-717fe3f631d6 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:07.537515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1186/2361] 10.222.0.55 () {54 vars in 921 bytes} [Wed Aug 24 17:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:13:07.545174 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f933395-7a4e-4671-8bfb-5b4dfb2c0a3b None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:07.545793 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f933395-7a4e-4671-8bfb-5b4dfb2c0a3b None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:07.546079 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f933395-7a4e-4671-8bfb-5b4dfb2c0a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:07.567941 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-3f933395-7a4e-4671-8bfb-5b4dfb2c0a3b None None] MFA Rules not processed for user `28a1c617fc264b118e61f2a97ecb3f39`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:13:07.569185 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-3f933395-7a4e-4671-8bfb-5b4dfb2c0a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:07.646759 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1176/2362] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Aug 24 17:13:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:13:07.659139 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698fdf6-c274-4c4a-bf7b-717fe3f631d6 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:07.660920 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-8698fdf6-c274-4c4a-bf7b-717fe3f631d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:07.726571 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698fdf6-c274-4c4a-bf7b-717fe3f631d6 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:07.730629 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be82761-85b8-47e0-a6f8-af5afa4de92b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6aad0e9f5f4a0b9578a31082e726cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:07.732143 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be82761-85b8-47e0-a6f8-af5afa4de92b service glance] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:07.732435 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be82761-85b8-47e0-a6f8-af5afa4de92b service glance] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:07.732708 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be82761-85b8-47e0-a6f8-af5afa4de92b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:07.744744 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be82761-85b8-47e0-a6f8-af5afa4de92b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:07.746221 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be82761-85b8-47e0-a6f8-af5afa4de92b service glance] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:07.759315 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1187/2363] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:13:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:13:08.021042 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df530b55-2eda-4a37-a40e-b2cc7f40293d None None] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:08.021346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df530b55-2eda-4a37-a40e-b2cc7f40293d None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:08.021605 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df530b55-2eda-4a37-a40e-b2cc7f40293d None None] PATH_INFO: `/` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:08.023479 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1177/2364] 10.222.0.55 () {54 vars in 921 bytes} [Wed Aug 24 17:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:13:08.028953 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d48f3-6c61-4180-b209-462bddfc83df None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:08.029237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d48f3-6c61-4180-b209-462bddfc83df None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:08.029504 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d48f3-6c61-4180-b209-462bddfc83df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:08.051534 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-434d48f3-6c61-4180-b209-462bddfc83df None None] MFA Rules not processed for user `88ce8df89a96460ca046f2972321bceb`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:13:08.052768 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-434d48f3-6c61-4180-b209-462bddfc83df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:08.110503 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1188/2365] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Aug 24 17:13:08 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:13:08.123902 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df530b55-2eda-4a37-a40e-b2cc7f40293d None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:08.126433 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-df530b55-2eda-4a37-a40e-b2cc7f40293d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:08.142720 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df530b55-2eda-4a37-a40e-b2cc7f40293d None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:08.147818 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c202b-44d6-4ed8-9f3a-87516880f00e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:08.148367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c202b-44d6-4ed8-9f3a-87516880f00e service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:08.148835 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c202b-44d6-4ed8-9f3a-87516880f00e service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:08.149498 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c202b-44d6-4ed8-9f3a-87516880f00e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:08.164901 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c202b-44d6-4ed8-9f3a-87516880f00e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:08.166526 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c202b-44d6-4ed8-9f3a-87516880f00e service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:08.177348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1178/2366] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:13:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:13:08.341338 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c96a7-c66f-4ae2-bc70-a20e1ba43760 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:08.341654 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c96a7-c66f-4ae2-bc70-a20e1ba43760 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:08.341937 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c96a7-c66f-4ae2-bc70-a20e1ba43760 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:08.343508 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1189/2367] 10.222.0.55 () {54 vars in 921 bytes} [Wed Aug 24 17:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:13:08.358908 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f5bcf-f861-4e5c-8692-7d73688a45c6 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:08.359171 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f5bcf-f861-4e5c-8692-7d73688a45c6 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:08.359620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f5bcf-f861-4e5c-8692-7d73688a45c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:08.381728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-5f9f5bcf-f861-4e5c-8692-7d73688a45c6 None None] MFA Rules not processed for user `28a1c617fc264b118e61f2a97ecb3f39`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:13:08.383206 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-5f9f5bcf-f861-4e5c-8692-7d73688a45c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:08.393157 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1179/2368] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Aug 24 17:13:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:13:08.404152 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c96a7-c66f-4ae2-bc70-a20e1ba43760 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:08.415755 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c96a7-c66f-4ae2-bc70-a20e1ba43760 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:08.420260 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9c163-a661-49f3-a073-5fd30ca26bbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:08.420867 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9c163-a661-49f3-a073-5fd30ca26bbb service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:08.421131 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9c163-a661-49f3-a073-5fd30ca26bbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:08.421400 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc9c163-a661-49f3-a073-5fd30ca26bbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:08.433295 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9c163-a661-49f3-a073-5fd30ca26bbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:08.434790 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc9c163-a661-49f3-a073-5fd30ca26bbb service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:08.448063 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:08.459798 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1190/2369] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:13:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:13:09.763633 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f5bcf-f861-4e5c-8692-7d73688a45c6 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:09.773810 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f5bcf-f861-4e5c-8692-7d73688a45c6 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:09.779988 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250bf4e-62d2-4c94-abc6-35e4a6a53e6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:09.780614 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250bf4e-62d2-4c94-abc6-35e4a6a53e6d service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:09.780893 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250bf4e-62d2-4c94-abc6-35e4a6a53e6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:09.781168 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a250bf4e-62d2-4c94-abc6-35e4a6a53e6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:09.783173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-a250bf4e-62d2-4c94-abc6-35e4a6a53e6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:09.790259 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:09.895609 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a250bf4e-62d2-4c94-abc6-35e4a6a53e6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:09.897178 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a250bf4e-62d2-4c94-abc6-35e4a6a53e6d service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:09.922645 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1180/2370] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:13:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:13:10.222298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9c163-a661-49f3-a073-5fd30ca26bbb service neutron] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:10.231684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc9c163-a661-49f3-a073-5fd30ca26bbb service neutron] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:10.235233 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f699c2-5236-4752-9011-c7b052e7bab4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:10.235834 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f699c2-5236-4752-9011-c7b052e7bab4 service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:10.236109 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f699c2-5236-4752-9011-c7b052e7bab4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:10.236378 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f699c2-5236-4752-9011-c7b052e7bab4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:10.238392 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-95f699c2-5236-4752-9011-c7b052e7bab4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:10.310878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f699c2-5236-4752-9011-c7b052e7bab4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:10.312883 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f699c2-5236-4752-9011-c7b052e7bab4 service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:10.323810 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1191/2371] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:13:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:13:14.518226 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250bf4e-62d2-4c94-abc6-35e4a6a53e6d service neutron] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:14.597620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a250bf4e-62d2-4c94-abc6-35e4a6a53e6d service neutron] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:14.602435 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1aaa67-4523-44fb-8469-b5c68159ad74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:14.603225 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1aaa67-4523-44fb-8469-b5c68159ad74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:14.603503 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1aaa67-4523-44fb-8469-b5c68159ad74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:14.612590 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1aaa67-4523-44fb-8469-b5c68159ad74 admin admin] PATH_INFO: `/v3/users/f8a9a3156bc944a6a2e1d9e60cc48ce1` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:14.612590 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1aaa67-4523-44fb-8469-b5c68159ad74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8a9a3156bc944a6a2e1d9e60cc48ce1)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:14.612590 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1aaa67-4523-44fb-8469-b5c68159ad74 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:14.800975 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd5117-edf1-4ac5-a8c8-a99c95044bbe None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:14.801827 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd5117-edf1-4ac5-a8c8-a99c95044bbe None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:14.802106 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd5117-edf1-4ac5-a8c8-a99c95044bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:14.818128 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-ed1aaa67-4523-44fb-8469-b5c68159ad74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8a9a3156bc944a6a2e1d9e60cc48ce1'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:14.818948 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-ed1aaa67-4523-44fb-8469-b5c68159ad74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8a9a3156bc944a6a2e1d9e60cc48ce1'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:14.822351 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-5abd5117-edf1-4ac5-a8c8-a99c95044bbe None None] MFA Rules not processed for user `ae9fc5f06a0441da80e656fa1e88db5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:13:14.823615 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-5abd5117-edf1-4ac5-a8c8-a99c95044bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:14.831060 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-ed1aaa67-4523-44fb-8469-b5c68159ad74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8a9a3156bc944a6a2e1d9e60cc48ce1'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:14.831905 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-ed1aaa67-4523-44fb-8469-b5c68159ad74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8a9a3156bc944a6a2e1d9e60cc48ce1'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:14.896986 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1192/2372] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Aug 24 17:13:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:13:14.909414 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd5117-edf1-4ac5-a8c8-a99c95044bbe None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:14.910784 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-5abd5117-edf1-4ac5-a8c8-a99c95044bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:14.937543 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-ed1aaa67-4523-44fb-8469-b5c68159ad74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8a9a3156bc944a6a2e1d9e60cc48ce1'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:14.959043 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1181/2373] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:13:14 2022] DELETE /identity/v3/users/f8a9a3156bc944a6a2e1d9e60cc48ce1 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:13:14.963516 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b8672-b55c-493b-8c07-c97a3ada9695 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:14.963801 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b8672-b55c-493b-8c07-c97a3ada9695 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:14.964074 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b8672-b55c-493b-8c07-c97a3ada9695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:14.983947 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-696b8672-b55c-493b-8c07-c97a3ada9695 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:13:14.985080 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-696b8672-b55c-493b-8c07-c97a3ada9695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:14.990387 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd5117-edf1-4ac5-a8c8-a99c95044bbe None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:15.002777 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:15.034553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:15.057471 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f411d0-88d1-4082-8748-862128f83a5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c067bc2d84b741d08ac47e40adae4b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:15.057726 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1182/2374] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:13:15.058620 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f411d0-88d1-4082-8748-862128f83a5d service swift] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:15.059000 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f411d0-88d1-4082-8748-862128f83a5d service swift] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:15.059458 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f411d0-88d1-4082-8748-862128f83a5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:15.067539 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b8672-b55c-493b-8c07-c97a3ada9695 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:15.068984 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-696b8672-b55c-493b-8c07-c97a3ada9695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:15.120638 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f411d0-88d1-4082-8748-862128f83a5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:15.122358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f411d0-88d1-4082-8748-862128f83a5d service swift] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:15.126284 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b8672-b55c-493b-8c07-c97a3ada9695 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:15.130336 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc6cf9-26b6-4de1-956f-08573958f6cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:15.130729 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1193/2375] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Aug 24 17:13:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 17:13:15.130944 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc6cf9-26b6-4de1-956f-08573958f6cf service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:15.131252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc6cf9-26b6-4de1-956f-08573958f6cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:15.131522 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc6cf9-26b6-4de1-956f-08573958f6cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:15.142243 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc6cf9-26b6-4de1-956f-08573958f6cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:15.143639 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc6cf9-26b6-4de1-956f-08573958f6cf service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:15.156491 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1183/2376] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:13:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:13:15.691294 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f411d0-88d1-4082-8748-862128f83a5d service swift] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:15.693089 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-68f411d0-88d1-4082-8748-862128f83a5d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:15.709197 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f411d0-88d1-4082-8748-862128f83a5d service swift] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:15.714556 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5f34e4-380a-420e-bc19-bfdb2300597e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:15.715924 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f34e4-380a-420e-bc19-bfdb2300597e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:15.716384 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f34e4-380a-420e-bc19-bfdb2300597e admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:15.716596 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5f34e4-380a-420e-bc19-bfdb2300597e admin admin] PATH_INFO: `/v3/projects/916983658d4947938bdc186d15092622` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:15.717961 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f34e4-380a-420e-bc19-bfdb2300597e admin admin] RBAC: Authorizing `identity:delete_project(project_id=916983658d4947938bdc186d15092622)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:15.720505 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5f34e4-380a-420e-bc19-bfdb2300597e admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:15.832268 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-fa5f34e4-380a-420e-bc19-bfdb2300597e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '916983658d4947938bdc186d15092622', 'request_id': 'req-fa5f34e4-380a-420e-bc19-bfdb2300597e'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:15.839006 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-fa5f34e4-380a-420e-bc19-bfdb2300597e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '916983658d4947938bdc186d15092622', 'request_id': 'req-fa5f34e4-380a-420e-bc19-bfdb2300597e'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:15.922749 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-fa5f34e4-380a-420e-bc19-bfdb2300597e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '916983658d4947938bdc186d15092622', 'request_id': 'req-fa5f34e4-380a-420e-bc19-bfdb2300597e'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:15.935299 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-fa5f34e4-380a-420e-bc19-bfdb2300597e admin admin] The token cache is being invalidate because project 916983658d4947938bdc186d15092622 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:13:15.935587 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-fa5f34e4-380a-420e-bc19-bfdb2300597e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:15.936362 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-fa5f34e4-380a-420e-bc19-bfdb2300597e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:15.937941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1194/2377] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:13:15 2022] DELETE /identity/v3/projects/916983658d4947938bdc186d15092622 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:13:15.942768 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c4a41-d157-4ef0-8c9b-110e2d21ad89 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:15.943367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c4a41-d157-4ef0-8c9b-110e2d21ad89 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:15.943367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8c4a41-d157-4ef0-8c9b-110e2d21ad89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:15.964465 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-1f8c4a41-d157-4ef0-8c9b-110e2d21ad89 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:13:15.966307 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-1f8c4a41-d157-4ef0-8c9b-110e2d21ad89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:16.062348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1184/2378] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:13:16.071580 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1c72b-98bb-4439-87c9-8ee4395ad000 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:16.071998 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1c72b-98bb-4439-87c9-8ee4395ad000 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:16.072371 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1c72b-98bb-4439-87c9-8ee4395ad000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:16.104650 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-32a1c72b-98bb-4439-87c9-8ee4395ad000 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:13:16.106552 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-32a1c72b-98bb-4439-87c9-8ee4395ad000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:16.115494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1195/2379] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:13:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:13:16.119732 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c4a41-d157-4ef0-8c9b-110e2d21ad89 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:16.130315 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8c4a41-d157-4ef0-8c9b-110e2d21ad89 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:16.135131 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b343bf3-de69-400f-8789-0f16c27fff2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:16.135751 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b343bf3-de69-400f-8789-0f16c27fff2b admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:16.136029 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b343bf3-de69-400f-8789-0f16c27fff2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:16.136297 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b343bf3-de69-400f-8789-0f16c27fff2b admin admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:16.137011 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b343bf3-de69-400f-8789-0f16c27fff2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:13:16.137309 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b343bf3-de69-400f-8789-0f16c27fff2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:16.138900 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b343bf3-de69-400f-8789-0f16c27fff2b admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:16.151660 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1185/2380] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:13:16.157221 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1c72b-98bb-4439-87c9-8ee4395ad000 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:16.166783 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1c72b-98bb-4439-87c9-8ee4395ad000 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:16.172368 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b8ae2-5dee-431f-b61d-a2cd1b7a82e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:16.172979 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b8ae2-5dee-431f-b61d-a2cd1b7a82e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:16.173282 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b8ae2-5dee-431f-b61d-a2cd1b7a82e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:16.173584 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b8ae2-5dee-431f-b61d-a2cd1b7a82e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:16.174318 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b8ae2-5dee-431f-b61d-a2cd1b7a82e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:16.176103 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b8ae2-5dee-431f-b61d-a2cd1b7a82e9 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:16.253797 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1196/2381] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:13:16 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:13:16.257882 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b343bf3-de69-400f-8789-0f16c27fff2b admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:16.269579 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b343bf3-de69-400f-8789-0f16c27fff2b admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:16.324006 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:16.334914 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb61cd-0f51-40a7-ab3b-881e94227d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:16.335751 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb61cd-0f51-40a7-ab3b-881e94227d66 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:16.336042 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb61cd-0f51-40a7-ab3b-881e94227d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:16.336316 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb61cd-0f51-40a7-ab3b-881e94227d66 admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:16.337003 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb61cd-0f51-40a7-ab3b-881e94227d66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:16.338914 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eb61cd-0f51-40a7-ab3b-881e94227d66 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:16.445939 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1186/2382] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:13:16 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:13:16.450654 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b8ae2-5dee-431f-b61d-a2cd1b7a82e9 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:16.461568 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b8ae2-5dee-431f-b61d-a2cd1b7a82e9 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:16.466331 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6186d4-fc7c-4fa9-869d-a5cc3ef10c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:16.467016 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6186d4-fc7c-4fa9-869d-a5cc3ef10c5b admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:16.467322 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6186d4-fc7c-4fa9-869d-a5cc3ef10c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:16.467596 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6186d4-fc7c-4fa9-869d-a5cc3ef10c5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:16.468247 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6186d4-fc7c-4fa9-869d-a5cc3ef10c5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:16.470278 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6186d4-fc7c-4fa9-869d-a5cc3ef10c5b admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:16.482670 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1197/2383] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:13:16.486861 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb61cd-0f51-40a7-ab3b-881e94227d66 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:16.499367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eb61cd-0f51-40a7-ab3b-881e94227d66 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:16.505872 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2af34d-dfb1-47c9-970a-e5ee7fb6d2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:16.507036 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2af34d-dfb1-47c9-970a-e5ee7fb6d2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:16.507474 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2af34d-dfb1-47c9-970a-e5ee7fb6d2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:16.507829 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2af34d-dfb1-47c9-970a-e5ee7fb6d2d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:16.508912 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2af34d-dfb1-47c9-970a-e5ee7fb6d2d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:16.510599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2af34d-dfb1-47c9-970a-e5ee7fb6d2d0 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:16.524746 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1187/2384] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:13:16.529069 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6186d4-fc7c-4fa9-869d-a5cc3ef10c5b admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:16.539965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6186d4-fc7c-4fa9-869d-a5cc3ef10c5b admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:16.545305 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f7084-977e-49cf-a283-8fb15df38289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:16.545972 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f7084-977e-49cf-a283-8fb15df38289 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:16.546342 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f7084-977e-49cf-a283-8fb15df38289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:16.546622 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f7084-977e-49cf-a283-8fb15df38289 admin admin] PATH_INFO: `/v3/projects/dda059fed3e14529a9ac03cedf9f1923/users/839803a2f95840b09818c9afee5d4ceb/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:16.579734 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f7084-977e-49cf-a283-8fb15df38289 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dda059fed3e14529a9ac03cedf9f1923, user_id=839803a2f95840b09818c9afee5d4ceb, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:16.582708 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f7084-977e-49cf-a283-8fb15df38289 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:16.666035 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:16.672247 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1198/2385] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:13:16 2022] PUT /identity/v3/projects/dda059fed3e14529a9ac03cedf9f1923/users/839803a2f95840b09818c9afee5d4ceb/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:13:16.683540 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47a143-f193-4fd7-8208-9494305234a4 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:16.684639 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47a143-f193-4fd7-8208-9494305234a4 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:16.685142 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac47a143-f193-4fd7-8208-9494305234a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:16.719839 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-ac47a143-f193-4fd7-8208-9494305234a4 None None] MFA Rules not processed for user `839803a2f95840b09818c9afee5d4ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:13:16.721076 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-ac47a143-f193-4fd7-8208-9494305234a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:16.790788 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1188/2386] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:13:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:13:16.796348 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f7084-977e-49cf-a283-8fb15df38289 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:16.861103 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f7084-977e-49cf-a283-8fb15df38289 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:16.865956 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486dce87-97a6-4762-bea8-14556d958f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:16.866571 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dce87-97a6-4762-bea8-14556d958f62 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:16.867833 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dce87-97a6-4762-bea8-14556d958f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:16.867833 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486dce87-97a6-4762-bea8-14556d958f62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:16.868038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486dce87-97a6-4762-bea8-14556d958f62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:16.869908 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486dce87-97a6-4762-bea8-14556d958f62 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:17.008459 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1199/2387] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:13:16 2022] POST /identity/v3/projects => generated 385 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:13:17.013318 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47a143-f193-4fd7-8208-9494305234a4 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:17.024373 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac47a143-f193-4fd7-8208-9494305234a4 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:17.088706 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bcc8e6-b037-49ec-9d05-a96c42be47dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:17.089369 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcc8e6-b037-49ec-9d05-a96c42be47dc admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:17.089652 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcc8e6-b037-49ec-9d05-a96c42be47dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:17.089949 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bcc8e6-b037-49ec-9d05-a96c42be47dc admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:17.090861 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bcc8e6-b037-49ec-9d05-a96c42be47dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:17.092762 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bcc8e6-b037-49ec-9d05-a96c42be47dc admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:17.185149 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1189/2388] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:13:17 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:13:17.189019 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486dce87-97a6-4762-bea8-14556d958f62 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:17.200413 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486dce87-97a6-4762-bea8-14556d958f62 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:17.205285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb10dad-99e4-418f-8737-1f0da128f451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:17.205902 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb10dad-99e4-418f-8737-1f0da128f451 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:17.206184 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb10dad-99e4-418f-8737-1f0da128f451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:17.206449 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb10dad-99e4-418f-8737-1f0da128f451 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:17.207092 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb10dad-99e4-418f-8737-1f0da128f451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:17.208930 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb10dad-99e4-418f-8737-1f0da128f451 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:17.222957 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1200/2389] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:13:17.224459 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bcc8e6-b037-49ec-9d05-a96c42be47dc admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:17.234880 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bcc8e6-b037-49ec-9d05-a96c42be47dc admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:17.239502 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cb07e3-3117-40e9-b8d6-795781ebf9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:17.240253 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb07e3-3117-40e9-b8d6-795781ebf9cf admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:17.240533 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb07e3-3117-40e9-b8d6-795781ebf9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:17.240799 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cb07e3-3117-40e9-b8d6-795781ebf9cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:17.241491 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb07e3-3117-40e9-b8d6-795781ebf9cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:17.243061 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cb07e3-3117-40e9-b8d6-795781ebf9cf admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:17.254867 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1190/2390] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:13:17.260015 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb10dad-99e4-418f-8737-1f0da128f451 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:17.287399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb10dad-99e4-418f-8737-1f0da128f451 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:17.295665 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb2d59-6cd2-493e-8d64-40258e12a548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:17.296662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb2d59-6cd2-493e-8d64-40258e12a548 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:17.297134 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb2d59-6cd2-493e-8d64-40258e12a548 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:17.297413 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bb2d59-6cd2-493e-8d64-40258e12a548 admin admin] PATH_INFO: `/v3/projects/bf647883c4ed4d258a353ea391aebfa4/users/d49eec385eab451a84c44bfd4bf96e3b/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:17.314094 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb2d59-6cd2-493e-8d64-40258e12a548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf647883c4ed4d258a353ea391aebfa4, user_id=d49eec385eab451a84c44bfd4bf96e3b, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:17.316805 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bb2d59-6cd2-493e-8d64-40258e12a548 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:17.391424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1201/2391] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:13:17 2022] PUT /identity/v3/projects/bf647883c4ed4d258a353ea391aebfa4/users/d49eec385eab451a84c44bfd4bf96e3b/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:13:17.403166 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984de0b-ba6b-4295-add1-e7bea740bc67 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:17.403455 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984de0b-ba6b-4295-add1-e7bea740bc67 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:17.403733 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5984de0b-ba6b-4295-add1-e7bea740bc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:17.437028 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-5984de0b-ba6b-4295-add1-e7bea740bc67 None None] MFA Rules not processed for user `d49eec385eab451a84c44bfd4bf96e3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:13:17.438531 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-5984de0b-ba6b-4295-add1-e7bea740bc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:17.470232 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:17.512514 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1191/2392] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:13:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:13:17.517376 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb2d59-6cd2-493e-8d64-40258e12a548 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:17.593478 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bb2d59-6cd2-493e-8d64-40258e12a548 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:17.598374 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13531137-37d0-4549-ace2-25b2e977a4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:17.598943 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13531137-37d0-4549-ace2-25b2e977a4f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:17.599260 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13531137-37d0-4549-ace2-25b2e977a4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:17.599537 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13531137-37d0-4549-ace2-25b2e977a4f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:17.600208 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13531137-37d0-4549-ace2-25b2e977a4f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:17.602127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13531137-37d0-4549-ace2-25b2e977a4f3 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:17.707192 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1202/2393] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:13:17 2022] POST /identity/v3/projects => generated 381 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:13:17.712696 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984de0b-ba6b-4295-add1-e7bea740bc67 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:17.741684 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5984de0b-ba6b-4295-add1-e7bea740bc67 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:17.818749 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74557095-e57f-4200-b76f-60e0273ed91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:17.819397 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74557095-e57f-4200-b76f-60e0273ed91f admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:17.819698 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74557095-e57f-4200-b76f-60e0273ed91f admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:17.819969 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74557095-e57f-4200-b76f-60e0273ed91f admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:17.820597 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74557095-e57f-4200-b76f-60e0273ed91f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:17.822525 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74557095-e57f-4200-b76f-60e0273ed91f admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:17.927285 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1192/2394] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:13:17 2022] POST /identity/v3/users => generated 297 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:13:17.931839 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13531137-37d0-4549-ace2-25b2e977a4f3 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:17.944202 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13531137-37d0-4549-ace2-25b2e977a4f3 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:17.949061 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578c6ea-f810-4d51-87e7-867b354b4d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:17.949857 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578c6ea-f810-4d51-87e7-867b354b4d0d admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:17.950237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578c6ea-f810-4d51-87e7-867b354b4d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:17.950583 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578c6ea-f810-4d51-87e7-867b354b4d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:17.951330 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578c6ea-f810-4d51-87e7-867b354b4d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:17.953042 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578c6ea-f810-4d51-87e7-867b354b4d0d admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:17.966868 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1203/2395] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:13:17.971090 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74557095-e57f-4200-b76f-60e0273ed91f admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:17.982719 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74557095-e57f-4200-b76f-60e0273ed91f admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:17.987751 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f681fa-b1b5-4c37-b61c-c392e177d288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:17.988602 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f681fa-b1b5-4c37-b61c-c392e177d288 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:17.988961 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f681fa-b1b5-4c37-b61c-c392e177d288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:17.989538 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f681fa-b1b5-4c37-b61c-c392e177d288 admin admin] PATH_INFO: `/v3/projects/45446155f46f41aeb134f0376ce16f13/users/238b323a1fc0420fb518a903ac3ad899/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:18.007084 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f681fa-b1b5-4c37-b61c-c392e177d288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45446155f46f41aeb134f0376ce16f13, user_id=238b323a1fc0420fb518a903ac3ad899, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:18.010111 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f681fa-b1b5-4c37-b61c-c392e177d288 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:18.092871 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1193/2396] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:13:17 2022] PUT /identity/v3/projects/45446155f46f41aeb134f0376ce16f13/users/238b323a1fc0420fb518a903ac3ad899/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:13:18.096964 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578c6ea-f810-4d51-87e7-867b354b4d0d admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:18.107584 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578c6ea-f810-4d51-87e7-867b354b4d0d admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:18.128749 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:18.169218 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50844c-40e5-4326-bf6b-42a909b6400d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:18.169843 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50844c-40e5-4326-bf6b-42a909b6400d admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:18.170204 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50844c-40e5-4326-bf6b-42a909b6400d admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:18.170667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50844c-40e5-4326-bf6b-42a909b6400d admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:18.172102 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50844c-40e5-4326-bf6b-42a909b6400d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:18.173540 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50844c-40e5-4326-bf6b-42a909b6400d admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:18.186737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1204/2397] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:13:18.190988 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f681fa-b1b5-4c37-b61c-c392e177d288 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:18.202880 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f681fa-b1b5-4c37-b61c-c392e177d288 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:18.207731 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afb765-28d4-4aff-a4cf-089adea9c2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:18.208409 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afb765-28d4-4aff-a4cf-089adea9c2d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:18.208692 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afb765-28d4-4aff-a4cf-089adea9c2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:18.208967 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afb765-28d4-4aff-a4cf-089adea9c2d9 admin admin] PATH_INFO: `/v3/projects/45446155f46f41aeb134f0376ce16f13/users/238b323a1fc0420fb518a903ac3ad899/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:18.211040 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afb765-28d4-4aff-a4cf-089adea9c2d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45446155f46f41aeb134f0376ce16f13, user_id=238b323a1fc0420fb518a903ac3ad899, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:18.213794 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afb765-28d4-4aff-a4cf-089adea9c2d9 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:18.226321 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1194/2398] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:13:18 2022] PUT /identity/v3/projects/45446155f46f41aeb134f0376ce16f13/users/238b323a1fc0420fb518a903ac3ad899/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:13:18.237022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763c057-164a-4bbe-9e6c-536ba5d5d28e None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:18.237313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763c057-164a-4bbe-9e6c-536ba5d5d28e None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:18.237598 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763c057-164a-4bbe-9e6c-536ba5d5d28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:18.274136 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-f763c057-164a-4bbe-9e6c-536ba5d5d28e None None] MFA Rules not processed for user `238b323a1fc0420fb518a903ac3ad899`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:13:18.275547 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-f763c057-164a-4bbe-9e6c-536ba5d5d28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:18.363065 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1205/2399] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:13:18 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:13:18.379153 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afb765-28d4-4aff-a4cf-089adea9c2d9 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:18.385227 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-46afb765-28d4-4aff-a4cf-089adea9c2d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:18.471364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afb765-28d4-4aff-a4cf-089adea9c2d9 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:18.477493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b5e0c-e98f-45ca-b3ed-36fbc80c1171 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:18.478147 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b5e0c-e98f-45ca-b3ed-36fbc80c1171 service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:18.478431 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b5e0c-e98f-45ca-b3ed-36fbc80c1171 service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:18.478712 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b5e0c-e98f-45ca-b3ed-36fbc80c1171 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:18.526337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:18.551024 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b5e0c-e98f-45ca-b3ed-36fbc80c1171 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:18.552521 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b5e0c-e98f-45ca-b3ed-36fbc80c1171 service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:18.563012 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1195/2400] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:13:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:13:21.329083 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763c057-164a-4bbe-9e6c-536ba5d5d28e None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:21.330560 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-f763c057-164a-4bbe-9e6c-536ba5d5d28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:21.344428 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763c057-164a-4bbe-9e6c-536ba5d5d28e None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:21.348283 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ceeb7b-ffab-4cdf-a2e2-db1035713004 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:21.348956 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ceeb7b-ffab-4cdf-a2e2-db1035713004 service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:21.349384 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ceeb7b-ffab-4cdf-a2e2-db1035713004 service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:21.349720 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ceeb7b-ffab-4cdf-a2e2-db1035713004 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:21.422887 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ceeb7b-ffab-4cdf-a2e2-db1035713004 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:21.424668 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ceeb7b-ffab-4cdf-a2e2-db1035713004 service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:21.437114 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1206/2401] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:13:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:13:22.875917 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b5e0c-e98f-45ca-b3ed-36fbc80c1171 service cinder] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:22.885247 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b5e0c-e98f-45ca-b3ed-36fbc80c1171 service cinder] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:22.891938 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942e2a2-38d1-4102-becf-1077bc19e5a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:22.892558 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942e2a2-38d1-4102-becf-1077bc19e5a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:22.892836 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942e2a2-38d1-4102-becf-1077bc19e5a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:22.893107 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942e2a2-38d1-4102-becf-1077bc19e5a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:22.903382 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942e2a2-38d1-4102-becf-1077bc19e5a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:22.904912 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942e2a2-38d1-4102-becf-1077bc19e5a1 service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:22.915426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1196/2402] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:13:22 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:13:27.659916 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ceeb7b-ffab-4cdf-a2e2-db1035713004 service cinder] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:27.704804 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:27.721865 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ceeb7b-ffab-4cdf-a2e2-db1035713004 service cinder] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:27.726398 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e15d8-d538-40f3-a3cb-2ae4a9e103d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:27.727038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e15d8-d538-40f3-a3cb-2ae4a9e103d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:27.727336 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e15d8-d538-40f3-a3cb-2ae4a9e103d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:27.727611 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e15d8-d538-40f3-a3cb-2ae4a9e103d3 admin admin] PATH_INFO: `/v3/users/839803a2f95840b09818c9afee5d4ceb` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:27.728743 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e15d8-d538-40f3-a3cb-2ae4a9e103d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=839803a2f95840b09818c9afee5d4ceb)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:27.730703 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05e15d8-d538-40f3-a3cb-2ae4a9e103d3 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:27.946232 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-c05e15d8-d538-40f3-a3cb-2ae4a9e103d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '839803a2f95840b09818c9afee5d4ceb'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:27.956332 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-c05e15d8-d538-40f3-a3cb-2ae4a9e103d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '839803a2f95840b09818c9afee5d4ceb'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:28.052091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-c05e15d8-d538-40f3-a3cb-2ae4a9e103d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '839803a2f95840b09818c9afee5d4ceb'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:28.052850 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-c05e15d8-d538-40f3-a3cb-2ae4a9e103d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '839803a2f95840b09818c9afee5d4ceb'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:28.053476 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-c05e15d8-d538-40f3-a3cb-2ae4a9e103d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '839803a2f95840b09818c9afee5d4ceb'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:28.082004 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1207/2403] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:13:27 2022] DELETE /identity/v3/users/839803a2f95840b09818c9afee5d4ceb => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:13:28.086391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1b6f0-c3ea-41fd-8f9c-603bae4f7923 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:28.086932 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1b6f0-c3ea-41fd-8f9c-603bae4f7923 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:28.086932 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1b6f0-c3ea-41fd-8f9c-603bae4f7923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:28.107945 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-3cb1b6f0-c3ea-41fd-8f9c-603bae4f7923 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:13:28.109180 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-3cb1b6f0-c3ea-41fd-8f9c-603bae4f7923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:28.179256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1197/2404] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:13:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:13:28.189849 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e15d8-d538-40f3-a3cb-2ae4a9e103d3 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:28.191285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-c05e15d8-d538-40f3-a3cb-2ae4a9e103d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:28.258586 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e15d8-d538-40f3-a3cb-2ae4a9e103d3 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:28.262322 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4791ae-5516-41ce-b9ac-d5ac6715d907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:28.262927 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4791ae-5516-41ce-b9ac-d5ac6715d907 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:28.263237 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4791ae-5516-41ce-b9ac-d5ac6715d907 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:28.263509 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4791ae-5516-41ce-b9ac-d5ac6715d907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:28.273205 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4791ae-5516-41ce-b9ac-d5ac6715d907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:28.274892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4791ae-5516-41ce-b9ac-d5ac6715d907 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:28.285568 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1208/2405] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:13:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:13:28.796981 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1b6f0-c3ea-41fd-8f9c-603bae4f7923 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:28.799163 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-3cb1b6f0-c3ea-41fd-8f9c-603bae4f7923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:28.811995 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1b6f0-c3ea-41fd-8f9c-603bae4f7923 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:28.820371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a528ca-f29c-489d-bcfa-5735d3050ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:28.821129 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a528ca-f29c-489d-bcfa-5735d3050ac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:28.824334 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a528ca-f29c-489d-bcfa-5735d3050ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:28.824334 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a528ca-f29c-489d-bcfa-5735d3050ac2 admin admin] PATH_INFO: `/v3/projects/dda059fed3e14529a9ac03cedf9f1923` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:28.824334 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a528ca-f29c-489d-bcfa-5735d3050ac2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dda059fed3e14529a9ac03cedf9f1923)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:28.825697 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a528ca-f29c-489d-bcfa-5735d3050ac2 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:28.987655 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-54a528ca-f29c-489d-bcfa-5735d3050ac2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dda059fed3e14529a9ac03cedf9f1923', 'request_id': 'req-54a528ca-f29c-489d-bcfa-5735d3050ac2'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:28.993093 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-54a528ca-f29c-489d-bcfa-5735d3050ac2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dda059fed3e14529a9ac03cedf9f1923', 'request_id': 'req-54a528ca-f29c-489d-bcfa-5735d3050ac2'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:29.000586 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-54a528ca-f29c-489d-bcfa-5735d3050ac2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dda059fed3e14529a9ac03cedf9f1923', 'request_id': 'req-54a528ca-f29c-489d-bcfa-5735d3050ac2'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:29.094888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-54a528ca-f29c-489d-bcfa-5735d3050ac2 admin admin] The token cache is being invalidate because project dda059fed3e14529a9ac03cedf9f1923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:13:29.095537 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-54a528ca-f29c-489d-bcfa-5735d3050ac2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:29.099464 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-54a528ca-f29c-489d-bcfa-5735d3050ac2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:29.099464 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1198/2406] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:13:28 2022] DELETE /identity/v3/projects/dda059fed3e14529a9ac03cedf9f1923 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:13:29.102105 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4791ae-5516-41ce-b9ac-d5ac6715d907 service neutron] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:29.112056 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4791ae-5516-41ce-b9ac-d5ac6715d907 service neutron] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:29.174961 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74add4f-9eb9-4393-a020-fee7987839d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:29.175972 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74add4f-9eb9-4393-a020-fee7987839d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:29.176253 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74add4f-9eb9-4393-a020-fee7987839d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:29.176525 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74add4f-9eb9-4393-a020-fee7987839d8 admin admin] PATH_INFO: `/v3/users/d49eec385eab451a84c44bfd4bf96e3b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:29.177669 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74add4f-9eb9-4393-a020-fee7987839d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d49eec385eab451a84c44bfd4bf96e3b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:29.180007 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74add4f-9eb9-4393-a020-fee7987839d8 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:29.186471 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:29.431324 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-f74add4f-9eb9-4393-a020-fee7987839d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd49eec385eab451a84c44bfd4bf96e3b'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:29.439229 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-f74add4f-9eb9-4393-a020-fee7987839d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd49eec385eab451a84c44bfd4bf96e3b'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:29.497866 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-f74add4f-9eb9-4393-a020-fee7987839d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd49eec385eab451a84c44bfd4bf96e3b'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:29.498438 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-f74add4f-9eb9-4393-a020-fee7987839d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd49eec385eab451a84c44bfd4bf96e3b'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:29.499065 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-f74add4f-9eb9-4393-a020-fee7987839d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd49eec385eab451a84c44bfd4bf96e3b'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:29.518232 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1209/2407] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:13:29 2022] DELETE /identity/v3/users/d49eec385eab451a84c44bfd4bf96e3b => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:13:29.951440 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a528ca-f29c-489d-bcfa-5735d3050ac2 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:29.952984 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-54a528ca-f29c-489d-bcfa-5735d3050ac2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:29.966326 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a528ca-f29c-489d-bcfa-5735d3050ac2 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:30.018225 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:30.031136 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e317d-7a66-451a-b7c6-e258f4a05f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:30.035009 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e317d-7a66-451a-b7c6-e258f4a05f34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:30.035009 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e317d-7a66-451a-b7c6-e258f4a05f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:30.035009 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e317d-7a66-451a-b7c6-e258f4a05f34 admin admin] PATH_INFO: `/v3/projects/bf647883c4ed4d258a353ea391aebfa4` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:30.035009 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e317d-7a66-451a-b7c6-e258f4a05f34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf647883c4ed4d258a353ea391aebfa4)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:30.035417 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e317d-7a66-451a-b7c6-e258f4a05f34 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:30.137181 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-711e317d-7a66-451a-b7c6-e258f4a05f34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf647883c4ed4d258a353ea391aebfa4', 'request_id': 'req-711e317d-7a66-451a-b7c6-e258f4a05f34'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:30.142532 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-711e317d-7a66-451a-b7c6-e258f4a05f34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf647883c4ed4d258a353ea391aebfa4', 'request_id': 'req-711e317d-7a66-451a-b7c6-e258f4a05f34'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:30.148883 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-711e317d-7a66-451a-b7c6-e258f4a05f34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf647883c4ed4d258a353ea391aebfa4', 'request_id': 'req-711e317d-7a66-451a-b7c6-e258f4a05f34'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:30.244430 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-711e317d-7a66-451a-b7c6-e258f4a05f34 admin admin] The token cache is being invalidate because project bf647883c4ed4d258a353ea391aebfa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:13:30.244716 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-711e317d-7a66-451a-b7c6-e258f4a05f34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:30.245348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-711e317d-7a66-451a-b7c6-e258f4a05f34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:30.247131 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1199/2408] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:13:29 2022] DELETE /identity/v3/projects/bf647883c4ed4d258a353ea391aebfa4 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:13:30.251484 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74add4f-9eb9-4393-a020-fee7987839d8 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:30.252965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-f74add4f-9eb9-4393-a020-fee7987839d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:30.272992 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74add4f-9eb9-4393-a020-fee7987839d8 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:30.332383 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c537d-3cf9-4c22-ac0b-0f79d5e11b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:30.333011 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c537d-3cf9-4c22-ac0b-0f79d5e11b99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:30.333291 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c537d-3cf9-4c22-ac0b-0f79d5e11b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:30.333561 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c537d-3cf9-4c22-ac0b-0f79d5e11b99 admin admin] PATH_INFO: `/v3/users/238b323a1fc0420fb518a903ac3ad899` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:30.334675 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c537d-3cf9-4c22-ac0b-0f79d5e11b99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=238b323a1fc0420fb518a903ac3ad899)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:30.336612 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c537d-3cf9-4c22-ac0b-0f79d5e11b99 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:30.518146 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-259c537d-3cf9-4c22-ac0b-0f79d5e11b99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '238b323a1fc0420fb518a903ac3ad899'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:30.525875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-259c537d-3cf9-4c22-ac0b-0f79d5e11b99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '238b323a1fc0420fb518a903ac3ad899'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:30.668993 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-259c537d-3cf9-4c22-ac0b-0f79d5e11b99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '238b323a1fc0420fb518a903ac3ad899'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:30.669616 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-259c537d-3cf9-4c22-ac0b-0f79d5e11b99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '238b323a1fc0420fb518a903ac3ad899'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:30.670255 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-259c537d-3cf9-4c22-ac0b-0f79d5e11b99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '238b323a1fc0420fb518a903ac3ad899'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:30.689239 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1210/2409] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:13:30 2022] DELETE /identity/v3/users/238b323a1fc0420fb518a903ac3ad899 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:13:31.220003 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e317d-7a66-451a-b7c6-e258f4a05f34 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:31.221840 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-711e317d-7a66-451a-b7c6-e258f4a05f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:31.239700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e317d-7a66-451a-b7c6-e258f4a05f34 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:31.310252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe4ef7-bb3c-4d8c-84ca-3374a34f408d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:31.310892 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe4ef7-bb3c-4d8c-84ca-3374a34f408d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:31.311198 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe4ef7-bb3c-4d8c-84ca-3374a34f408d admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:31.311465 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe4ef7-bb3c-4d8c-84ca-3374a34f408d admin admin] PATH_INFO: `/v3/projects/45446155f46f41aeb134f0376ce16f13` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:31.312579 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe4ef7-bb3c-4d8c-84ca-3374a34f408d admin admin] RBAC: Authorizing `identity:delete_project(project_id=45446155f46f41aeb134f0376ce16f13)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:31.314504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe4ef7-bb3c-4d8c-84ca-3374a34f408d admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:31.453717 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-c7fe4ef7-bb3c-4d8c-84ca-3374a34f408d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45446155f46f41aeb134f0376ce16f13', 'request_id': 'req-c7fe4ef7-bb3c-4d8c-84ca-3374a34f408d'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:31.459197 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-c7fe4ef7-bb3c-4d8c-84ca-3374a34f408d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45446155f46f41aeb134f0376ce16f13', 'request_id': 'req-c7fe4ef7-bb3c-4d8c-84ca-3374a34f408d'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:31.465981 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-c7fe4ef7-bb3c-4d8c-84ca-3374a34f408d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45446155f46f41aeb134f0376ce16f13', 'request_id': 'req-c7fe4ef7-bb3c-4d8c-84ca-3374a34f408d'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:31.554609 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-c7fe4ef7-bb3c-4d8c-84ca-3374a34f408d admin admin] The token cache is being invalidate because project 45446155f46f41aeb134f0376ce16f13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:13:31.554918 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-c7fe4ef7-bb3c-4d8c-84ca-3374a34f408d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:31.556084 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-c7fe4ef7-bb3c-4d8c-84ca-3374a34f408d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:31.561917 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1200/2410] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:13:31 2022] DELETE /identity/v3/projects/45446155f46f41aeb134f0376ce16f13 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:13:31.563909 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e49f74-3451-4a0f-ad1a-84fe46ec5387 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:31.564369 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e49f74-3451-4a0f-ad1a-84fe46ec5387 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:31.564495 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e49f74-3451-4a0f-ad1a-84fe46ec5387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:31.573130 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:31.584718 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-90e49f74-3451-4a0f-ad1a-84fe46ec5387 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:13:31.585930 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-90e49f74-3451-4a0f-ad1a-84fe46ec5387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:31.652001 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1211/2411] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:13:31.661884 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d5742-8037-4eb2-9d1d-676b69b11205 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:31.662105 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d5742-8037-4eb2-9d1d-676b69b11205 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:31.662318 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435d5742-8037-4eb2-9d1d-676b69b11205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:31.679167 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:31.686143 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-435d5742-8037-4eb2-9d1d-676b69b11205 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:13:31.687712 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-435d5742-8037-4eb2-9d1d-676b69b11205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:31.698301 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1201/2412] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:13:31.702911 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e49f74-3451-4a0f-ad1a-84fe46ec5387 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:31.713726 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e49f74-3451-4a0f-ad1a-84fe46ec5387 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:31.720019 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183e7ff-e429-4211-a783-abee3715e8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:31.721028 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183e7ff-e429-4211-a783-abee3715e8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:31.721460 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183e7ff-e429-4211-a783-abee3715e8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:31.721879 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183e7ff-e429-4211-a783-abee3715e8d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:31.722702 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183e7ff-e429-4211-a783-abee3715e8d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:13:31.723177 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183e7ff-e429-4211-a783-abee3715e8d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:31.725202 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183e7ff-e429-4211-a783-abee3715e8d1 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:31.741222 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1212/2413] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:13:31.747046 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d5742-8037-4eb2-9d1d-676b69b11205 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:31.759861 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435d5742-8037-4eb2-9d1d-676b69b11205 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:31.765033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c32bd9-c16e-4f8d-be91-56e8d511b58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:31.765655 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c32bd9-c16e-4f8d-be91-56e8d511b58f admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:31.771912 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c32bd9-c16e-4f8d-be91-56e8d511b58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:31.771912 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c32bd9-c16e-4f8d-be91-56e8d511b58f admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:31.771912 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c32bd9-c16e-4f8d-be91-56e8d511b58f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:31.771912 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c32bd9-c16e-4f8d-be91-56e8d511b58f admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:31.944159 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1202/2414] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:13:31 2022] POST /identity/v3/projects => generated 375 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:13:31.945373 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183e7ff-e429-4211-a783-abee3715e8d1 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:31.956646 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183e7ff-e429-4211-a783-abee3715e8d1 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:32.017715 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798e9d9-0890-4c3f-93f9-05d87a0dcc22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:32.018318 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798e9d9-0890-4c3f-93f9-05d87a0dcc22 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:32.018598 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798e9d9-0890-4c3f-93f9-05d87a0dcc22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:32.018874 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798e9d9-0890-4c3f-93f9-05d87a0dcc22 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:32.019520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798e9d9-0890-4c3f-93f9-05d87a0dcc22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:32.021443 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798e9d9-0890-4c3f-93f9-05d87a0dcc22 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:32.120430 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1213/2415] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:13:31 2022] POST /identity/v3/users => generated 288 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:13:32.125355 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c32bd9-c16e-4f8d-be91-56e8d511b58f admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:32.137419 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c32bd9-c16e-4f8d-be91-56e8d511b58f admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:32.142275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ad82b-ad30-4873-a0d6-c8d297c29f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:32.142904 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ad82b-ad30-4873-a0d6-c8d297c29f41 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:32.143211 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ad82b-ad30-4873-a0d6-c8d297c29f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:32.143482 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ad82b-ad30-4873-a0d6-c8d297c29f41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:32.144143 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ad82b-ad30-4873-a0d6-c8d297c29f41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:32.145744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766ad82b-ad30-4873-a0d6-c8d297c29f41 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:32.156261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1203/2416] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:13:32.160505 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798e9d9-0890-4c3f-93f9-05d87a0dcc22 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:32.172780 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798e9d9-0890-4c3f-93f9-05d87a0dcc22 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:32.175714 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daacaba1-45f7-42b1-b1ef-f0d542009025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:32.176380 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daacaba1-45f7-42b1-b1ef-f0d542009025 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:32.176650 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daacaba1-45f7-42b1-b1ef-f0d542009025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:32.176934 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daacaba1-45f7-42b1-b1ef-f0d542009025 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:32.177554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daacaba1-45f7-42b1-b1ef-f0d542009025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:32.179166 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daacaba1-45f7-42b1-b1ef-f0d542009025 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:32.190145 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1214/2417] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:13:32.194431 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ad82b-ad30-4873-a0d6-c8d297c29f41 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:32.205246 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ad82b-ad30-4873-a0d6-c8d297c29f41 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:32.209871 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e238d64-c79d-44e1-9981-8727f099ff3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:32.210515 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e238d64-c79d-44e1-9981-8727f099ff3d admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:32.210795 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e238d64-c79d-44e1-9981-8727f099ff3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:32.211074 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e238d64-c79d-44e1-9981-8727f099ff3d admin admin] PATH_INFO: `/v3/projects/7011a034c5aa4abba8b9f7524eb816f0/users/19871c5e81714ddbaaa2c79bc2836031/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:32.226279 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e238d64-c79d-44e1-9981-8727f099ff3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7011a034c5aa4abba8b9f7524eb816f0, user_id=19871c5e81714ddbaaa2c79bc2836031, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:32.229021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e238d64-c79d-44e1-9981-8727f099ff3d admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:32.303090 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1204/2418] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:13:32 2022] PUT /identity/v3/projects/7011a034c5aa4abba8b9f7524eb816f0/users/19871c5e81714ddbaaa2c79bc2836031/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:13:32.374809 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc035a4-c9d4-428f-b77c-a483879fd4a8 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:32.375095 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc035a4-c9d4-428f-b77c-a483879fd4a8 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:32.375403 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc035a4-c9d4-428f-b77c-a483879fd4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:32.404921 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-7cc035a4-c9d4-428f-b77c-a483879fd4a8 None None] MFA Rules not processed for user `19871c5e81714ddbaaa2c79bc2836031`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:13:32.406160 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-7cc035a4-c9d4-428f-b77c-a483879fd4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:32.468505 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:32.472377 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1215/2419] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:13:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:13:32.483869 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e238d64-c79d-44e1-9981-8727f099ff3d admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:32.485594 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-0e238d64-c79d-44e1-9981-8727f099ff3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:32.544156 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e238d64-c79d-44e1-9981-8727f099ff3d admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:32.547813 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce77a4-a751-417e-8813-162d7311eb8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:32.548417 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce77a4-a751-417e-8813-162d7311eb8a service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:32.552025 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce77a4-a751-417e-8813-162d7311eb8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:32.552025 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce77a4-a751-417e-8813-162d7311eb8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:32.557344 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce77a4-a751-417e-8813-162d7311eb8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:32.558871 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcce77a4-a751-417e-8813-162d7311eb8a service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:32.567679 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1205/2420] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:13:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:13:33.900785 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8416e-ee40-4ff8-a1b4-93226afd7684 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:33.901264 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8416e-ee40-4ff8-a1b4-93226afd7684 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:33.901371 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d8416e-ee40-4ff8-a1b4-93226afd7684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:33.921995 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-75d8416e-ee40-4ff8-a1b4-93226afd7684 None None] MFA Rules not processed for user `ae9fc5f06a0441da80e656fa1e88db5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:13:33.923346 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-75d8416e-ee40-4ff8-a1b4-93226afd7684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:33.986302 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1216/2421] 10.222.0.55 () {58 vars in 967 bytes} [Wed Aug 24 17:13:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:13:33.999809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce77a4-a751-417e-8813-162d7311eb8a service cinder] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:34.001469 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-dcce77a4-a751-417e-8813-162d7311eb8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:34.076417 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce77a4-a751-417e-8813-162d7311eb8a service cinder] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:34.081416 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aee87e-e099-4cd7-81a7-396413370e00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c067bc2d84b741d08ac47e40adae4b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:34.082084 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aee87e-e099-4cd7-81a7-396413370e00 service swift] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:34.082363 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aee87e-e099-4cd7-81a7-396413370e00 service swift] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:34.082635 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aee87e-e099-4cd7-81a7-396413370e00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:34.092696 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aee87e-e099-4cd7-81a7-396413370e00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:34.094329 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aee87e-e099-4cd7-81a7-396413370e00 service swift] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:34.103585 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1206/2422] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Aug 24 17:13:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 17:13:34.351083 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5d963-db1c-4a24-82de-9d0a956bebc5 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:34.351410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5d963-db1c-4a24-82de-9d0a956bebc5 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:34.351686 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5d963-db1c-4a24-82de-9d0a956bebc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:34.371175 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-cbe5d963-db1c-4a24-82de-9d0a956bebc5 None None] MFA Rules not processed for user `19871c5e81714ddbaaa2c79bc2836031`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:13:34.372423 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-cbe5d963-db1c-4a24-82de-9d0a956bebc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:34.379393 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1217/2423] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:13:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:13:36.755965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aee87e-e099-4cd7-81a7-396413370e00 service swift] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:36.757359 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-70aee87e-e099-4cd7-81a7-396413370e00 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:36.798280 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:36.828050 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aee87e-e099-4cd7-81a7-396413370e00 service swift] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:36.833190 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d043ea-52d4-4b8a-84fa-b1dc2d0df077 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ef97356edf406aad9ab5f502bdb0af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:36.833797 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d043ea-52d4-4b8a-84fa-b1dc2d0df077 service placement] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:36.834077 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d043ea-52d4-4b8a-84fa-b1dc2d0df077 service placement] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:36.834350 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d043ea-52d4-4b8a-84fa-b1dc2d0df077 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:36.836142 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-63d043ea-52d4-4b8a-84fa-b1dc2d0df077 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:36.848561 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d043ea-52d4-4b8a-84fa-b1dc2d0df077 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:36.850167 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d043ea-52d4-4b8a-84fa-b1dc2d0df077 service placement] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:36.862182 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1207/2424] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:13:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:13:44.365762 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=28 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:46.897435 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=16 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:48.974006 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5d963-db1c-4a24-82de-9d0a956bebc5 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:48.975543 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-cbe5d963-db1c-4a24-82de-9d0a956bebc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:49.046761 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5d963-db1c-4a24-82de-9d0a956bebc5 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:49.051737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf84b2c-a696-4ee8-847b-7554d24c2278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:49.052493 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf84b2c-a696-4ee8-847b-7554d24c2278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:49.052840 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf84b2c-a696-4ee8-847b-7554d24c2278 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:49.053120 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf84b2c-a696-4ee8-847b-7554d24c2278 admin admin] PATH_INFO: `/v3/users/14dcdf67d4d34156b1fa6dcd9571aa95` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:49.054276 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf84b2c-a696-4ee8-847b-7554d24c2278 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14dcdf67d4d34156b1fa6dcd9571aa95)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:49.056323 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf84b2c-a696-4ee8-847b-7554d24c2278 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:49.278254 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-bcf84b2c-a696-4ee8-847b-7554d24c2278 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14dcdf67d4d34156b1fa6dcd9571aa95'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:49.286250 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-bcf84b2c-a696-4ee8-847b-7554d24c2278 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14dcdf67d4d34156b1fa6dcd9571aa95'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:49.392968 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-bcf84b2c-a696-4ee8-847b-7554d24c2278 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14dcdf67d4d34156b1fa6dcd9571aa95'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:49.393604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-bcf84b2c-a696-4ee8-847b-7554d24c2278 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14dcdf67d4d34156b1fa6dcd9571aa95'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:49.394312 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-bcf84b2c-a696-4ee8-847b-7554d24c2278 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14dcdf67d4d34156b1fa6dcd9571aa95'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:49.413847 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1218/2425] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:13:48 2022] DELETE /identity/v3/users/14dcdf67d4d34156b1fa6dcd9571aa95 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:13:49.680237 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d043ea-52d4-4b8a-84fa-b1dc2d0df077 service placement] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:49.691605 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d043ea-52d4-4b8a-84fa-b1dc2d0df077 service placement] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:49.753022 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece42c9d-e8cc-4fea-b01f-b219a92eb669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:49.753659 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece42c9d-e8cc-4fea-b01f-b219a92eb669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:49.753937 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece42c9d-e8cc-4fea-b01f-b219a92eb669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:49.754208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece42c9d-e8cc-4fea-b01f-b219a92eb669 admin admin] PATH_INFO: `/v3/projects/47b6f105989f41a7b4a56be357f583f1` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:49.755365 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece42c9d-e8cc-4fea-b01f-b219a92eb669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47b6f105989f41a7b4a56be357f583f1)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:49.757261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece42c9d-e8cc-4fea-b01f-b219a92eb669 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:49.887707 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-ece42c9d-e8cc-4fea-b01f-b219a92eb669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47b6f105989f41a7b4a56be357f583f1', 'request_id': 'req-ece42c9d-e8cc-4fea-b01f-b219a92eb669'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:49.894958 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-ece42c9d-e8cc-4fea-b01f-b219a92eb669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47b6f105989f41a7b4a56be357f583f1', 'request_id': 'req-ece42c9d-e8cc-4fea-b01f-b219a92eb669'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:49.901837 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-ece42c9d-e8cc-4fea-b01f-b219a92eb669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47b6f105989f41a7b4a56be357f583f1', 'request_id': 'req-ece42c9d-e8cc-4fea-b01f-b219a92eb669'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:50.022022 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-ece42c9d-e8cc-4fea-b01f-b219a92eb669 admin admin] The token cache is being invalidate because project 47b6f105989f41a7b4a56be357f583f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:13:50.022022 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-ece42c9d-e8cc-4fea-b01f-b219a92eb669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:50.022022 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-ece42c9d-e8cc-4fea-b01f-b219a92eb669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:50.022022 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1208/2426] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:13:49 2022] DELETE /identity/v3/projects/47b6f105989f41a7b4a56be357f583f1 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:13:50.025679 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf84b2c-a696-4ee8-847b-7554d24c2278 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:50.027305 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-bcf84b2c-a696-4ee8-847b-7554d24c2278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:50.041879 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf84b2c-a696-4ee8-847b-7554d24c2278 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:50.101550 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c303dc-737d-4703-baf3-1b490d7226e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:50.102169 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c303dc-737d-4703-baf3-1b490d7226e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:50.102445 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c303dc-737d-4703-baf3-1b490d7226e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:50.102715 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c303dc-737d-4703-baf3-1b490d7226e1 admin admin] PATH_INFO: `/v3/users/55d3c39383194941a41852f160e9dde4` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:50.103850 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c303dc-737d-4703-baf3-1b490d7226e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55d3c39383194941a41852f160e9dde4)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:50.106157 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c303dc-737d-4703-baf3-1b490d7226e1 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:50.129901 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:50.329509 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-33c303dc-737d-4703-baf3-1b490d7226e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55d3c39383194941a41852f160e9dde4'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:50.337293 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-33c303dc-737d-4703-baf3-1b490d7226e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55d3c39383194941a41852f160e9dde4'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:50.417879 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-33c303dc-737d-4703-baf3-1b490d7226e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55d3c39383194941a41852f160e9dde4'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:50.418693 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-33c303dc-737d-4703-baf3-1b490d7226e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55d3c39383194941a41852f160e9dde4'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:50.419437 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-33c303dc-737d-4703-baf3-1b490d7226e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55d3c39383194941a41852f160e9dde4'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:50.439721 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1219/2427] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:13:50 2022] DELETE /identity/v3/users/55d3c39383194941a41852f160e9dde4 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:13:50.767141 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece42c9d-e8cc-4fea-b01f-b219a92eb669 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:50.768901 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-ece42c9d-e8cc-4fea-b01f-b219a92eb669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:50.786471 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece42c9d-e8cc-4fea-b01f-b219a92eb669 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:50.871986 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07359f09-eae5-4e9a-856d-58a4aeca2dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:50.873036 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07359f09-eae5-4e9a-856d-58a4aeca2dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:50.874009 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07359f09-eae5-4e9a-856d-58a4aeca2dac admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:50.874009 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07359f09-eae5-4e9a-856d-58a4aeca2dac admin admin] PATH_INFO: `/v3/projects/57affd7bc716407d8134b1c7d6bd1963` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:50.876987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07359f09-eae5-4e9a-856d-58a4aeca2dac admin admin] RBAC: Authorizing `identity:delete_project(project_id=57affd7bc716407d8134b1c7d6bd1963)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:50.880572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07359f09-eae5-4e9a-856d-58a4aeca2dac admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:51.043027 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:51.058275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-07359f09-eae5-4e9a-856d-58a4aeca2dac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57affd7bc716407d8134b1c7d6bd1963', 'request_id': 'req-07359f09-eae5-4e9a-856d-58a4aeca2dac'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:51.064402 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-07359f09-eae5-4e9a-856d-58a4aeca2dac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57affd7bc716407d8134b1c7d6bd1963', 'request_id': 'req-07359f09-eae5-4e9a-856d-58a4aeca2dac'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:51.071477 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-07359f09-eae5-4e9a-856d-58a4aeca2dac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57affd7bc716407d8134b1c7d6bd1963', 'request_id': 'req-07359f09-eae5-4e9a-856d-58a4aeca2dac'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:51.161774 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-07359f09-eae5-4e9a-856d-58a4aeca2dac admin admin] The token cache is being invalidate because project 57affd7bc716407d8134b1c7d6bd1963 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:13:51.162123 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-07359f09-eae5-4e9a-856d-58a4aeca2dac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:51.162810 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-07359f09-eae5-4e9a-856d-58a4aeca2dac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:51.167190 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1209/2428] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:13:50 2022] DELETE /identity/v3/projects/57affd7bc716407d8134b1c7d6bd1963 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:13:51.170412 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5977e-a20a-41a3-b2f8-e8366ed1610e None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:51.170984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5977e-a20a-41a3-b2f8-e8366ed1610e None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:51.171519 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5977e-a20a-41a3-b2f8-e8366ed1610e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:51.198519 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-88d5977e-a20a-41a3-b2f8-e8366ed1610e None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:13:51.199784 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-88d5977e-a20a-41a3-b2f8-e8366ed1610e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:51.293301 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1220/2429] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:13:51.308420 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd67a06-6be8-4cd2-9f73-315cce584e9e None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:51.308837 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd67a06-6be8-4cd2-9f73-315cce584e9e None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:51.308984 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd67a06-6be8-4cd2-9f73-315cce584e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:51.340012 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-5dd67a06-6be8-4cd2-9f73-315cce584e9e None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:13:51.341952 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-5dd67a06-6be8-4cd2-9f73-315cce584e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:51.362232 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5977e-a20a-41a3-b2f8-e8366ed1610e None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:51.367416 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1210/2430] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:13:51.374006 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5977e-a20a-41a3-b2f8-e8366ed1610e None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:51.381491 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f9a5e-a758-412c-bc64-1287417c337d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:51.386149 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f9a5e-a758-412c-bc64-1287417c337d admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:51.386571 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f9a5e-a758-412c-bc64-1287417c337d admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:51.386852 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f9a5e-a758-412c-bc64-1287417c337d admin admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:51.387575 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f9a5e-a758-412c-bc64-1287417c337d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:13:51.387918 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f9a5e-a758-412c-bc64-1287417c337d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:51.389628 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26f9a5e-a758-412c-bc64-1287417c337d admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:51.427416 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1221/2431] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:13:51.430301 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd67a06-6be8-4cd2-9f73-315cce584e9e None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:51.447196 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd67a06-6be8-4cd2-9f73-315cce584e9e None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:51.474469 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f81133-1b3a-4407-88e8-5842f8b04fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:51.475509 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f81133-1b3a-4407-88e8-5842f8b04fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:51.483425 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f81133-1b3a-4407-88e8-5842f8b04fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:51.483891 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f81133-1b3a-4407-88e8-5842f8b04fc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:51.484600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f81133-1b3a-4407-88e8-5842f8b04fc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:51.486624 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f81133-1b3a-4407-88e8-5842f8b04fc4 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:51.591022 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1211/2432] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:13:51 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:13:51.595533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f9a5e-a758-412c-bc64-1287417c337d admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:51.605998 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26f9a5e-a758-412c-bc64-1287417c337d admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:51.712219 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc693b33-7c31-4df1-b9b7-f87b1e78b183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:51.712860 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc693b33-7c31-4df1-b9b7-f87b1e78b183 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:51.713116 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc693b33-7c31-4df1-b9b7-f87b1e78b183 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:51.713386 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc693b33-7c31-4df1-b9b7-f87b1e78b183 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:51.714105 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc693b33-7c31-4df1-b9b7-f87b1e78b183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:51.716109 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc693b33-7c31-4df1-b9b7-f87b1e78b183 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:51.789814 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1222/2433] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:13:51 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:13:51.794169 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f81133-1b3a-4407-88e8-5842f8b04fc4 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:51.805364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f81133-1b3a-4407-88e8-5842f8b04fc4 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:51.810121 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1adf68-d430-4868-960f-81331186365d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:51.810835 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1adf68-d430-4868-960f-81331186365d admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:51.811200 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1adf68-d430-4868-960f-81331186365d admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:51.811473 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1adf68-d430-4868-960f-81331186365d admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:51.812150 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1adf68-d430-4868-960f-81331186365d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:51.813753 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1adf68-d430-4868-960f-81331186365d admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:51.825058 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1212/2434] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:13:51.829685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc693b33-7c31-4df1-b9b7-f87b1e78b183 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:51.840608 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc693b33-7c31-4df1-b9b7-f87b1e78b183 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:51.847633 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7897a6d0-81f3-4104-9d6e-d278a6d442af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:51.848251 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897a6d0-81f3-4104-9d6e-d278a6d442af admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:51.848718 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897a6d0-81f3-4104-9d6e-d278a6d442af admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:51.848996 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7897a6d0-81f3-4104-9d6e-d278a6d442af admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:51.849740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897a6d0-81f3-4104-9d6e-d278a6d442af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:51.851535 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7897a6d0-81f3-4104-9d6e-d278a6d442af admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:51.865077 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1223/2435] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:13:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:13:51.869681 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1adf68-d430-4868-960f-81331186365d admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:51.881054 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1adf68-d430-4868-960f-81331186365d admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:51.886088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696b82a-f130-45e2-ab32-9317d581492e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:51.886987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696b82a-f130-45e2-ab32-9317d581492e admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:51.887303 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696b82a-f130-45e2-ab32-9317d581492e admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:51.887577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696b82a-f130-45e2-ab32-9317d581492e admin admin] PATH_INFO: `/v3/projects/4987acb8951c434b8bcc6c54e83d45e1/users/88d81883bc0b4ef48ac2d516cf13f662/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:51.906504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696b82a-f130-45e2-ab32-9317d581492e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4987acb8951c434b8bcc6c54e83d45e1, user_id=88d81883bc0b4ef48ac2d516cf13f662, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:51.909955 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696b82a-f130-45e2-ab32-9317d581492e admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:52.213222 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1213/2436] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:13:51 2022] PUT /identity/v3/projects/4987acb8951c434b8bcc6c54e83d45e1/users/88d81883bc0b4ef48ac2d516cf13f662/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:13:52.225793 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d598b8-39f3-4807-9a5c-a65d3d92ac40 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:52.225793 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d598b8-39f3-4807-9a5c-a65d3d92ac40 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:52.226412 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d598b8-39f3-4807-9a5c-a65d3d92ac40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:52.235507 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:52.259229 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-d4d598b8-39f3-4807-9a5c-a65d3d92ac40 None None] MFA Rules not processed for user `88d81883bc0b4ef48ac2d516cf13f662`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:13:52.260063 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-d4d598b8-39f3-4807-9a5c-a65d3d92ac40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:52.354859 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1224/2437] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:13:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:13:52.369809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696b82a-f130-45e2-ab32-9317d581492e admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:52.371610 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-5696b82a-f130-45e2-ab32-9317d581492e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:52.440903 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696b82a-f130-45e2-ab32-9317d581492e admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:52.446012 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23bb63-6efc-49f7-bf76-7ebb9a5061dd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6aad0e9f5f4a0b9578a31082e726cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:52.447873 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23bb63-6efc-49f7-bf76-7ebb9a5061dd service glance] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:52.448173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23bb63-6efc-49f7-bf76-7ebb9a5061dd service glance] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:52.448466 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23bb63-6efc-49f7-bf76-7ebb9a5061dd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:52.460740 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23bb63-6efc-49f7-bf76-7ebb9a5061dd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:52.462189 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23bb63-6efc-49f7-bf76-7ebb9a5061dd service glance] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:52.473945 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1214/2438] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:13:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:13:53.679812 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675a135-f459-4b33-91d9-1ae4d440cf96 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:53.680811 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675a135-f459-4b33-91d9-1ae4d440cf96 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:53.681305 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675a135-f459-4b33-91d9-1ae4d440cf96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:53.704533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-7675a135-f459-4b33-91d9-1ae4d440cf96 None None] MFA Rules not processed for user `ae9fc5f06a0441da80e656fa1e88db5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:13:53.706468 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-7675a135-f459-4b33-91d9-1ae4d440cf96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:53.769413 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1225/2439] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Aug 24 17:13:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:13:53.799174 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23bb63-6efc-49f7-bf76-7ebb9a5061dd service glance] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:53.800748 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-df23bb63-6efc-49f7-bf76-7ebb9a5061dd service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:53.883307 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:53.889274 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23bb63-6efc-49f7-bf76-7ebb9a5061dd service glance] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:53.900798 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb158c72-3ba2-4d2d-83c6-3a457ecebfee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c067bc2d84b741d08ac47e40adae4b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:53.901420 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb158c72-3ba2-4d2d-83c6-3a457ecebfee service swift] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:53.901697 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb158c72-3ba2-4d2d-83c6-3a457ecebfee service swift] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:53.902159 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb158c72-3ba2-4d2d-83c6-3a457ecebfee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:53.911759 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb158c72-3ba2-4d2d-83c6-3a457ecebfee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:53.913405 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb158c72-3ba2-4d2d-83c6-3a457ecebfee service swift] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:53.921344 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1215/2440] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Aug 24 17:13:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:13:55.015184 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e513af-11b6-431c-8113-8807804321bd None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:55.015693 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e513af-11b6-431c-8113-8807804321bd None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:55.015795 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e513af-11b6-431c-8113-8807804321bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:55.037528 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-88e513af-11b6-431c-8113-8807804321bd None None] MFA Rules not processed for user `ae9fc5f06a0441da80e656fa1e88db5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:13:55.038847 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-88e513af-11b6-431c-8113-8807804321bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:55.046295 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1226/2441] 10.222.0.55 () {58 vars in 967 bytes} [Wed Aug 24 17:13:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:13:55.059492 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb158c72-3ba2-4d2d-83c6-3a457ecebfee service swift] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:55.070320 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb158c72-3ba2-4d2d-83c6-3a457ecebfee service swift] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:55.075816 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df6fe4-9a42-4f4b-9ab3-0bfd32788a1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c067bc2d84b741d08ac47e40adae4b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:55.076452 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df6fe4-9a42-4f4b-9ab3-0bfd32788a1b service swift] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:55.080526 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df6fe4-9a42-4f4b-9ab3-0bfd32788a1b service swift] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:55.080526 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9df6fe4-9a42-4f4b-9ab3-0bfd32788a1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:55.091736 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df6fe4-9a42-4f4b-9ab3-0bfd32788a1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:55.093648 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9df6fe4-9a42-4f4b-9ab3-0bfd32788a1b service swift] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:55.103758 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1216/2442] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Aug 24 17:13:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:13:55.783780 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4044803-d5bd-4f7f-8ac9-84cb43a79050 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:55.784084 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4044803-d5bd-4f7f-8ac9-84cb43a79050 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:55.784359 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4044803-d5bd-4f7f-8ac9-84cb43a79050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:55.804955 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-a4044803-d5bd-4f7f-8ac9-84cb43a79050 None None] MFA Rules not processed for user `ae9fc5f06a0441da80e656fa1e88db5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:13:55.806160 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-a4044803-d5bd-4f7f-8ac9-84cb43a79050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:55.815934 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1227/2443] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Aug 24 17:13:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:13:55.827852 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df6fe4-9a42-4f4b-9ab3-0bfd32788a1b service swift] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:55.839477 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9df6fe4-9a42-4f4b-9ab3-0bfd32788a1b service swift] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:55.845439 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856a1c6-815d-4706-b6da-6bb1fd43a214 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c067bc2d84b741d08ac47e40adae4b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:55.850101 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856a1c6-815d-4706-b6da-6bb1fd43a214 service swift] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:55.850101 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856a1c6-815d-4706-b6da-6bb1fd43a214 service swift] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:55.850101 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3856a1c6-815d-4706-b6da-6bb1fd43a214 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:55.855273 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856a1c6-815d-4706-b6da-6bb1fd43a214 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:55.856877 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3856a1c6-815d-4706-b6da-6bb1fd43a214 service swift] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:55.869133 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1217/2444] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Aug 24 17:13:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:13:56.510081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b4e46-e912-4297-b143-dfe71976a2bb None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:56.510577 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b4e46-e912-4297-b143-dfe71976a2bb None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:56.510687 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b4e46-e912-4297-b143-dfe71976a2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:56.531308 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-f34b4e46-e912-4297-b143-dfe71976a2bb None None] MFA Rules not processed for user `ae9fc5f06a0441da80e656fa1e88db5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:13:56.533198 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-f34b4e46-e912-4297-b143-dfe71976a2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:56.540703 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1228/2445] 10.222.0.55 () {58 vars in 967 bytes} [Wed Aug 24 17:13:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:13:56.553064 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856a1c6-815d-4706-b6da-6bb1fd43a214 service swift] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:56.563671 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3856a1c6-815d-4706-b6da-6bb1fd43a214 service swift] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:56.568793 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9cb752-9407-4dd0-8742-4761cff59ef6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c067bc2d84b741d08ac47e40adae4b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:56.569405 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cb752-9407-4dd0-8742-4761cff59ef6 service swift] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:56.569685 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cb752-9407-4dd0-8742-4761cff59ef6 service swift] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:56.570127 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cb752-9407-4dd0-8742-4761cff59ef6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:56.579492 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9cb752-9407-4dd0-8742-4761cff59ef6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:56.581090 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9cb752-9407-4dd0-8742-4761cff59ef6 service swift] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:56.589224 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1218/2446] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Aug 24 17:13:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:13:59.397690 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b4e46-e912-4297-b143-dfe71976a2bb None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:59.399171 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-f34b4e46-e912-4297-b143-dfe71976a2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:59.481742 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b4e46-e912-4297-b143-dfe71976a2bb None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:13:59.487592 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b0454-e706-48dc-b033-ff37730ba16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:13:59.488238 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b0454-e706-48dc-b033-ff37730ba16b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:59.488625 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b0454-e706-48dc-b033-ff37730ba16b admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:59.488901 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3b0454-e706-48dc-b033-ff37730ba16b admin admin] PATH_INFO: `/v3/users/19871c5e81714ddbaaa2c79bc2836031` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:59.490074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b0454-e706-48dc-b033-ff37730ba16b admin admin] RBAC: Authorizing `identity:delete_user(user_id=19871c5e81714ddbaaa2c79bc2836031)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:13:59.493904 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3b0454-e706-48dc-b033-ff37730ba16b admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:13:59.525791 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:13:59.711344 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-3e3b0454-e706-48dc-b033-ff37730ba16b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19871c5e81714ddbaaa2c79bc2836031'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:59.720514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-3e3b0454-e706-48dc-b033-ff37730ba16b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19871c5e81714ddbaaa2c79bc2836031'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:59.773068 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-3e3b0454-e706-48dc-b033-ff37730ba16b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19871c5e81714ddbaaa2c79bc2836031'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:59.774121 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-3e3b0454-e706-48dc-b033-ff37730ba16b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19871c5e81714ddbaaa2c79bc2836031'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:59.774881 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-3e3b0454-e706-48dc-b033-ff37730ba16b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19871c5e81714ddbaaa2c79bc2836031'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:13:59.817675 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1229/2447] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:13:59 2022] DELETE /identity/v3/users/19871c5e81714ddbaaa2c79bc2836031 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:13:59.817827 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f110cbb-5fa0-48b0-998c-5e8c3c5a398e None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:13:59.817827 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f110cbb-5fa0-48b0-998c-5e8c3c5a398e None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:13:59.817827 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f110cbb-5fa0-48b0-998c-5e8c3c5a398e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:13:59.831968 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-3f110cbb-5fa0-48b0-998c-5e8c3c5a398e None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:13:59.833184 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-3f110cbb-5fa0-48b0-998c-5e8c3c5a398e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:13:59.911849 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1219/2448] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:13:59.933154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b0454-e706-48dc-b033-ff37730ba16b admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:13:59.935930 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-3e3b0454-e706-48dc-b033-ff37730ba16b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:14:00.007556 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3b0454-e706-48dc-b033-ff37730ba16b admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:14:00.011784 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f54cce-565f-42c3-83d7-01fd072b8b84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:14:00.012389 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f54cce-565f-42c3-83d7-01fd072b8b84 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:00.012665 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f54cce-565f-42c3-83d7-01fd072b8b84 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:00.012933 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f54cce-565f-42c3-83d7-01fd072b8b84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:00.023580 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f54cce-565f-42c3-83d7-01fd072b8b84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:14:00.025008 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f54cce-565f-42c3-83d7-01fd072b8b84 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:14:00.036630 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1230/2449] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:13:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:14:00.284387 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f110cbb-5fa0-48b0-998c-5e8c3c5a398e None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:14:00.285957 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-3f110cbb-5fa0-48b0-998c-5e8c3c5a398e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:14:00.299323 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f110cbb-5fa0-48b0-998c-5e8c3c5a398e None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:14:00.305484 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580908e-ec6b-44b0-8fda-188eba1a06c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:14:00.306080 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580908e-ec6b-44b0-8fda-188eba1a06c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:00.306468 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580908e-ec6b-44b0-8fda-188eba1a06c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:00.306681 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580908e-ec6b-44b0-8fda-188eba1a06c7 admin admin] PATH_INFO: `/v3/projects/7011a034c5aa4abba8b9f7524eb816f0` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:00.312582 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6580908e-ec6b-44b0-8fda-188eba1a06c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7011a034c5aa4abba8b9f7524eb816f0)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:14:00.312582 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6580908e-ec6b-44b0-8fda-188eba1a06c7 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:14:00.429190 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-6580908e-ec6b-44b0-8fda-188eba1a06c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7011a034c5aa4abba8b9f7524eb816f0', 'request_id': 'req-6580908e-ec6b-44b0-8fda-188eba1a06c7'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:14:00.434999 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-6580908e-ec6b-44b0-8fda-188eba1a06c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7011a034c5aa4abba8b9f7524eb816f0', 'request_id': 'req-6580908e-ec6b-44b0-8fda-188eba1a06c7'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:14:00.441760 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-6580908e-ec6b-44b0-8fda-188eba1a06c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7011a034c5aa4abba8b9f7524eb816f0', 'request_id': 'req-6580908e-ec6b-44b0-8fda-188eba1a06c7'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:14:00.497849 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-6580908e-ec6b-44b0-8fda-188eba1a06c7 admin admin] The token cache is being invalidate because project 7011a034c5aa4abba8b9f7524eb816f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:14:00.498053 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-6580908e-ec6b-44b0-8fda-188eba1a06c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:14:00.498716 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-6580908e-ec6b-44b0-8fda-188eba1a06c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:14:00.500801 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1220/2450] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:14:00 2022] DELETE /identity/v3/projects/7011a034c5aa4abba8b9f7524eb816f0 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:14:03.586291 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a52815-f1f8-48af-b495-15700c8126be None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:03.586861 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a52815-f1f8-48af-b495-15700c8126be None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:03.587240 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a52815-f1f8-48af-b495-15700c8126be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:03.606865 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-c6a52815-f1f8-48af-b495-15700c8126be None None] MFA Rules not processed for user `2cad680ebdab4fd4996f39f2e08eabb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:14:03.608106 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-c6a52815-f1f8-48af-b495-15700c8126be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:14:03.664734 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1231/2451] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:14:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:14:09.417578 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580908e-ec6b-44b0-8fda-188eba1a06c7 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:14:09.419028 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-6580908e-ec6b-44b0-8fda-188eba1a06c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:14:09.454905 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:14:09.483953 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580908e-ec6b-44b0-8fda-188eba1a06c7 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:14:09.489194 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710cff0-4e2d-4952-8027-920c0a60bcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:14:09.489992 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710cff0-4e2d-4952-8027-920c0a60bcaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:09.490862 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710cff0-4e2d-4952-8027-920c0a60bcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:09.491397 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710cff0-4e2d-4952-8027-920c0a60bcaf admin admin] PATH_INFO: `/v3/users/88d81883bc0b4ef48ac2d516cf13f662` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:09.492432 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2710cff0-4e2d-4952-8027-920c0a60bcaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=88d81883bc0b4ef48ac2d516cf13f662)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:14:09.494414 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2710cff0-4e2d-4952-8027-920c0a60bcaf admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:14:09.705693 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-2710cff0-4e2d-4952-8027-920c0a60bcaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88d81883bc0b4ef48ac2d516cf13f662'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:14:09.706275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-2710cff0-4e2d-4952-8027-920c0a60bcaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88d81883bc0b4ef48ac2d516cf13f662'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:14:09.713359 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-2710cff0-4e2d-4952-8027-920c0a60bcaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88d81883bc0b4ef48ac2d516cf13f662'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:14:09.713998 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-2710cff0-4e2d-4952-8027-920c0a60bcaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88d81883bc0b4ef48ac2d516cf13f662'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:14:09.783957 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-2710cff0-4e2d-4952-8027-920c0a60bcaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88d81883bc0b4ef48ac2d516cf13f662'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:14:09.801805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1221/2452] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:14:09 2022] DELETE /identity/v3/users/88d81883bc0b4ef48ac2d516cf13f662 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:14:09.806563 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f7d49-63c2-4eb3-ab7e-069e53855b73 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:09.807030 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f7d49-63c2-4eb3-ab7e-069e53855b73 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:09.807300 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f7d49-63c2-4eb3-ab7e-069e53855b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:09.826445 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-720f7d49-63c2-4eb3-ab7e-069e53855b73 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:14:09.827684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-720f7d49-63c2-4eb3-ab7e-069e53855b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:14:09.871598 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:14:09.889253 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1232/2453] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:14:09.899507 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710cff0-4e2d-4952-8027-920c0a60bcaf admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:14:09.907332 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-2710cff0-4e2d-4952-8027-920c0a60bcaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:14:09.961251 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710cff0-4e2d-4952-8027-920c0a60bcaf admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:14:09.965079 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f15c4d9-a595-4e4c-8630-37d289e156be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:14:09.965685 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15c4d9-a595-4e4c-8630-37d289e156be service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:09.965968 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15c4d9-a595-4e4c-8630-37d289e156be service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:09.966248 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f15c4d9-a595-4e4c-8630-37d289e156be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:09.976602 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15c4d9-a595-4e4c-8630-37d289e156be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:14:09.978051 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f15c4d9-a595-4e4c-8630-37d289e156be service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:14:09.987971 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1222/2454] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:14:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:14:10.452118 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f7d49-63c2-4eb3-ab7e-069e53855b73 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:14:10.455757 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-720f7d49-63c2-4eb3-ab7e-069e53855b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:14:10.468149 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f7d49-63c2-4eb3-ab7e-069e53855b73 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:14:10.474924 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be54a79-f7d1-4727-8453-024a105f9b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:14:10.475683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be54a79-f7d1-4727-8453-024a105f9b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:10.476032 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be54a79-f7d1-4727-8453-024a105f9b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:10.476375 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be54a79-f7d1-4727-8453-024a105f9b90 admin admin] PATH_INFO: `/v3/projects/4987acb8951c434b8bcc6c54e83d45e1` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:10.477618 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be54a79-f7d1-4727-8453-024a105f9b90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4987acb8951c434b8bcc6c54e83d45e1)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:14:10.479657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be54a79-f7d1-4727-8453-024a105f9b90 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:14:10.601403 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0be54a79-f7d1-4727-8453-024a105f9b90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4987acb8951c434b8bcc6c54e83d45e1', 'request_id': 'req-0be54a79-f7d1-4727-8453-024a105f9b90'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:14:10.607002 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0be54a79-f7d1-4727-8453-024a105f9b90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4987acb8951c434b8bcc6c54e83d45e1', 'request_id': 'req-0be54a79-f7d1-4727-8453-024a105f9b90'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:14:10.695967 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0be54a79-f7d1-4727-8453-024a105f9b90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4987acb8951c434b8bcc6c54e83d45e1', 'request_id': 'req-0be54a79-f7d1-4727-8453-024a105f9b90'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:14:10.707951 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0be54a79-f7d1-4727-8453-024a105f9b90 admin admin] The token cache is being invalidate because project 4987acb8951c434b8bcc6c54e83d45e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:14:10.708231 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0be54a79-f7d1-4727-8453-024a105f9b90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:14:10.711666 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0be54a79-f7d1-4727-8453-024a105f9b90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:14:10.711666 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1233/2455] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:14:10 2022] DELETE /identity/v3/projects/4987acb8951c434b8bcc6c54e83d45e1 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:14:10.715786 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbed29-802d-4760-b195-cb402b9a5e51 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:10.716278 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbed29-802d-4760-b195-cb402b9a5e51 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:10.716384 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bbed29-802d-4760-b195-cb402b9a5e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:10.736553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-92bbed29-802d-4760-b195-cb402b9a5e51 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:14:10.737726 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-92bbed29-802d-4760-b195-cb402b9a5e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:14:10.786826 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:14:10.798546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1223/2456] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:14:10.806476 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc86f3b-3fd0-403b-bd18-00a11811a2eb None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:10.806761 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc86f3b-3fd0-403b-bd18-00a11811a2eb None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:10.807365 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc86f3b-3fd0-403b-bd18-00a11811a2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:10.827902 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-9bc86f3b-3fd0-403b-bd18-00a11811a2eb None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:14:10.829228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-9bc86f3b-3fd0-403b-bd18-00a11811a2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:14:10.837292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1234/2457] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:14:10.849501 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbed29-802d-4760-b195-cb402b9a5e51 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:14:10.859513 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bbed29-802d-4760-b195-cb402b9a5e51 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:14:10.864746 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f84d8-28fc-4ac3-8d34-1876cf487db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:14:10.865355 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f84d8-28fc-4ac3-8d34-1876cf487db3 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:10.865635 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f84d8-28fc-4ac3-8d34-1876cf487db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:10.865900 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f84d8-28fc-4ac3-8d34-1876cf487db3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:10.866546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f84d8-28fc-4ac3-8d34-1876cf487db3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:14:10.866845 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f84d8-28fc-4ac3-8d34-1876cf487db3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:14:10.868516 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f84d8-28fc-4ac3-8d34-1876cf487db3 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:14:10.880636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1224/2458] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:14:10.885543 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc86f3b-3fd0-403b-bd18-00a11811a2eb None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:14:10.895425 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc86f3b-3fd0-403b-bd18-00a11811a2eb None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:14:10.900261 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff3569-511b-4567-a241-816a535d6364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:14:10.900855 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff3569-511b-4567-a241-816a535d6364 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:10.901130 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff3569-511b-4567-a241-816a535d6364 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:10.901401 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff3569-511b-4567-a241-816a535d6364 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:10.902092 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff3569-511b-4567-a241-816a535d6364 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:14:10.904006 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff3569-511b-4567-a241-816a535d6364 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:14:11.015367 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1235/2459] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:14:10 2022] POST /identity/v3/projects => generated 373 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:14:11.018986 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f84d8-28fc-4ac3-8d34-1876cf487db3 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:14:11.029359 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f84d8-28fc-4ac3-8d34-1876cf487db3 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:14:11.085131 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b489be-8ac6-43d8-adb3-d33d99f98234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:14:11.085730 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b489be-8ac6-43d8-adb3-d33d99f98234 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:11.086004 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b489be-8ac6-43d8-adb3-d33d99f98234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:11.086269 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b489be-8ac6-43d8-adb3-d33d99f98234 admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:11.086889 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b489be-8ac6-43d8-adb3-d33d99f98234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:14:11.088847 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b489be-8ac6-43d8-adb3-d33d99f98234 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:14:11.178585 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1225/2460] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:14:11 2022] POST /identity/v3/users => generated 287 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:14:11.182674 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff3569-511b-4567-a241-816a535d6364 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:14:11.193451 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff3569-511b-4567-a241-816a535d6364 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:14:11.198836 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf7874-4e71-47ef-8951-2044e13da7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:14:11.199452 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf7874-4e71-47ef-8951-2044e13da7a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:11.199728 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf7874-4e71-47ef-8951-2044e13da7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:11.199997 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf7874-4e71-47ef-8951-2044e13da7a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:11.200815 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf7874-4e71-47ef-8951-2044e13da7a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:14:11.202239 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bf7874-4e71-47ef-8951-2044e13da7a9 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:14:11.212858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1236/2461] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:14:11.216976 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b489be-8ac6-43d8-adb3-d33d99f98234 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:14:11.228890 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b489be-8ac6-43d8-adb3-d33d99f98234 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:14:11.233702 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a881fb0d-4358-4ec2-896a-7c1ce544ce8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:14:11.234344 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881fb0d-4358-4ec2-896a-7c1ce544ce8d admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:11.235453 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881fb0d-4358-4ec2-896a-7c1ce544ce8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:11.235755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a881fb0d-4358-4ec2-896a-7c1ce544ce8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:11.236533 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a881fb0d-4358-4ec2-896a-7c1ce544ce8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:14:11.238152 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a881fb0d-4358-4ec2-896a-7c1ce544ce8d admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:14:11.249038 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1226/2462] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:14:11.253452 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf7874-4e71-47ef-8951-2044e13da7a9 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:14:11.264447 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf7874-4e71-47ef-8951-2044e13da7a9 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:14:11.281113 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b66f67-cc32-48f8-928b-8dc9f2f90d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:14:11.282839 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b66f67-cc32-48f8-928b-8dc9f2f90d99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:11.283195 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b66f67-cc32-48f8-928b-8dc9f2f90d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:11.283423 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b66f67-cc32-48f8-928b-8dc9f2f90d99 admin admin] PATH_INFO: `/v3/projects/c05eb24160df40a29c7775c9e0a351ef/users/9ab4cbbbcb0347b79ab1293fcf83527d/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:11.304140 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b66f67-cc32-48f8-928b-8dc9f2f90d99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c05eb24160df40a29c7775c9e0a351ef, user_id=9ab4cbbbcb0347b79ab1293fcf83527d, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:14:11.307869 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b66f67-cc32-48f8-928b-8dc9f2f90d99 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:14:11.396084 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1237/2463] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:14:11 2022] PUT /identity/v3/projects/c05eb24160df40a29c7775c9e0a351ef/users/9ab4cbbbcb0347b79ab1293fcf83527d/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:14:11.469868 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefdff4-10e0-4e5f-ad4c-982da1800589 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:11.470558 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefdff4-10e0-4e5f-ad4c-982da1800589 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:11.470831 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdefdff4-10e0-4e5f-ad4c-982da1800589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:11.499452 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-fdefdff4-10e0-4e5f-ad4c-982da1800589 None None] MFA Rules not processed for user `9ab4cbbbcb0347b79ab1293fcf83527d`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:14:11.501099 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-fdefdff4-10e0-4e5f-ad4c-982da1800589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:14:11.568305 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1227/2464] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:14:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:14:11.579613 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b66f67-cc32-48f8-928b-8dc9f2f90d99 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:14:11.581272 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-77b66f67-cc32-48f8-928b-8dc9f2f90d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:14:11.640343 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b66f67-cc32-48f8-928b-8dc9f2f90d99 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:14:11.644986 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a07e56-f19e-414c-8434-04ebc23a30e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:14:11.645598 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a07e56-f19e-414c-8434-04ebc23a30e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:11.645877 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a07e56-f19e-414c-8434-04ebc23a30e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:11.646156 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a07e56-f19e-414c-8434-04ebc23a30e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:11.655089 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a07e56-f19e-414c-8434-04ebc23a30e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:14:11.657000 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a07e56-f19e-414c-8434-04ebc23a30e3 service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:14:11.666168 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1238/2465] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:14:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:14:16.616203 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea434bed-8ea5-4ac4-bfa6-da54c97908dc None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:16.616794 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea434bed-8ea5-4ac4-bfa6-da54c97908dc None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:16.616794 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea434bed-8ea5-4ac4-bfa6-da54c97908dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:16.639402 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-ea434bed-8ea5-4ac4-bfa6-da54c97908dc None None] MFA Rules not processed for user `3659772c227a4a179d30340e9573d556`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:14:16.640869 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-ea434bed-8ea5-4ac4-bfa6-da54c97908dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:14:16.692343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:14:16.702855 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1228/2466] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:14:16 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:14:21.662067 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:14:23.373885 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a07e56-f19e-414c-8434-04ebc23a30e3 service cinder] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:14:23.444729 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a07e56-f19e-414c-8434-04ebc23a30e3 service cinder] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:14:23.449668 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fded8-2f3c-4e3c-aa9e-40632cf74c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:14:23.450380 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fded8-2f3c-4e3c-aa9e-40632cf74c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:23.450664 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fded8-2f3c-4e3c-aa9e-40632cf74c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:23.450934 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0fded8-2f3c-4e3c-aa9e-40632cf74c74 admin admin] PATH_INFO: `/v3/users/9ab4cbbbcb0347b79ab1293fcf83527d` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:23.452143 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fded8-2f3c-4e3c-aa9e-40632cf74c74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ab4cbbbcb0347b79ab1293fcf83527d)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:14:23.454147 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0fded8-2f3c-4e3c-aa9e-40632cf74c74 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:14:23.649097 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-2d0fded8-2f3c-4e3c-aa9e-40632cf74c74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ab4cbbbcb0347b79ab1293fcf83527d'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:14:23.657122 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-2d0fded8-2f3c-4e3c-aa9e-40632cf74c74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ab4cbbbcb0347b79ab1293fcf83527d'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:14:23.720990 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-2d0fded8-2f3c-4e3c-aa9e-40632cf74c74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ab4cbbbcb0347b79ab1293fcf83527d'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:14:23.721700 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-2d0fded8-2f3c-4e3c-aa9e-40632cf74c74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ab4cbbbcb0347b79ab1293fcf83527d'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:14:23.722258 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-2d0fded8-2f3c-4e3c-aa9e-40632cf74c74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ab4cbbbcb0347b79ab1293fcf83527d'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:14:23.741680 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1239/2467] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:14:23 2022] DELETE /identity/v3/users/9ab4cbbbcb0347b79ab1293fcf83527d => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:14:23.746448 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f8841-88c3-4319-9798-9b825cc44dd2 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:23.746951 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f8841-88c3-4319-9798-9b825cc44dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:23.747056 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f8841-88c3-4319-9798-9b825cc44dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:23.767280 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-981f8841-88c3-4319-9798-9b825cc44dd2 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:14:23.768530 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-981f8841-88c3-4319-9798-9b825cc44dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:14:23.832102 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1229/2468] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:14:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:14:23.841771 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fded8-2f3c-4e3c-aa9e-40632cf74c74 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:14:23.843988 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-2d0fded8-2f3c-4e3c-aa9e-40632cf74c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:14:23.911217 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0fded8-2f3c-4e3c-aa9e-40632cf74c74 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:14:23.915028 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf540005-706a-4406-9e50-e5b160b3efeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:14:23.915683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf540005-706a-4406-9e50-e5b160b3efeb service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:23.915959 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf540005-706a-4406-9e50-e5b160b3efeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:23.916228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf540005-706a-4406-9e50-e5b160b3efeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:23.926893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf540005-706a-4406-9e50-e5b160b3efeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:14:23.928401 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf540005-706a-4406-9e50-e5b160b3efeb service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:14:23.938562 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1240/2469] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:14:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:14:24.654524 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f8841-88c3-4319-9798-9b825cc44dd2 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:14:24.656282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-981f8841-88c3-4319-9798-9b825cc44dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:14:24.669774 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f8841-88c3-4319-9798-9b825cc44dd2 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:14:24.675043 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4410d52-4a18-4e82-8aed-0468c3f850af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:14:24.675808 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4410d52-4a18-4e82-8aed-0468c3f850af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:24.675989 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4410d52-4a18-4e82-8aed-0468c3f850af admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:24.676263 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4410d52-4a18-4e82-8aed-0468c3f850af admin admin] PATH_INFO: `/v3/projects/c05eb24160df40a29c7775c9e0a351ef` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:24.677424 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4410d52-4a18-4e82-8aed-0468c3f850af admin admin] RBAC: Authorizing `identity:delete_project(project_id=c05eb24160df40a29c7775c9e0a351ef)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:14:24.679439 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4410d52-4a18-4e82-8aed-0468c3f850af admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:14:24.797111 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-d4410d52-4a18-4e82-8aed-0468c3f850af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c05eb24160df40a29c7775c9e0a351ef', 'request_id': 'req-d4410d52-4a18-4e82-8aed-0468c3f850af'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:14:24.802768 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-d4410d52-4a18-4e82-8aed-0468c3f850af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c05eb24160df40a29c7775c9e0a351ef', 'request_id': 'req-d4410d52-4a18-4e82-8aed-0468c3f850af'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:14:24.809137 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-d4410d52-4a18-4e82-8aed-0468c3f850af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c05eb24160df40a29c7775c9e0a351ef', 'request_id': 'req-d4410d52-4a18-4e82-8aed-0468c3f850af'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:14:24.863983 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-d4410d52-4a18-4e82-8aed-0468c3f850af admin admin] The token cache is being invalidate because project c05eb24160df40a29c7775c9e0a351ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:14:24.864223 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-d4410d52-4a18-4e82-8aed-0468c3f850af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:14:24.864845 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-d4410d52-4a18-4e82-8aed-0468c3f850af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:14:24.866560 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1230/2470] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:14:24 2022] DELETE /identity/v3/projects/c05eb24160df40a29c7775c9e0a351ef => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:14:29.826254 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2fe91-3771-49ba-94de-eef859df7d38 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:14:29.826792 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2fe91-3771-49ba-94de-eef859df7d38 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:14:29.826792 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2fe91-3771-49ba-94de-eef859df7d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:14:29.847311 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-43a2fe91-3771-49ba-94de-eef859df7d38 None None] MFA Rules not processed for user `9d829f56be8a4000946c6ca93007937c`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:14:29.848887 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-43a2fe91-3771-49ba-94de-eef859df7d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:14:29.867452 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:14:29.907689 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1241/2471] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:14:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:14:34.860830 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=56,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:14:40.040883 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=15 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:15:21.100923 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc4da5-1f15-4e34-9559-f70e8feef582 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:21.101476 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc4da5-1f15-4e34-9559-f70e8feef582 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:21.101600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc4da5-1f15-4e34-9559-f70e8feef582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:21.120506 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-92cc4da5-1f15-4e34-9559-f70e8feef582 None None] MFA Rules not processed for user `2cad680ebdab4fd4996f39f2e08eabb7`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:15:21.121694 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-92cc4da5-1f15-4e34-9559-f70e8feef582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:21.177233 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1231/2472] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:15:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:15:26.846550 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2fe91-3771-49ba-94de-eef859df7d38 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:26.846550 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-43a2fe91-3771-49ba-94de-eef859df7d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:26.928549 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2fe91-3771-49ba-94de-eef859df7d38 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:26.933060 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dcb1f-6600-44e1-8497-c178f83439bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:26.933372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dcb1f-6600-44e1-8497-c178f83439bb service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:26.933657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dcb1f-6600-44e1-8497-c178f83439bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:26.933935 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dcb1f-6600-44e1-8497-c178f83439bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:26.935751 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-5d1dcb1f-6600-44e1-8497-c178f83439bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:27.008935 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dcb1f-6600-44e1-8497-c178f83439bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:27.010553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dcb1f-6600-44e1-8497-c178f83439bb service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:27.025583 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1242/2473] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:15:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:15:29.161511 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc4da5-1f15-4e34-9559-f70e8feef582 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:29.164491 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-92cc4da5-1f15-4e34-9559-f70e8feef582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:29.176879 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc4da5-1f15-4e34-9559-f70e8feef582 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:29.181498 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fcf56-9987-479c-a235-97ff0b2bad59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:29.182116 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fcf56-9987-479c-a235-97ff0b2bad59 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:29.182391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fcf56-9987-479c-a235-97ff0b2bad59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:29.182661 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fcf56-9987-479c-a235-97ff0b2bad59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:29.184445 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-6c0fcf56-9987-479c-a235-97ff0b2bad59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:29.283409 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fcf56-9987-479c-a235-97ff0b2bad59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:29.290061 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0fcf56-9987-479c-a235-97ff0b2bad59 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:29.294912 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dcb1f-6600-44e1-8497-c178f83439bb service neutron] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:29.305025 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dcb1f-6600-44e1-8497-c178f83439bb service neutron] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:29.305843 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1232/2474] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:15:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:15:29.312613 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a034d3-bb21-441d-8b58-679a442b823f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:29.313247 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a034d3-bb21-441d-8b58-679a442b823f service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:29.313523 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a034d3-bb21-441d-8b58-679a442b823f service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:29.313796 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a034d3-bb21-441d-8b58-679a442b823f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:29.315666 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-f3a034d3-bb21-441d-8b58-679a442b823f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:29.332716 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a034d3-bb21-441d-8b58-679a442b823f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:29.334440 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a034d3-bb21-441d-8b58-679a442b823f service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:29.356859 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1243/2475] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:15:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:15:29.806311 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fcf56-9987-479c-a235-97ff0b2bad59 service neutron] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:29.807959 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-6c0fcf56-9987-479c-a235-97ff0b2bad59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:29.826238 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0fcf56-9987-479c-a235-97ff0b2bad59 service neutron] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:29.831019 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3553a71d-b382-4a60-9716-52646935aa4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:29.831681 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553a71d-b382-4a60-9716-52646935aa4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:29.831958 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553a71d-b382-4a60-9716-52646935aa4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:29.832229 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3553a71d-b382-4a60-9716-52646935aa4b admin admin] PATH_INFO: `/v3/users/3659772c227a4a179d30340e9573d556` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:29.833365 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553a71d-b382-4a60-9716-52646935aa4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3659772c227a4a179d30340e9573d556)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:29.835527 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3553a71d-b382-4a60-9716-52646935aa4b admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:30.012872 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-3553a71d-b382-4a60-9716-52646935aa4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3659772c227a4a179d30340e9573d556'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:30.013678 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-3553a71d-b382-4a60-9716-52646935aa4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3659772c227a4a179d30340e9573d556'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:30.021839 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-3553a71d-b382-4a60-9716-52646935aa4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3659772c227a4a179d30340e9573d556'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:30.023086 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-3553a71d-b382-4a60-9716-52646935aa4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3659772c227a4a179d30340e9573d556'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:30.100083 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-3553a71d-b382-4a60-9716-52646935aa4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3659772c227a4a179d30340e9573d556'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:30.119495 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1233/2476] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:15:29 2022] DELETE /identity/v3/users/3659772c227a4a179d30340e9573d556 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:15:30.410285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a034d3-bb21-441d-8b58-679a442b823f service neutron] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:30.422260 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a034d3-bb21-441d-8b58-679a442b823f service neutron] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:30.483093 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4380d-c572-4f4f-a65f-bc38ad42250c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:30.483752 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4380d-c572-4f4f-a65f-bc38ad42250c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:30.484034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4380d-c572-4f4f-a65f-bc38ad42250c admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:30.484305 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4380d-c572-4f4f-a65f-bc38ad42250c admin admin] PATH_INFO: `/v3/projects/0131d0330fac4b8089503e5d0e830841` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:30.485530 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d4380d-c572-4f4f-a65f-bc38ad42250c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0131d0330fac4b8089503e5d0e830841)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:30.487359 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d4380d-c572-4f4f-a65f-bc38ad42250c admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:30.597896 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:15:30.606591 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-40d4380d-c572-4f4f-a65f-bc38ad42250c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0131d0330fac4b8089503e5d0e830841', 'request_id': 'req-40d4380d-c572-4f4f-a65f-bc38ad42250c'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:30.613846 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-40d4380d-c572-4f4f-a65f-bc38ad42250c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0131d0330fac4b8089503e5d0e830841', 'request_id': 'req-40d4380d-c572-4f4f-a65f-bc38ad42250c'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:30.699967 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-40d4380d-c572-4f4f-a65f-bc38ad42250c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0131d0330fac4b8089503e5d0e830841', 'request_id': 'req-40d4380d-c572-4f4f-a65f-bc38ad42250c'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:30.726629 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-40d4380d-c572-4f4f-a65f-bc38ad42250c admin admin] The token cache is being invalidate because project 0131d0330fac4b8089503e5d0e830841 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:15:30.727022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-40d4380d-c572-4f4f-a65f-bc38ad42250c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:30.727685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-40d4380d-c572-4f4f-a65f-bc38ad42250c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:30.729503 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1244/2477] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:15:30 2022] DELETE /identity/v3/projects/0131d0330fac4b8089503e5d0e830841 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:15:30.734475 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cdbd0-8da1-4547-860d-bb07fbc479b6 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:30.734974 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cdbd0-8da1-4547-860d-bb07fbc479b6 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:30.735057 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865cdbd0-8da1-4547-860d-bb07fbc479b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:30.745860 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:15:30.764342 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-865cdbd0-8da1-4547-860d-bb07fbc479b6 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:15:30.766597 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-865cdbd0-8da1-4547-860d-bb07fbc479b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:30.833927 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1234/2478] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:15:30.842217 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ad712-1bc5-401e-bce5-52ce507e5109 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:30.842524 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ad712-1bc5-401e-bce5-52ce507e5109 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:30.842792 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055ad712-1bc5-401e-bce5-52ce507e5109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:30.863456 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-055ad712-1bc5-401e-bce5-52ce507e5109 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:15:30.864781 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-055ad712-1bc5-401e-bce5-52ce507e5109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:30.874193 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1245/2479] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:15:30.878146 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cdbd0-8da1-4547-860d-bb07fbc479b6 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:30.889318 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865cdbd0-8da1-4547-860d-bb07fbc479b6 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:30.894843 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2428c8-52dd-4716-906f-010d0eaee18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:30.895496 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2428c8-52dd-4716-906f-010d0eaee18e admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:30.895765 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2428c8-52dd-4716-906f-010d0eaee18e admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:30.896035 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2428c8-52dd-4716-906f-010d0eaee18e admin admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:30.896852 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2428c8-52dd-4716-906f-010d0eaee18e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:15:30.896986 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2428c8-52dd-4716-906f-010d0eaee18e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:30.898998 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2428c8-52dd-4716-906f-010d0eaee18e admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:30.915249 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1235/2480] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:15:30.916580 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ad712-1bc5-401e-bce5-52ce507e5109 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:30.926854 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055ad712-1bc5-401e-bce5-52ce507e5109 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:30.932744 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93adc166-8667-4392-af55-6aa0843333b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:30.933402 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adc166-8667-4392-af55-6aa0843333b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:30.933676 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adc166-8667-4392-af55-6aa0843333b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:30.933944 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adc166-8667-4392-af55-6aa0843333b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:30.934565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93adc166-8667-4392-af55-6aa0843333b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:30.936513 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93adc166-8667-4392-af55-6aa0843333b6 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:31.016320 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1246/2481] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:15:30 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:15:31.020511 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2428c8-52dd-4716-906f-010d0eaee18e admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:31.031536 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2428c8-52dd-4716-906f-010d0eaee18e admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:31.088646 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0166e5-69de-4188-8a04-d1754d0ace14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:31.089262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0166e5-69de-4188-8a04-d1754d0ace14 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:31.089537 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0166e5-69de-4188-8a04-d1754d0ace14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:31.089813 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0166e5-69de-4188-8a04-d1754d0ace14 admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:31.090440 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0166e5-69de-4188-8a04-d1754d0ace14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:31.092685 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0166e5-69de-4188-8a04-d1754d0ace14 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:31.208741 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1236/2482] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:15:31 2022] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:15:31.212633 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93adc166-8667-4392-af55-6aa0843333b6 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:31.222782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93adc166-8667-4392-af55-6aa0843333b6 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:31.228105 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd6f28-8245-4b07-bd6e-406c935cc5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:31.228710 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd6f28-8245-4b07-bd6e-406c935cc5fc admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:31.228992 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd6f28-8245-4b07-bd6e-406c935cc5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:31.229268 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd6f28-8245-4b07-bd6e-406c935cc5fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:31.229929 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd6f28-8245-4b07-bd6e-406c935cc5fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:31.231539 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd6f28-8245-4b07-bd6e-406c935cc5fc admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:31.242355 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1247/2483] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:15:31.246441 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0166e5-69de-4188-8a04-d1754d0ace14 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:31.257309 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0166e5-69de-4188-8a04-d1754d0ace14 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:31.262542 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6305e16-fc4d-4ffe-922c-b031340b98f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:31.263178 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6305e16-fc4d-4ffe-922c-b031340b98f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:31.263461 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6305e16-fc4d-4ffe-922c-b031340b98f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:31.263737 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6305e16-fc4d-4ffe-922c-b031340b98f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:31.264374 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6305e16-fc4d-4ffe-922c-b031340b98f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:31.265986 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6305e16-fc4d-4ffe-922c-b031340b98f6 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:31.283278 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1237/2484] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:15:31.287690 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd6f28-8245-4b07-bd6e-406c935cc5fc admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:31.298345 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd6f28-8245-4b07-bd6e-406c935cc5fc admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:31.302937 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862f6b3-eee5-40f7-a8be-972d300e026d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:31.304297 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862f6b3-eee5-40f7-a8be-972d300e026d admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:31.304693 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862f6b3-eee5-40f7-a8be-972d300e026d admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:31.304999 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f862f6b3-eee5-40f7-a8be-972d300e026d admin admin] PATH_INFO: `/v3/projects/acdf9565429f418c96a366e68f5e5e3a/users/658f564268274a9385d02e75ebb3025d/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:31.319383 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862f6b3-eee5-40f7-a8be-972d300e026d admin admin] RBAC: Authorizing `identity:create_grant(project_id=acdf9565429f418c96a366e68f5e5e3a, user_id=658f564268274a9385d02e75ebb3025d, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:31.322142 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f862f6b3-eee5-40f7-a8be-972d300e026d admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:31.383785 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1248/2485] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:15:31 2022] PUT /identity/v3/projects/acdf9565429f418c96a366e68f5e5e3a/users/658f564268274a9385d02e75ebb3025d/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:15:31.394106 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261958d-3d1f-4a30-8598-d39a0c02773c None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:31.394388 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261958d-3d1f-4a30-8598-d39a0c02773c None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:31.394663 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8261958d-3d1f-4a30-8598-d39a0c02773c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:31.422789 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-8261958d-3d1f-4a30-8598-d39a0c02773c None None] MFA Rules not processed for user `658f564268274a9385d02e75ebb3025d`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:15:31.424035 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-8261958d-3d1f-4a30-8598-d39a0c02773c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:31.482482 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:15:31.487886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1238/2486] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:15:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:15:31.492311 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862f6b3-eee5-40f7-a8be-972d300e026d admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:31.554935 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f862f6b3-eee5-40f7-a8be-972d300e026d admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:31.559719 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a4ec1-2cc4-4e3f-be36-fd65b2f726e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:31.560324 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a4ec1-2cc4-4e3f-be36-fd65b2f726e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:31.560601 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a4ec1-2cc4-4e3f-be36-fd65b2f726e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:31.560876 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a4ec1-2cc4-4e3f-be36-fd65b2f726e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:31.561510 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a4ec1-2cc4-4e3f-be36-fd65b2f726e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:31.563440 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a4ec1-2cc4-4e3f-be36-fd65b2f726e6 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:31.651505 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1249/2487] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:15:31 2022] POST /identity/v3/projects => generated 379 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:15:31.654947 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261958d-3d1f-4a30-8598-d39a0c02773c None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:31.666774 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8261958d-3d1f-4a30-8598-d39a0c02773c None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:31.724059 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde19532-dfae-441b-b030-aa7db8d6aed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:31.724677 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde19532-dfae-441b-b030-aa7db8d6aed6 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:31.724956 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde19532-dfae-441b-b030-aa7db8d6aed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:31.725228 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde19532-dfae-441b-b030-aa7db8d6aed6 admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:31.726770 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde19532-dfae-441b-b030-aa7db8d6aed6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:31.728844 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde19532-dfae-441b-b030-aa7db8d6aed6 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:31.851176 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1239/2488] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:15:31 2022] POST /identity/v3/users => generated 296 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:15:31.855437 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a4ec1-2cc4-4e3f-be36-fd65b2f726e6 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:31.869513 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a4ec1-2cc4-4e3f-be36-fd65b2f726e6 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:31.874397 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4128ce-9838-4838-bee5-28e06fe60ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:31.875217 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4128ce-9838-4838-bee5-28e06fe60ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:31.875321 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4128ce-9838-4838-bee5-28e06fe60ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:31.875575 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4128ce-9838-4838-bee5-28e06fe60ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:31.876323 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4128ce-9838-4838-bee5-28e06fe60ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:31.877970 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4128ce-9838-4838-bee5-28e06fe60ca6 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:31.898569 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1250/2489] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:15:31.900124 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde19532-dfae-441b-b030-aa7db8d6aed6 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:31.911336 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde19532-dfae-441b-b030-aa7db8d6aed6 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:31.918447 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b2a57-95e6-47c8-ac3a-6ea007a80ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:31.919139 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b2a57-95e6-47c8-ac3a-6ea007a80ca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:31.919422 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b2a57-95e6-47c8-ac3a-6ea007a80ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:31.919687 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b2a57-95e6-47c8-ac3a-6ea007a80ca5 admin admin] PATH_INFO: `/v3/projects/879ab12901654cce87bb4651b7ec99f4/users/abeb56f7348948748c0a9c91e7ce69e9/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:31.936987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b2a57-95e6-47c8-ac3a-6ea007a80ca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=879ab12901654cce87bb4651b7ec99f4, user_id=abeb56f7348948748c0a9c91e7ce69e9, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:31.939808 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b2a57-95e6-47c8-ac3a-6ea007a80ca5 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:32.045844 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1240/2490] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:15:31 2022] PUT /identity/v3/projects/879ab12901654cce87bb4651b7ec99f4/users/abeb56f7348948748c0a9c91e7ce69e9/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:15:32.049875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4128ce-9838-4838-bee5-28e06fe60ca6 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:32.061155 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4128ce-9838-4838-bee5-28e06fe60ca6 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:32.112148 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:15:32.137680 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f99c10-408c-48b4-9bac-d59f300818f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:32.138318 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f99c10-408c-48b4-9bac-d59f300818f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:32.138577 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f99c10-408c-48b4-9bac-d59f300818f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:32.138852 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f99c10-408c-48b4-9bac-d59f300818f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:32.139534 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f99c10-408c-48b4-9bac-d59f300818f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:32.141176 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f99c10-408c-48b4-9bac-d59f300818f5 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:32.151682 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1251/2491] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:15:32.156236 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b2a57-95e6-47c8-ac3a-6ea007a80ca5 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:32.168249 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b2a57-95e6-47c8-ac3a-6ea007a80ca5 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:32.172997 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7578486-c1c0-436f-a6fc-f43549a27442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:32.173663 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7578486-c1c0-436f-a6fc-f43549a27442 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:32.174048 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7578486-c1c0-436f-a6fc-f43549a27442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:32.174223 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7578486-c1c0-436f-a6fc-f43549a27442 admin admin] PATH_INFO: `/v3/projects/879ab12901654cce87bb4651b7ec99f4/users/abeb56f7348948748c0a9c91e7ce69e9/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:32.176192 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7578486-c1c0-436f-a6fc-f43549a27442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=879ab12901654cce87bb4651b7ec99f4, user_id=abeb56f7348948748c0a9c91e7ce69e9, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:32.180436 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7578486-c1c0-436f-a6fc-f43549a27442 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:32.211256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1241/2492] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:15:32 2022] PUT /identity/v3/projects/879ab12901654cce87bb4651b7ec99f4/users/abeb56f7348948748c0a9c91e7ce69e9/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:15:32.218672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51bb20-4257-42f4-a37c-1034ea7fa5f5 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:32.219239 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51bb20-4257-42f4-a37c-1034ea7fa5f5 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:32.219719 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e51bb20-4257-42f4-a37c-1034ea7fa5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:32.255306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-2e51bb20-4257-42f4-a37c-1034ea7fa5f5 None None] MFA Rules not processed for user `abeb56f7348948748c0a9c91e7ce69e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:15:32.263291 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-2e51bb20-4257-42f4-a37c-1034ea7fa5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:32.337196 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1252/2493] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:15:32 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:15:32.348729 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7578486-c1c0-436f-a6fc-f43549a27442 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:32.351104 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-b7578486-c1c0-436f-a6fc-f43549a27442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:32.411619 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7578486-c1c0-436f-a6fc-f43549a27442 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:32.416142 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98132e0-3f41-4489-9bd8-f3787bdc00d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:32.416734 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98132e0-3f41-4489-9bd8-f3787bdc00d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:32.417016 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98132e0-3f41-4489-9bd8-f3787bdc00d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:32.417292 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98132e0-3f41-4489-9bd8-f3787bdc00d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:32.478147 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98132e0-3f41-4489-9bd8-f3787bdc00d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:32.479772 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98132e0-3f41-4489-9bd8-f3787bdc00d8 service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:32.491037 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1242/2494] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:15:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:15:34.311691 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51bb20-4257-42f4-a37c-1034ea7fa5f5 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:34.316425 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-2e51bb20-4257-42f4-a37c-1034ea7fa5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:34.328596 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e51bb20-4257-42f4-a37c-1034ea7fa5f5 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:34.332258 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb389d1-e4c9-47f0-9465-0e58bf86751b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:34.332914 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb389d1-e4c9-47f0-9465-0e58bf86751b service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:34.333188 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb389d1-e4c9-47f0-9465-0e58bf86751b service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:34.333455 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb389d1-e4c9-47f0-9465-0e58bf86751b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:34.343176 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb389d1-e4c9-47f0-9465-0e58bf86751b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:34.344626 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb389d1-e4c9-47f0-9465-0e58bf86751b service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:34.356085 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1253/2495] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:15:34 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:15:38.706671 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98132e0-3f41-4489-9bd8-f3787bdc00d8 service cinder] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:38.716145 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:15:38.775327 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98132e0-3f41-4489-9bd8-f3787bdc00d8 service cinder] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:38.779959 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83af13-bb44-44d1-860e-87ee9b684a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:38.780591 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83af13-bb44-44d1-860e-87ee9b684a75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:38.780867 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83af13-bb44-44d1-860e-87ee9b684a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:38.781132 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83af13-bb44-44d1-860e-87ee9b684a75 admin admin] PATH_INFO: `/v3/users/658f564268274a9385d02e75ebb3025d` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:38.782256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83af13-bb44-44d1-860e-87ee9b684a75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=658f564268274a9385d02e75ebb3025d)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:38.784315 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c83af13-bb44-44d1-860e-87ee9b684a75 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:38.806546 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3a0aa-2da0-40ed-853d-699ac0b60e00 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:38.807198 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3a0aa-2da0-40ed-853d-699ac0b60e00 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:38.807198 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf3a0aa-2da0-40ed-853d-699ac0b60e00 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:38.808702 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1254/2496] 10.222.0.55 () {54 vars in 921 bytes} [Wed Aug 24 17:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 17:15:38.814667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c551b-2382-41ca-9818-4efaf3f75a90 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:38.814956 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c551b-2382-41ca-9818-4efaf3f75a90 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:38.815267 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721c551b-2382-41ca-9818-4efaf3f75a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:38.836920 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-721c551b-2382-41ca-9818-4efaf3f75a90 None None] MFA Rules not processed for user `88ce8df89a96460ca046f2972321bceb`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:15:38.838173 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-721c551b-2382-41ca-9818-4efaf3f75a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:38.894724 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1255/2497] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Aug 24 17:15:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:15:38.907081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c551b-2382-41ca-9818-4efaf3f75a90 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:38.908538 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-721c551b-2382-41ca-9818-4efaf3f75a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:38.919509 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721c551b-2382-41ca-9818-4efaf3f75a90 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:38.923430 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c7661-8d35-4904-b9f9-42dbfdbc3544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:38.924038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c7661-8d35-4904-b9f9-42dbfdbc3544 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:38.924314 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c7661-8d35-4904-b9f9-42dbfdbc3544 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:38.924583 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c7661-8d35-4904-b9f9-42dbfdbc3544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:38.932932 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c7661-8d35-4904-b9f9-42dbfdbc3544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:38.934393 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c7661-8d35-4904-b9f9-42dbfdbc3544 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:38.942285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1256/2498] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:15:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:15:38.978593 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-4c83af13-bb44-44d1-860e-87ee9b684a75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '658f564268274a9385d02e75ebb3025d'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:38.979366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-4c83af13-bb44-44d1-860e-87ee9b684a75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '658f564268274a9385d02e75ebb3025d'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:38.987103 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-4c83af13-bb44-44d1-860e-87ee9b684a75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '658f564268274a9385d02e75ebb3025d'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:38.987795 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-4c83af13-bb44-44d1-860e-87ee9b684a75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '658f564268274a9385d02e75ebb3025d'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:39.026805 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7797e81-2b71-4fac-bffb-d7c068bc4750 None None] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:39.027092 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7797e81-2b71-4fac-bffb-d7c068bc4750 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:39.027403 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7797e81-2b71-4fac-bffb-d7c068bc4750 None None] PATH_INFO: `/` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:39.028899 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1257/2499] 10.222.0.55 () {54 vars in 921 bytes} [Wed Aug 24 17:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 17:15:39.034373 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c35ed0-75cb-408e-b497-b8bc58dd1919 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:39.034656 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c35ed0-75cb-408e-b497-b8bc58dd1919 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:39.034962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c35ed0-75cb-408e-b497-b8bc58dd1919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:39.055585 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-e0c35ed0-75cb-408e-b497-b8bc58dd1919 None None] MFA Rules not processed for user `28a1c617fc264b118e61f2a97ecb3f39`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:15:39.060427 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-e0c35ed0-75cb-408e-b497-b8bc58dd1919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:39.092175 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-4c83af13-bb44-44d1-860e-87ee9b684a75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '658f564268274a9385d02e75ebb3025d'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:39.096494 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:15:39.111227 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1243/2500] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:15:38 2022] DELETE /identity/v3/users/658f564268274a9385d02e75ebb3025d => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:15:39.116360 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbc013-aa61-4f05-9520-ebca9cde5e90 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:39.116636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbc013-aa61-4f05-9520-ebca9cde5e90 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:39.116920 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effbc013-aa61-4f05-9520-ebca9cde5e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:39.126744 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1258/2501] 10.222.0.55 () {58 vars in 1018 bytes} [Wed Aug 24 17:15:39 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:15:39.137306 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-effbc013-aa61-4f05-9520-ebca9cde5e90 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:15:39.140586 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c35ed0-75cb-408e-b497-b8bc58dd1919 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:39.140725 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-effbc013-aa61-4f05-9520-ebca9cde5e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:39.140835 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-e0c35ed0-75cb-408e-b497-b8bc58dd1919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:39.151932 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c35ed0-75cb-408e-b497-b8bc58dd1919 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:39.199454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1244/2502] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:15:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:15:39.204126 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27ef9a-64a7-477b-a181-5afa28fcdd1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:39.204736 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27ef9a-64a7-477b-a181-5afa28fcdd1c service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:39.205022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27ef9a-64a7-477b-a181-5afa28fcdd1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:39.205365 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed27ef9a-64a7-477b-a181-5afa28fcdd1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:39.219337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effbc013-aa61-4f05-9520-ebca9cde5e90 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:39.231423 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effbc013-aa61-4f05-9520-ebca9cde5e90 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:39.235030 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35422e43-a42d-4078-a08f-03f81c1612f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:39.235696 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35422e43-a42d-4078-a08f-03f81c1612f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:39.236115 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35422e43-a42d-4078-a08f-03f81c1612f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:39.236399 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35422e43-a42d-4078-a08f-03f81c1612f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:39.247562 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35422e43-a42d-4078-a08f-03f81c1612f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:39.248865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35422e43-a42d-4078-a08f-03f81c1612f3 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:39.263618 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1245/2503] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:15:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:15:39.292877 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27ef9a-64a7-477b-a181-5afa28fcdd1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:39.294340 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed27ef9a-64a7-477b-a181-5afa28fcdd1c service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:39.307602 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1259/2504] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:15:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:15:39.752741 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35422e43-a42d-4078-a08f-03f81c1612f3 service neutron] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:39.757569 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-35422e43-a42d-4078-a08f-03f81c1612f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:39.779988 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35422e43-a42d-4078-a08f-03f81c1612f3 service neutron] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:39.785507 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32bb312-a054-4022-a52e-758b6cc79870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:39.786214 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32bb312-a054-4022-a52e-758b6cc79870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:39.786499 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32bb312-a054-4022-a52e-758b6cc79870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:39.786776 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32bb312-a054-4022-a52e-758b6cc79870 admin admin] PATH_INFO: `/v3/projects/acdf9565429f418c96a366e68f5e5e3a` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:39.788736 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32bb312-a054-4022-a52e-758b6cc79870 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acdf9565429f418c96a366e68f5e5e3a)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:39.791087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32bb312-a054-4022-a52e-758b6cc79870 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:39.798175 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:15:39.914960 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-b32bb312-a054-4022-a52e-758b6cc79870 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acdf9565429f418c96a366e68f5e5e3a', 'request_id': 'req-b32bb312-a054-4022-a52e-758b6cc79870'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:39.921791 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-b32bb312-a054-4022-a52e-758b6cc79870 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acdf9565429f418c96a366e68f5e5e3a', 'request_id': 'req-b32bb312-a054-4022-a52e-758b6cc79870'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:39.930168 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-b32bb312-a054-4022-a52e-758b6cc79870 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acdf9565429f418c96a366e68f5e5e3a', 'request_id': 'req-b32bb312-a054-4022-a52e-758b6cc79870'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:40.001671 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-b32bb312-a054-4022-a52e-758b6cc79870 admin admin] The token cache is being invalidate because project acdf9565429f418c96a366e68f5e5e3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:15:40.001916 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-b32bb312-a054-4022-a52e-758b6cc79870 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:40.002671 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-b32bb312-a054-4022-a52e-758b6cc79870 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:40.008162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1246/2505] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:15:39 2022] DELETE /identity/v3/projects/acdf9565429f418c96a366e68f5e5e3a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:15:40.009330 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27ef9a-64a7-477b-a181-5afa28fcdd1c service neutron] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:40.020426 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed27ef9a-64a7-477b-a181-5afa28fcdd1c service neutron] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:40.102050 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f8188c-d3bd-4a2d-8885-91a309338dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:40.102728 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8188c-d3bd-4a2d-8885-91a309338dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:40.103033 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8188c-d3bd-4a2d-8885-91a309338dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:40.103272 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f8188c-d3bd-4a2d-8885-91a309338dc2 admin admin] PATH_INFO: `/v3/users/abeb56f7348948748c0a9c91e7ce69e9` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:40.104403 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f8188c-d3bd-4a2d-8885-91a309338dc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abeb56f7348948748c0a9c91e7ce69e9)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:40.106329 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f8188c-d3bd-4a2d-8885-91a309338dc2 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:40.123549 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:15:40.347614 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-f9f8188c-d3bd-4a2d-8885-91a309338dc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abeb56f7348948748c0a9c91e7ce69e9'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:40.355892 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-f9f8188c-d3bd-4a2d-8885-91a309338dc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abeb56f7348948748c0a9c91e7ce69e9'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:40.443161 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-f9f8188c-d3bd-4a2d-8885-91a309338dc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abeb56f7348948748c0a9c91e7ce69e9'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:40.444217 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-f9f8188c-d3bd-4a2d-8885-91a309338dc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abeb56f7348948748c0a9c91e7ce69e9'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:40.445146 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-f9f8188c-d3bd-4a2d-8885-91a309338dc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abeb56f7348948748c0a9c91e7ce69e9'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:40.463683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1260/2506] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:15:40 2022] DELETE /identity/v3/users/abeb56f7348948748c0a9c91e7ce69e9 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:15:40.902534 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32bb312-a054-4022-a52e-758b6cc79870 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:40.904039 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-b32bb312-a054-4022-a52e-758b6cc79870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:40.917543 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32bb312-a054-4022-a52e-758b6cc79870 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:40.976397 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30208022-f187-4932-bfb6-4046d2f43a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:40.977012 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30208022-f187-4932-bfb6-4046d2f43a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:40.977285 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30208022-f187-4932-bfb6-4046d2f43a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:40.977563 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30208022-f187-4932-bfb6-4046d2f43a18 admin admin] PATH_INFO: `/v3/projects/879ab12901654cce87bb4651b7ec99f4` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:40.978690 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30208022-f187-4932-bfb6-4046d2f43a18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=879ab12901654cce87bb4651b7ec99f4)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:40.980629 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30208022-f187-4932-bfb6-4046d2f43a18 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:41.141915 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-30208022-f187-4932-bfb6-4046d2f43a18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '879ab12901654cce87bb4651b7ec99f4', 'request_id': 'req-30208022-f187-4932-bfb6-4046d2f43a18'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:41.148445 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-30208022-f187-4932-bfb6-4046d2f43a18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '879ab12901654cce87bb4651b7ec99f4', 'request_id': 'req-30208022-f187-4932-bfb6-4046d2f43a18'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:41.155038 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-30208022-f187-4932-bfb6-4046d2f43a18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '879ab12901654cce87bb4651b7ec99f4', 'request_id': 'req-30208022-f187-4932-bfb6-4046d2f43a18'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:41.267844 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-30208022-f187-4932-bfb6-4046d2f43a18 admin admin] The token cache is being invalidate because project 879ab12901654cce87bb4651b7ec99f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:15:41.267844 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-30208022-f187-4932-bfb6-4046d2f43a18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:41.268248 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-30208022-f187-4932-bfb6-4046d2f43a18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:41.274042 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1247/2507] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:15:40 2022] DELETE /identity/v3/projects/879ab12901654cce87bb4651b7ec99f4 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:15:41.276152 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793701c1-e3e7-4ee2-a0c6-0736265c9a04 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:41.276631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793701c1-e3e7-4ee2-a0c6-0736265c9a04 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:41.276786 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793701c1-e3e7-4ee2-a0c6-0736265c9a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:41.297217 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-793701c1-e3e7-4ee2-a0c6-0736265c9a04 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:15:41.298469 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-793701c1-e3e7-4ee2-a0c6-0736265c9a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:41.359662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1261/2508] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:15:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:15:41.369036 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc53a53-f92d-492a-acb5-c6c613b3d389 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:41.369322 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc53a53-f92d-492a-acb5-c6c613b3d389 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:41.369600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc53a53-f92d-492a-acb5-c6c613b3d389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:41.391179 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-edc53a53-f92d-492a-acb5-c6c613b3d389 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:15:41.392418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-edc53a53-f92d-492a-acb5-c6c613b3d389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:41.401311 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1248/2509] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:15:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:15:41.405624 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793701c1-e3e7-4ee2-a0c6-0736265c9a04 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:41.417125 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793701c1-e3e7-4ee2-a0c6-0736265c9a04 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:41.422247 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92870b-bd35-402e-bd57-939207aff852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:41.422984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92870b-bd35-402e-bd57-939207aff852 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:41.423200 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92870b-bd35-402e-bd57-939207aff852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:41.423483 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92870b-bd35-402e-bd57-939207aff852 admin admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:41.424131 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92870b-bd35-402e-bd57-939207aff852 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:15:41.424438 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92870b-bd35-402e-bd57-939207aff852 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:41.426058 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92870b-bd35-402e-bd57-939207aff852 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:41.439661 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1262/2510] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:15:41.444613 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc53a53-f92d-492a-acb5-c6c613b3d389 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:41.454282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc53a53-f92d-492a-acb5-c6c613b3d389 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:41.458955 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1d852-846d-4381-9387-d503f762c321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:41.464586 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1d852-846d-4381-9387-d503f762c321 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:41.464586 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1d852-846d-4381-9387-d503f762c321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:41.464586 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1d852-846d-4381-9387-d503f762c321 admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:41.464586 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb1d852-846d-4381-9387-d503f762c321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:41.464586 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb1d852-846d-4381-9387-d503f762c321 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:41.479915 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:15:41.562955 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1249/2511] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:15:41 2022] POST /identity/v3/projects => generated 401 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:15:41.567482 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92870b-bd35-402e-bd57-939207aff852 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:41.577548 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92870b-bd35-402e-bd57-939207aff852 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:41.637636 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa8224-b350-4662-a081-5f58da46605e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:41.638175 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa8224-b350-4662-a081-5f58da46605e admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:41.638458 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa8224-b350-4662-a081-5f58da46605e admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:41.638758 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa8224-b350-4662-a081-5f58da46605e admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:41.639462 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa8224-b350-4662-a081-5f58da46605e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:41.641411 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa8224-b350-4662-a081-5f58da46605e admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:41.735262 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1263/2512] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:15:41 2022] POST /identity/v3/users => generated 301 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:15:41.739098 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1d852-846d-4381-9387-d503f762c321 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:41.750965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1d852-846d-4381-9387-d503f762c321 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:41.755849 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec4392-c416-4344-9004-d0924a43ed3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:41.756750 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec4392-c416-4344-9004-d0924a43ed3c admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:41.757447 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec4392-c416-4344-9004-d0924a43ed3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:41.757746 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec4392-c416-4344-9004-d0924a43ed3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:41.758418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec4392-c416-4344-9004-d0924a43ed3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:41.760051 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec4392-c416-4344-9004-d0924a43ed3c admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:41.770455 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1250/2513] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:15:41.775861 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa8224-b350-4662-a081-5f58da46605e admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:41.785947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa8224-b350-4662-a081-5f58da46605e admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:41.791202 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74083f71-7c8a-490c-81f2-ed138e28fe9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:41.791800 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74083f71-7c8a-490c-81f2-ed138e28fe9c admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:41.792082 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74083f71-7c8a-490c-81f2-ed138e28fe9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:41.792355 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74083f71-7c8a-490c-81f2-ed138e28fe9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:41.792994 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74083f71-7c8a-490c-81f2-ed138e28fe9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:41.794597 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74083f71-7c8a-490c-81f2-ed138e28fe9c admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:41.816182 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:15:41.822419 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1264/2514] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:15:41.826645 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec4392-c416-4344-9004-d0924a43ed3c admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:41.838058 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec4392-c416-4344-9004-d0924a43ed3c admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:41.843159 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e70818-5ff1-48c0-bea8-4fc7baac2b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:41.844162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e70818-5ff1-48c0-bea8-4fc7baac2b2e admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:41.844162 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e70818-5ff1-48c0-bea8-4fc7baac2b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:41.844361 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e70818-5ff1-48c0-bea8-4fc7baac2b2e admin admin] PATH_INFO: `/v3/projects/1c8662f17086400c86f236513c4d9e62/users/0317656248c04d64b3e4fbf8a1576b8e/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:41.867063 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e70818-5ff1-48c0-bea8-4fc7baac2b2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c8662f17086400c86f236513c4d9e62, user_id=0317656248c04d64b3e4fbf8a1576b8e, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:41.869916 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e70818-5ff1-48c0-bea8-4fc7baac2b2e admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:41.974620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1251/2515] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:15:41 2022] PUT /identity/v3/projects/1c8662f17086400c86f236513c4d9e62/users/0317656248c04d64b3e4fbf8a1576b8e/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:15:41.986099 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12daaf-14e7-45c3-9032-34e538ea03a2 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:41.986508 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12daaf-14e7-45c3-9032-34e538ea03a2 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:41.986855 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d12daaf-14e7-45c3-9032-34e538ea03a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:42.017781 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-0d12daaf-14e7-45c3-9032-34e538ea03a2 None None] MFA Rules not processed for user `0317656248c04d64b3e4fbf8a1576b8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:15:42.019018 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-0d12daaf-14e7-45c3-9032-34e538ea03a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:42.086417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1265/2516] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:15:41 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:15:42.090923 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e70818-5ff1-48c0-bea8-4fc7baac2b2e admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:42.165203 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e70818-5ff1-48c0-bea8-4fc7baac2b2e admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:42.169945 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336606cc-c11e-4fb4-9912-22da02ffb8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:42.170555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336606cc-c11e-4fb4-9912-22da02ffb8a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:42.170832 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336606cc-c11e-4fb4-9912-22da02ffb8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:42.171157 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336606cc-c11e-4fb4-9912-22da02ffb8a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:42.171798 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336606cc-c11e-4fb4-9912-22da02ffb8a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:42.173720 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336606cc-c11e-4fb4-9912-22da02ffb8a9 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:42.265117 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1252/2517] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:15:42 2022] POST /identity/v3/projects => generated 399 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:15:42.266666 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12daaf-14e7-45c3-9032-34e538ea03a2 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:42.279835 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d12daaf-14e7-45c3-9032-34e538ea03a2 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:42.356756 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4f36f-6ac6-4e2a-8ebc-7c58a7bcf177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:42.357432 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4f36f-6ac6-4e2a-8ebc-7c58a7bcf177 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:42.357767 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4f36f-6ac6-4e2a-8ebc-7c58a7bcf177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:42.358050 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4f36f-6ac6-4e2a-8ebc-7c58a7bcf177 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:42.358715 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4f36f-6ac6-4e2a-8ebc-7c58a7bcf177 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:42.360920 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f4f36f-6ac6-4e2a-8ebc-7c58a7bcf177 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:42.428957 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1266/2518] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:15:42 2022] POST /identity/v3/users => generated 306 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:15:42.430537 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336606cc-c11e-4fb4-9912-22da02ffb8a9 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:42.441510 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336606cc-c11e-4fb4-9912-22da02ffb8a9 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:42.447986 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02c86e-603e-4bab-ac85-44176f488ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:42.448658 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02c86e-603e-4bab-ac85-44176f488ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:42.449071 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02c86e-603e-4bab-ac85-44176f488ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:42.449351 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad02c86e-603e-4bab-ac85-44176f488ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:42.450686 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02c86e-603e-4bab-ac85-44176f488ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:42.451917 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad02c86e-603e-4bab-ac85-44176f488ab9 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:42.464022 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1253/2519] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:15:42.468214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4f36f-6ac6-4e2a-8ebc-7c58a7bcf177 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:42.478780 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4f36f-6ac6-4e2a-8ebc-7c58a7bcf177 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:42.483426 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78047290-f4b9-4dbe-9e07-db240387b41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:42.484074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78047290-f4b9-4dbe-9e07-db240387b41e admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:42.484366 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78047290-f4b9-4dbe-9e07-db240387b41e admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:42.484621 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78047290-f4b9-4dbe-9e07-db240387b41e admin admin] PATH_INFO: `/v3/projects/3fef340882fc4926a49dc83570b2fee5/users/6470253f80ab4a4dacdefecc491714aa/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:42.500279 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78047290-f4b9-4dbe-9e07-db240387b41e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fef340882fc4926a49dc83570b2fee5, user_id=6470253f80ab4a4dacdefecc491714aa, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:42.502927 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78047290-f4b9-4dbe-9e07-db240387b41e admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:42.590128 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1267/2520] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:15:42 2022] PUT /identity/v3/projects/3fef340882fc4926a49dc83570b2fee5/users/6470253f80ab4a4dacdefecc491714aa/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:15:42.594137 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02c86e-603e-4bab-ac85-44176f488ab9 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:42.604579 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad02c86e-603e-4bab-ac85-44176f488ab9 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:42.663550 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e1411-dac7-4596-8e37-0483cd08a16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:42.664190 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e1411-dac7-4596-8e37-0483cd08a16b admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:42.664473 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e1411-dac7-4596-8e37-0483cd08a16b admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:42.664778 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e1411-dac7-4596-8e37-0483cd08a16b admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:42.665424 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e1411-dac7-4596-8e37-0483cd08a16b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:42.667072 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e1411-dac7-4596-8e37-0483cd08a16b admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:42.677319 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1254/2521] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:15:42.681872 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78047290-f4b9-4dbe-9e07-db240387b41e admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:42.692843 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78047290-f4b9-4dbe-9e07-db240387b41e admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:42.698234 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2dce1d-95db-4684-a831-a04d19e17b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:42.698884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2dce1d-95db-4684-a831-a04d19e17b0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:42.699187 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2dce1d-95db-4684-a831-a04d19e17b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:42.699467 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2dce1d-95db-4684-a831-a04d19e17b0e admin admin] PATH_INFO: `/v3/projects/3fef340882fc4926a49dc83570b2fee5/users/6470253f80ab4a4dacdefecc491714aa/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:42.701364 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2dce1d-95db-4684-a831-a04d19e17b0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fef340882fc4926a49dc83570b2fee5, user_id=6470253f80ab4a4dacdefecc491714aa, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:42.704093 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2dce1d-95db-4684-a831-a04d19e17b0e admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:42.715008 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1268/2522] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:15:42 2022] PUT /identity/v3/projects/3fef340882fc4926a49dc83570b2fee5/users/6470253f80ab4a4dacdefecc491714aa/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:15:42.728793 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc484983-4bd0-4f60-97cd-9c2bff140039 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:42.729072 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc484983-4bd0-4f60-97cd-9c2bff140039 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:42.729347 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc484983-4bd0-4f60-97cd-9c2bff140039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:42.758353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-cc484983-4bd0-4f60-97cd-9c2bff140039 None None] MFA Rules not processed for user `6470253f80ab4a4dacdefecc491714aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:15:42.759582 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-cc484983-4bd0-4f60-97cd-9c2bff140039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:42.778580 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:15:42.834659 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1255/2523] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:15:42 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:15:42.848487 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2dce1d-95db-4684-a831-a04d19e17b0e admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:42.850357 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-0b2dce1d-95db-4684-a831-a04d19e17b0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:42.906655 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:15:42.918649 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2dce1d-95db-4684-a831-a04d19e17b0e admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:42.922432 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e17daa-4f5b-426d-a37d-520ad3fbbb98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:42.923062 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e17daa-4f5b-426d-a37d-520ad3fbbb98 service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:42.923367 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e17daa-4f5b-426d-a37d-520ad3fbbb98 service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:42.923635 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e17daa-4f5b-426d-a37d-520ad3fbbb98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:42.934079 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e17daa-4f5b-426d-a37d-520ad3fbbb98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:42.935560 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e17daa-4f5b-426d-a37d-520ad3fbbb98 service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:42.952595 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1269/2524] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:15:42 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:15:43.209693 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc484983-4bd0-4f60-97cd-9c2bff140039 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:43.219649 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc484983-4bd0-4f60-97cd-9c2bff140039 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:43.223323 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc67a82-3a86-4445-9a94-f9e78df53619 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:43.226193 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc67a82-3a86-4445-9a94-f9e78df53619 service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:43.226193 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc67a82-3a86-4445-9a94-f9e78df53619 service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:43.226193 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc67a82-3a86-4445-9a94-f9e78df53619 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:43.281637 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc67a82-3a86-4445-9a94-f9e78df53619 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:43.283089 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc67a82-3a86-4445-9a94-f9e78df53619 service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:43.293067 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1256/2525] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:15:43 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:15:48.533094 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e17daa-4f5b-426d-a37d-520ad3fbbb98 service cinder] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:48.609013 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e17daa-4f5b-426d-a37d-520ad3fbbb98 service cinder] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:48.614007 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f8dd0-5e8b-4cc3-a72d-cd86d3ddaaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:48.614657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f8dd0-5e8b-4cc3-a72d-cd86d3ddaaca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:48.614940 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f8dd0-5e8b-4cc3-a72d-cd86d3ddaaca admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:48.615244 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f8dd0-5e8b-4cc3-a72d-cd86d3ddaaca admin admin] PATH_INFO: `/v3/users/0317656248c04d64b3e4fbf8a1576b8e` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:48.616925 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f8dd0-5e8b-4cc3-a72d-cd86d3ddaaca admin admin] RBAC: Authorizing `identity:delete_user(user_id=0317656248c04d64b3e4fbf8a1576b8e)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:48.620298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f8dd0-5e8b-4cc3-a72d-cd86d3ddaaca admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:48.724194 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc67a82-3a86-4445-9a94-f9e78df53619 service cinder] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:48.725683 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-1bc67a82-3a86-4445-9a94-f9e78df53619 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:48.822728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc67a82-3a86-4445-9a94-f9e78df53619 service cinder] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:48.828977 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52181b3a-7751-4f80-8d54-1df1c56d69a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:48.829632 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52181b3a-7751-4f80-8d54-1df1c56d69a0 service nova] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:48.829921 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52181b3a-7751-4f80-8d54-1df1c56d69a0 service nova] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:48.830184 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52181b3a-7751-4f80-8d54-1df1c56d69a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:48.832259 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-52181b3a-7751-4f80-8d54-1df1c56d69a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:48.848747 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-b44f8dd0-5e8b-4cc3-a72d-cd86d3ddaaca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0317656248c04d64b3e4fbf8a1576b8e'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:48.865311 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-b44f8dd0-5e8b-4cc3-a72d-cd86d3ddaaca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0317656248c04d64b3e4fbf8a1576b8e'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:48.888418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:15:48.898966 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52181b3a-7751-4f80-8d54-1df1c56d69a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:48.900781 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52181b3a-7751-4f80-8d54-1df1c56d69a0 service nova] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:48.910836 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1257/2526] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:15:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:15:48.915476 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52181b3a-7751-4f80-8d54-1df1c56d69a0 service nova] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:48.916865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-52181b3a-7751-4f80-8d54-1df1c56d69a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:48.928978 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-b44f8dd0-5e8b-4cc3-a72d-cd86d3ddaaca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0317656248c04d64b3e4fbf8a1576b8e'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:48.930341 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-b44f8dd0-5e8b-4cc3-a72d-cd86d3ddaaca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0317656248c04d64b3e4fbf8a1576b8e'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:48.932854 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-b44f8dd0-5e8b-4cc3-a72d-cd86d3ddaaca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0317656248c04d64b3e4fbf8a1576b8e'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:48.970773 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1270/2527] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:15:48 2022] DELETE /identity/v3/users/0317656248c04d64b3e4fbf8a1576b8e => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:15:48.976185 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b516bd-247b-40f4-91ab-769b695ebdef None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:48.976393 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b516bd-247b-40f4-91ab-769b695ebdef None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:48.976675 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b516bd-247b-40f4-91ab-769b695ebdef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:49.000517 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-14b516bd-247b-40f4-91ab-769b695ebdef None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:15:49.002477 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-14b516bd-247b-40f4-91ab-769b695ebdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:49.005909 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52181b3a-7751-4f80-8d54-1df1c56d69a0 service nova] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:49.074131 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1271/2528] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:15:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:15:49.074336 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b074f16-8ba3-4add-82bc-837697609834 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6aad0e9f5f4a0b9578a31082e726cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:49.074893 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b074f16-8ba3-4add-82bc-837697609834 service glance] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:49.075217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b074f16-8ba3-4add-82bc-837697609834 service glance] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:49.075475 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b074f16-8ba3-4add-82bc-837697609834 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:49.077547 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-9b074f16-8ba3-4add-82bc-837697609834 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:49.084552 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b516bd-247b-40f4-91ab-769b695ebdef None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:49.089148 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-14b516bd-247b-40f4-91ab-769b695ebdef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:49.095867 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:15:49.143880 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b074f16-8ba3-4add-82bc-837697609834 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:49.145351 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b074f16-8ba3-4add-82bc-837697609834 service glance] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:49.156037 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1258/2529] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:15:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:15:49.278029 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b516bd-247b-40f4-91ab-769b695ebdef None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:49.281784 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df8f27-42ad-4ac1-b46e-73797a038d1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:49.282390 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df8f27-42ad-4ac1-b46e-73797a038d1e service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:49.282650 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df8f27-42ad-4ac1-b46e-73797a038d1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:49.282913 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df8f27-42ad-4ac1-b46e-73797a038d1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:49.293487 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df8f27-42ad-4ac1-b46e-73797a038d1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:49.294917 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df8f27-42ad-4ac1-b46e-73797a038d1e service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:49.305537 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1272/2530] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:15:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:15:49.766275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b074f16-8ba3-4add-82bc-837697609834 service glance] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:49.767895 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-9b074f16-8ba3-4add-82bc-837697609834 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:49.787190 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b074f16-8ba3-4add-82bc-837697609834 service glance] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:49.791181 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa3975-399d-446c-8499-1983fcb96f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:49.791930 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa3975-399d-446c-8499-1983fcb96f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:49.792305 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa3975-399d-446c-8499-1983fcb96f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:49.792645 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa3975-399d-446c-8499-1983fcb96f80 admin admin] PATH_INFO: `/v3/projects/1c8662f17086400c86f236513c4d9e62` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:49.793848 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa3975-399d-446c-8499-1983fcb96f80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c8662f17086400c86f236513c4d9e62)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:49.795910 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa3975-399d-446c-8499-1983fcb96f80 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:49.806880 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f16d5-7187-4479-84da-6629567e1397 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:49.807635 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f16d5-7187-4479-84da-6629567e1397 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:49.807635 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033f16d5-7187-4479-84da-6629567e1397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:49.829691 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-033f16d5-7187-4479-84da-6629567e1397 None None] MFA Rules not processed for user `ae9fc5f06a0441da80e656fa1e88db5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:15:49.830912 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-033f16d5-7187-4479-84da-6629567e1397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:49.891342 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1273/2531] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Aug 24 17:15:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:15:49.921651 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-9aaa3975-399d-446c-8499-1983fcb96f80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c8662f17086400c86f236513c4d9e62', 'request_id': 'req-9aaa3975-399d-446c-8499-1983fcb96f80'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:49.927936 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:15:49.930277 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-9aaa3975-399d-446c-8499-1983fcb96f80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c8662f17086400c86f236513c4d9e62', 'request_id': 'req-9aaa3975-399d-446c-8499-1983fcb96f80'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:49.945946 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-9aaa3975-399d-446c-8499-1983fcb96f80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c8662f17086400c86f236513c4d9e62', 'request_id': 'req-9aaa3975-399d-446c-8499-1983fcb96f80'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:50.035252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-9aaa3975-399d-446c-8499-1983fcb96f80 admin admin] The token cache is being invalidate because project 1c8662f17086400c86f236513c4d9e62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:15:50.035586 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-9aaa3975-399d-446c-8499-1983fcb96f80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:50.036307 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-9aaa3975-399d-446c-8499-1983fcb96f80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:50.038773 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1259/2532] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:15:49 2022] DELETE /identity/v3/projects/1c8662f17086400c86f236513c4d9e62 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:15:50.042105 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f16d5-7187-4479-84da-6629567e1397 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:50.054702 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033f16d5-7187-4479-84da-6629567e1397 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:50.077114 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa3975-399d-446c-8499-1983fcb96f80 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:50.079524 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-9aaa3975-399d-446c-8499-1983fcb96f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:50.130130 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfbe77f-e4b3-41c2-ac45-821869a4d970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:50.131548 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbe77f-e4b3-41c2-ac45-821869a4d970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:50.131886 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbe77f-e4b3-41c2-ac45-821869a4d970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:50.132557 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfbe77f-e4b3-41c2-ac45-821869a4d970 admin admin] PATH_INFO: `/v3/users/6470253f80ab4a4dacdefecc491714aa` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:50.133470 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfbe77f-e4b3-41c2-ac45-821869a4d970 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6470253f80ab4a4dacdefecc491714aa)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:50.135590 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfbe77f-e4b3-41c2-ac45-821869a4d970 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:50.179330 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa3975-399d-446c-8499-1983fcb96f80 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:50.184654 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685cb56-bd5a-4e0d-8be7-e42ee4e94456 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c067bc2d84b741d08ac47e40adae4b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:50.185420 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685cb56-bd5a-4e0d-8be7-e42ee4e94456 service swift] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:50.185698 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685cb56-bd5a-4e0d-8be7-e42ee4e94456 service swift] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:50.185967 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685cb56-bd5a-4e0d-8be7-e42ee4e94456 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:50.189139 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-c685cb56-bd5a-4e0d-8be7-e42ee4e94456 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:50.253090 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685cb56-bd5a-4e0d-8be7-e42ee4e94456 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:50.254783 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685cb56-bd5a-4e0d-8be7-e42ee4e94456 service swift] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:50.265443 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1260/2533] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Aug 24 17:15:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:15:50.388267 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-9dfbe77f-e4b3-41c2-ac45-821869a4d970 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6470253f80ab4a4dacdefecc491714aa'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:50.397859 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:15:50.402612 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-9dfbe77f-e4b3-41c2-ac45-821869a4d970 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6470253f80ab4a4dacdefecc491714aa'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:50.482255 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-9dfbe77f-e4b3-41c2-ac45-821869a4d970 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6470253f80ab4a4dacdefecc491714aa'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:50.482891 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-9dfbe77f-e4b3-41c2-ac45-821869a4d970 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6470253f80ab4a4dacdefecc491714aa'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:50.483638 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-9dfbe77f-e4b3-41c2-ac45-821869a4d970 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6470253f80ab4a4dacdefecc491714aa'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:50.515161 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1274/2534] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:15:50 2022] DELETE /identity/v3/users/6470253f80ab4a4dacdefecc491714aa => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:15:51.092188 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685cb56-bd5a-4e0d-8be7-e42ee4e94456 service swift] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:51.094231 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-c685cb56-bd5a-4e0d-8be7-e42ee4e94456 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:51.109123 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685cb56-bd5a-4e0d-8be7-e42ee4e94456 service swift] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:51.188978 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e84080-8bb7-425e-85b9-86dd6dfd7a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:51.189991 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e84080-8bb7-425e-85b9-86dd6dfd7a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:51.189991 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e84080-8bb7-425e-85b9-86dd6dfd7a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:51.190299 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e84080-8bb7-425e-85b9-86dd6dfd7a93 admin admin] PATH_INFO: `/v3/projects/3fef340882fc4926a49dc83570b2fee5` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:51.191579 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e84080-8bb7-425e-85b9-86dd6dfd7a93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fef340882fc4926a49dc83570b2fee5)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:51.193537 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e84080-8bb7-425e-85b9-86dd6dfd7a93 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:51.368955 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:15:51.400502 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-10e84080-8bb7-425e-85b9-86dd6dfd7a93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fef340882fc4926a49dc83570b2fee5', 'request_id': 'req-10e84080-8bb7-425e-85b9-86dd6dfd7a93'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:51.417000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-10e84080-8bb7-425e-85b9-86dd6dfd7a93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fef340882fc4926a49dc83570b2fee5', 'request_id': 'req-10e84080-8bb7-425e-85b9-86dd6dfd7a93'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:51.424895 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-10e84080-8bb7-425e-85b9-86dd6dfd7a93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fef340882fc4926a49dc83570b2fee5', 'request_id': 'req-10e84080-8bb7-425e-85b9-86dd6dfd7a93'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:51.540732 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-10e84080-8bb7-425e-85b9-86dd6dfd7a93 admin admin] The token cache is being invalidate because project 3fef340882fc4926a49dc83570b2fee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:15:51.541034 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-10e84080-8bb7-425e-85b9-86dd6dfd7a93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:51.541863 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-10e84080-8bb7-425e-85b9-86dd6dfd7a93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:15:51.564735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1261/2535] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:15:51 2022] DELETE /identity/v3/projects/3fef340882fc4926a49dc83570b2fee5 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:15:51.570817 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3902dab-6697-46d8-8494-25c475cbbacc None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:51.571551 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3902dab-6697-46d8-8494-25c475cbbacc None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:51.571551 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3902dab-6697-46d8-8494-25c475cbbacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:51.594822 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-c3902dab-6697-46d8-8494-25c475cbbacc None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:15:51.596806 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-c3902dab-6697-46d8-8494-25c475cbbacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:51.693196 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1275/2536] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:15:51.694777 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f166c-64cc-488b-9f36-0447fec6eca2 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:51.695325 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f166c-64cc-488b-9f36-0447fec6eca2 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:51.695816 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f166c-64cc-488b-9f36-0447fec6eca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:51.727848 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-390f166c-64cc-488b-9f36-0447fec6eca2 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:15:51.729368 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-390f166c-64cc-488b-9f36-0447fec6eca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:51.738395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1262/2537] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:15:51.743519 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3902dab-6697-46d8-8494-25c475cbbacc None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:51.754907 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3902dab-6697-46d8-8494-25c475cbbacc None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:51.762477 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58857ed-3948-4fac-88e1-e26a9edeaf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:51.763098 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58857ed-3948-4fac-88e1-e26a9edeaf52 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:51.763422 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58857ed-3948-4fac-88e1-e26a9edeaf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:51.763754 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58857ed-3948-4fac-88e1-e26a9edeaf52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:51.764562 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58857ed-3948-4fac-88e1-e26a9edeaf52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:15:51.765052 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58857ed-3948-4fac-88e1-e26a9edeaf52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:51.766702 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58857ed-3948-4fac-88e1-e26a9edeaf52 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:51.791172 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1276/2538] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:15:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:15:51.792959 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f166c-64cc-488b-9f36-0447fec6eca2 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:51.807504 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f166c-64cc-488b-9f36-0447fec6eca2 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:51.814588 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0daaf-97df-46e0-a392-d03ea9d840c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:51.815554 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0daaf-97df-46e0-a392-d03ea9d840c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:51.815920 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0daaf-97df-46e0-a392-d03ea9d840c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:51.816295 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c0daaf-97df-46e0-a392-d03ea9d840c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:51.817170 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0daaf-97df-46e0-a392-d03ea9d840c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:51.820620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c0daaf-97df-46e0-a392-d03ea9d840c2 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:51.942393 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1263/2539] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:15:51 2022] POST /identity/v3/projects => generated 371 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:15:51.946899 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58857ed-3948-4fac-88e1-e26a9edeaf52 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:51.959170 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58857ed-3948-4fac-88e1-e26a9edeaf52 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:52.044299 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b8ca9-6885-40c1-9346-62a89c64376d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:52.045038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b8ca9-6885-40c1-9346-62a89c64376d admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:52.045386 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b8ca9-6885-40c1-9346-62a89c64376d admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:52.045756 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b8ca9-6885-40c1-9346-62a89c64376d admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:52.046520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b8ca9-6885-40c1-9346-62a89c64376d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:52.048661 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b8ca9-6885-40c1-9346-62a89c64376d admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:52.180750 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1277/2540] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:15:51 2022] POST /identity/v3/users => generated 286 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:15:52.184740 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0daaf-97df-46e0-a392-d03ea9d840c2 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:52.197004 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c0daaf-97df-46e0-a392-d03ea9d840c2 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:52.201971 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd6d29-e82f-41a9-a421-0643c896b702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:52.202645 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd6d29-e82f-41a9-a421-0643c896b702 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:52.203004 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd6d29-e82f-41a9-a421-0643c896b702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:52.203363 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd6d29-e82f-41a9-a421-0643c896b702 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:52.204065 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd6d29-e82f-41a9-a421-0643c896b702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:52.205792 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd6d29-e82f-41a9-a421-0643c896b702 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:52.221141 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1264/2541] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:15:52.222397 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b8ca9-6885-40c1-9346-62a89c64376d admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:52.235099 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b8ca9-6885-40c1-9346-62a89c64376d admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:52.239967 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8413d8-e9e9-475e-9d31-4976452dc968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:52.240658 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8413d8-e9e9-475e-9d31-4976452dc968 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:52.240993 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8413d8-e9e9-475e-9d31-4976452dc968 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:52.241219 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8413d8-e9e9-475e-9d31-4976452dc968 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:52.241826 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8413d8-e9e9-475e-9d31-4976452dc968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:52.243436 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8413d8-e9e9-475e-9d31-4976452dc968 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:52.255099 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1278/2542] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:15:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:15:52.260106 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd6d29-e82f-41a9-a421-0643c896b702 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:52.271095 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd6d29-e82f-41a9-a421-0643c896b702 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:52.277619 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f8f93-7f3d-46c8-bc78-5a8126b31072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:52.278724 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f8f93-7f3d-46c8-bc78-5a8126b31072 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:52.279245 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f8f93-7f3d-46c8-bc78-5a8126b31072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:52.279737 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f8f93-7f3d-46c8-bc78-5a8126b31072 admin admin] PATH_INFO: `/v3/projects/9b24a2a62f504492b000a4f603b3672d/users/2d270c83062447b98b954f675880389d/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:52.298387 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f8f93-7f3d-46c8-bc78-5a8126b31072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b24a2a62f504492b000a4f603b3672d, user_id=2d270c83062447b98b954f675880389d, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:52.301797 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f8f93-7f3d-46c8-bc78-5a8126b31072 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:52.378589 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1265/2543] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:15:52 2022] PUT /identity/v3/projects/9b24a2a62f504492b000a4f603b3672d/users/2d270c83062447b98b954f675880389d/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:15:52.392116 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb5b76-51d8-4de3-9e6f-482529016ab6 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:52.392618 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb5b76-51d8-4de3-9e6f-482529016ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:52.393078 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb5b76-51d8-4de3-9e6f-482529016ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:52.429168 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-aacb5b76-51d8-4de3-9e6f-482529016ab6 None None] MFA Rules not processed for user `2d270c83062447b98b954f675880389d`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:15:52.430528 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-aacb5b76-51d8-4de3-9e6f-482529016ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:52.462619 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:15:52.505662 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1279/2544] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:15:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:15:52.524588 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f8f93-7f3d-46c8-bc78-5a8126b31072 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:15:52.526680 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-aa9f8f93-7f3d-46c8-bc78-5a8126b31072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:15:52.601930 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f8f93-7f3d-46c8-bc78-5a8126b31072 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:15:52.609942 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43362a-ecfb-4bf9-b684-ba385b547f63 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6aad0e9f5f4a0b9578a31082e726cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:15:52.610699 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43362a-ecfb-4bf9-b684-ba385b547f63 service glance] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:15:52.611057 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43362a-ecfb-4bf9-b684-ba385b547f63 service glance] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:15:52.612067 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43362a-ecfb-4bf9-b684-ba385b547f63 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:15:52.622615 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43362a-ecfb-4bf9-b684-ba385b547f63 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:15:52.624183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43362a-ecfb-4bf9-b684-ba385b547f63 service glance] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:15:52.636715 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1266/2545] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:15:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:16:02.363154 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb5b76-51d8-4de3-9e6f-482529016ab6 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:02.364673 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-aacb5b76-51d8-4de3-9e6f-482529016ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:02.429712 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb5b76-51d8-4de3-9e6f-482529016ab6 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:02.433323 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49f27dd-9bdb-41c1-abef-6e5635e13f73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:02.433929 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f27dd-9bdb-41c1-abef-6e5635e13f73 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:02.434200 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f27dd-9bdb-41c1-abef-6e5635e13f73 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:02.434467 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49f27dd-9bdb-41c1-abef-6e5635e13f73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:02.436200 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-e49f27dd-9bdb-41c1-abef-6e5635e13f73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:02.447131 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f27dd-9bdb-41c1-abef-6e5635e13f73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:02.448572 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49f27dd-9bdb-41c1-abef-6e5635e13f73 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:02.458527 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1280/2546] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:16:02.630652 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=67,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:09.066978 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43362a-ecfb-4bf9-b684-ba385b547f63 service glance] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:09.068519 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-3f43362a-ecfb-4bf9-b684-ba385b547f63 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:09.142468 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43362a-ecfb-4bf9-b684-ba385b547f63 service glance] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:09.147502 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ac119-ed55-4000-8e12-9f925ad4be71 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ef97356edf406aad9ab5f502bdb0af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:09.148105 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ac119-ed55-4000-8e12-9f925ad4be71 service placement] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:09.148454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ac119-ed55-4000-8e12-9f925ad4be71 service placement] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:09.149361 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ac119-ed55-4000-8e12-9f925ad4be71 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:09.151238 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-296ac119-ed55-4000-8e12-9f925ad4be71 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:09.163104 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ac119-ed55-4000-8e12-9f925ad4be71 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:09.164929 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ac119-ed55-4000-8e12-9f925ad4be71 service placement] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:09.175335 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1267/2547] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:16:11.464279 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888db1a-a835-421c-8453-4e8232317529 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:11.464768 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888db1a-a835-421c-8453-4e8232317529 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:11.464862 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888db1a-a835-421c-8453-4e8232317529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:11.484728 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-a888db1a-a835-421c-8453-4e8232317529 None None] MFA Rules not processed for user `ae9fc5f06a0441da80e656fa1e88db5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:11.486097 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-a888db1a-a835-421c-8453-4e8232317529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:11.543061 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1281/2548] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Aug 24 17:16:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:11.555957 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ac119-ed55-4000-8e12-9f925ad4be71 service placement] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:11.557386 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-296ac119-ed55-4000-8e12-9f925ad4be71 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:11.629789 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ac119-ed55-4000-8e12-9f925ad4be71 service placement] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:11.635101 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8d35a5-b6c5-4f88-bf98-e2b2ac021d6c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c067bc2d84b741d08ac47e40adae4b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:11.635724 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d35a5-b6c5-4f88-bf98-e2b2ac021d6c service swift] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:11.636000 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d35a5-b6c5-4f88-bf98-e2b2ac021d6c service swift] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:11.636270 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8d35a5-b6c5-4f88-bf98-e2b2ac021d6c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:11.645562 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d35a5-b6c5-4f88-bf98-e2b2ac021d6c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:11.647189 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8d35a5-b6c5-4f88-bf98-e2b2ac021d6c service swift] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:11.656564 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1268/2549] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Aug 24 17:16:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:16:18.947400 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888db1a-a835-421c-8453-4e8232317529 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:19.035103 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888db1a-a835-421c-8453-4e8232317529 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:19.039919 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e84a48-6aba-44b0-ad14-bc3cd5d21458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:19.040566 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e84a48-6aba-44b0-ad14-bc3cd5d21458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:19.040838 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e84a48-6aba-44b0-ad14-bc3cd5d21458 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:19.041107 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e84a48-6aba-44b0-ad14-bc3cd5d21458 admin admin] PATH_INFO: `/v3/users/2d270c83062447b98b954f675880389d` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:19.042327 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e84a48-6aba-44b0-ad14-bc3cd5d21458 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d270c83062447b98b954f675880389d)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:19.044277 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e84a48-6aba-44b0-ad14-bc3cd5d21458 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:19.075307 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:19.290269 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-e3e84a48-6aba-44b0-ad14-bc3cd5d21458 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d270c83062447b98b954f675880389d'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:19.319961 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-e3e84a48-6aba-44b0-ad14-bc3cd5d21458 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d270c83062447b98b954f675880389d'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:19.395803 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-e3e84a48-6aba-44b0-ad14-bc3cd5d21458 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d270c83062447b98b954f675880389d'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:19.396418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-e3e84a48-6aba-44b0-ad14-bc3cd5d21458 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d270c83062447b98b954f675880389d'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:19.397019 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-e3e84a48-6aba-44b0-ad14-bc3cd5d21458 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d270c83062447b98b954f675880389d'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:19.416723 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1282/2550] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:16:18 2022] DELETE /identity/v3/users/2d270c83062447b98b954f675880389d => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:19.421595 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3062e-0cee-4dde-bb80-980a297fe078 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:19.422072 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3062e-0cee-4dde-bb80-980a297fe078 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:19.422169 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3062e-0cee-4dde-bb80-980a297fe078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:19.443705 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-70c3062e-0cee-4dde-bb80-980a297fe078 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:19.445002 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-70c3062e-0cee-4dde-bb80-980a297fe078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:19.529223 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1269/2551] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:16:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:19.540596 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e84a48-6aba-44b0-ad14-bc3cd5d21458 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:19.542633 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-e3e84a48-6aba-44b0-ad14-bc3cd5d21458 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:19.697911 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e84a48-6aba-44b0-ad14-bc3cd5d21458 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:19.701843 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54909cbe-d45c-4b6e-a680-319e0a17b1c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:19.702458 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54909cbe-d45c-4b6e-a680-319e0a17b1c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:19.702742 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54909cbe-d45c-4b6e-a680-319e0a17b1c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:19.703032 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54909cbe-d45c-4b6e-a680-319e0a17b1c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:19.718052 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54909cbe-d45c-4b6e-a680-319e0a17b1c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:19.720403 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54909cbe-d45c-4b6e-a680-319e0a17b1c9 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:19.731466 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1283/2552] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:16:20.544642 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3062e-0cee-4dde-bb80-980a297fe078 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:20.546337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-70c3062e-0cee-4dde-bb80-980a297fe078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:20.581422 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:20.656714 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3062e-0cee-4dde-bb80-980a297fe078 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:20.668639 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8429804f-0539-4d93-b370-9e8774974b0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:20.669667 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429804f-0539-4d93-b370-9e8774974b0b service nova] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:20.670149 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429804f-0539-4d93-b370-9e8774974b0b service nova] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:20.670731 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8429804f-0539-4d93-b370-9e8774974b0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:20.673674 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-8429804f-0539-4d93-b370-9e8774974b0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:20.789135 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8429804f-0539-4d93-b370-9e8774974b0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:20.792256 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8429804f-0539-4d93-b370-9e8774974b0b service nova] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:20.807395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1270/2553] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:16:21.422063 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54909cbe-d45c-4b6e-a680-319e0a17b1c9 service neutron] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:21.424014 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-54909cbe-d45c-4b6e-a680-319e0a17b1c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:21.438087 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54909cbe-d45c-4b6e-a680-319e0a17b1c9 service neutron] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:21.443891 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049f0a04-3b97-4368-9df5-cd3a6dd5550a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:21.444530 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f0a04-3b97-4368-9df5-cd3a6dd5550a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:21.444808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f0a04-3b97-4368-9df5-cd3a6dd5550a admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:21.445114 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049f0a04-3b97-4368-9df5-cd3a6dd5550a admin admin] PATH_INFO: `/v3/projects/9b24a2a62f504492b000a4f603b3672d` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:21.446798 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f0a04-3b97-4368-9df5-cd3a6dd5550a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b24a2a62f504492b000a4f603b3672d)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:21.448863 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049f0a04-3b97-4368-9df5-cd3a6dd5550a admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:21.620883 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-049f0a04-3b97-4368-9df5-cd3a6dd5550a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b24a2a62f504492b000a4f603b3672d', 'request_id': 'req-049f0a04-3b97-4368-9df5-cd3a6dd5550a'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:21.627062 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-049f0a04-3b97-4368-9df5-cd3a6dd5550a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b24a2a62f504492b000a4f603b3672d', 'request_id': 'req-049f0a04-3b97-4368-9df5-cd3a6dd5550a'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:21.704614 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-049f0a04-3b97-4368-9df5-cd3a6dd5550a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b24a2a62f504492b000a4f603b3672d', 'request_id': 'req-049f0a04-3b97-4368-9df5-cd3a6dd5550a'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:21.718740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-049f0a04-3b97-4368-9df5-cd3a6dd5550a admin admin] The token cache is being invalidate because project 9b24a2a62f504492b000a4f603b3672d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:16:21.719128 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-049f0a04-3b97-4368-9df5-cd3a6dd5550a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:21.719902 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-049f0a04-3b97-4368-9df5-cd3a6dd5550a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:21.721697 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1284/2554] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:16:21 2022] DELETE /identity/v3/projects/9b24a2a62f504492b000a4f603b3672d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:21.726775 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df87f2-0297-4b7e-a811-d67d841d8d8d None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:21.728473 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df87f2-0297-4b7e-a811-d67d841d8d8d None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:21.728473 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df87f2-0297-4b7e-a811-d67d841d8d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:21.751697 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-d7df87f2-0297-4b7e-a811-d67d841d8d8d None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:21.753237 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-d7df87f2-0297-4b7e-a811-d67d841d8d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:21.821499 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1271/2555] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:21.829392 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74036ce-cb5a-4258-a220-5ac6cc579dd8 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:21.829750 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74036ce-cb5a-4258-a220-5ac6cc579dd8 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:21.829985 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74036ce-cb5a-4258-a220-5ac6cc579dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:21.851656 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-a74036ce-cb5a-4258-a220-5ac6cc579dd8 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:21.853084 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-a74036ce-cb5a-4258-a220-5ac6cc579dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:21.865261 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1285/2556] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:21.869841 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df87f2-0297-4b7e-a811-d67d841d8d8d None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:21.879804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df87f2-0297-4b7e-a811-d67d841d8d8d None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:21.885273 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab46bfb-d5fd-476f-88aa-1623d40fe2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:21.889893 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab46bfb-d5fd-476f-88aa-1623d40fe2e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:21.889893 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab46bfb-d5fd-476f-88aa-1623d40fe2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:21.889893 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab46bfb-d5fd-476f-88aa-1623d40fe2e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:21.889893 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab46bfb-d5fd-476f-88aa-1623d40fe2e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:16:21.889893 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab46bfb-d5fd-476f-88aa-1623d40fe2e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:21.889893 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab46bfb-d5fd-476f-88aa-1623d40fe2e0 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:21.902409 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1272/2557] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:16:21.907219 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74036ce-cb5a-4258-a220-5ac6cc579dd8 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:21.917625 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74036ce-cb5a-4258-a220-5ac6cc579dd8 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:21.923082 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b9ea3-4229-4b7c-bddb-960e406a0098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:21.923816 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b9ea3-4229-4b7c-bddb-960e406a0098 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:21.924090 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b9ea3-4229-4b7c-bddb-960e406a0098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:21.924359 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b9ea3-4229-4b7c-bddb-960e406a0098 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:21.925048 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b9ea3-4229-4b7c-bddb-960e406a0098 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:21.927289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b9ea3-4229-4b7c-bddb-960e406a0098 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:21.940368 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:22.053862 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1286/2558] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:16:21 2022] POST /identity/v3/projects => generated 379 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:16:22.058927 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab46bfb-d5fd-476f-88aa-1623d40fe2e0 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:22.069514 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab46bfb-d5fd-476f-88aa-1623d40fe2e0 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:22.114017 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:22.129792 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68825892-2f07-4c24-b383-884f862208d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:22.130539 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68825892-2f07-4c24-b383-884f862208d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:22.131149 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68825892-2f07-4c24-b383-884f862208d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:22.131503 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68825892-2f07-4c24-b383-884f862208d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:22.132216 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68825892-2f07-4c24-b383-884f862208d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:22.134862 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68825892-2f07-4c24-b383-884f862208d8 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:22.248213 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1273/2559] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:16:22 2022] POST /identity/v3/users => generated 290 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:16:22.252470 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b9ea3-4229-4b7c-bddb-960e406a0098 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:22.263981 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b9ea3-4229-4b7c-bddb-960e406a0098 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:22.268726 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9e98c-c852-40a4-876f-64ec781fbfba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:22.269461 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9e98c-c852-40a4-876f-64ec781fbfba admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:22.269746 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9e98c-c852-40a4-876f-64ec781fbfba admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:22.270019 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be9e98c-c852-40a4-876f-64ec781fbfba admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:22.270686 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be9e98c-c852-40a4-876f-64ec781fbfba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:22.272408 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be9e98c-c852-40a4-876f-64ec781fbfba admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:22.284066 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1287/2560] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:16:22.288739 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68825892-2f07-4c24-b383-884f862208d8 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:22.300400 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68825892-2f07-4c24-b383-884f862208d8 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:22.305863 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7799f6-fe0b-4387-93af-67269635c3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:22.306919 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7799f6-fe0b-4387-93af-67269635c3ea admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:22.306919 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7799f6-fe0b-4387-93af-67269635c3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:22.307240 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7799f6-fe0b-4387-93af-67269635c3ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:22.307738 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7799f6-fe0b-4387-93af-67269635c3ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:22.309400 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7799f6-fe0b-4387-93af-67269635c3ea admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:22.322771 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1274/2561] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:16:22.326864 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9e98c-c852-40a4-876f-64ec781fbfba admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:22.337358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be9e98c-c852-40a4-876f-64ec781fbfba admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:22.342067 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7db15-d285-4e2a-89cb-e106c0bd9e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:22.342727 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7db15-d285-4e2a-89cb-e106c0bd9e4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:22.343007 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7db15-d285-4e2a-89cb-e106c0bd9e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:22.343323 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7db15-d285-4e2a-89cb-e106c0bd9e4f admin admin] PATH_INFO: `/v3/projects/830cea74f85c4f258face31a3923f324/users/ecb1c1d7c1e94ec3b1ac9cac30204410/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:22.358594 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e7db15-d285-4e2a-89cb-e106c0bd9e4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=830cea74f85c4f258face31a3923f324, user_id=ecb1c1d7c1e94ec3b1ac9cac30204410, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:22.361364 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e7db15-d285-4e2a-89cb-e106c0bd9e4f admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:22.453033 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1288/2562] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:16:22 2022] PUT /identity/v3/projects/830cea74f85c4f258face31a3923f324/users/ecb1c1d7c1e94ec3b1ac9cac30204410/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:22.458515 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cb1a3-e702-4223-94f1-e5863e93be2e None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:22.458803 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cb1a3-e702-4223-94f1-e5863e93be2e None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:22.459078 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87cb1a3-e702-4223-94f1-e5863e93be2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:22.479951 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-a87cb1a3-e702-4223-94f1-e5863e93be2e None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:22.481216 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-a87cb1a3-e702-4223-94f1-e5863e93be2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:22.544414 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1275/2563] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:22.555073 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7db15-d285-4e2a-89cb-e106c0bd9e4f admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:22.556924 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-f3e7db15-d285-4e2a-89cb-e106c0bd9e4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:22.616455 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7db15-d285-4e2a-89cb-e106c0bd9e4f admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:22.621546 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e82327-0f36-42e1-a1ef-b57fdddc6099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:22.621720 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e82327-0f36-42e1-a1ef-b57fdddc6099 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:22.621974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e82327-0f36-42e1-a1ef-b57fdddc6099 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:22.622250 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e82327-0f36-42e1-a1ef-b57fdddc6099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:22.632235 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e82327-0f36-42e1-a1ef-b57fdddc6099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:22.634016 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e82327-0f36-42e1-a1ef-b57fdddc6099 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:22.645631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1289/2564] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:16:23.921879 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b387e-168b-46f0-8261-ef55815bb4eb None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:23.922470 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b387e-168b-46f0-8261-ef55815bb4eb None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:23.922673 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b387e-168b-46f0-8261-ef55815bb4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:23.958277 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-6c3b387e-168b-46f0-8261-ef55815bb4eb None None] MFA Rules not processed for user `ecb1c1d7c1e94ec3b1ac9cac30204410`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:23.959554 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-6c3b387e-168b-46f0-8261-ef55815bb4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:24.039240 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1276/2565] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:16:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:24.057883 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e82327-0f36-42e1-a1ef-b57fdddc6099 service neutron] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:24.057883 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-d3e82327-0f36-42e1-a1ef-b57fdddc6099 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:24.119528 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e82327-0f36-42e1-a1ef-b57fdddc6099 service neutron] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:24.123564 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a5396-33f4-4a8c-ab40-c7a6f2ca220f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:24.124074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a5396-33f4-4a8c-ab40-c7a6f2ca220f service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:24.124369 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a5396-33f4-4a8c-ab40-c7a6f2ca220f service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:24.124613 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a5396-33f4-4a8c-ab40-c7a6f2ca220f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:24.137292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a5396-33f4-4a8c-ab40-c7a6f2ca220f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:24.138866 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a5396-33f4-4a8c-ab40-c7a6f2ca220f service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:24.150053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1290/2566] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:16:25.984209 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e842aa-4016-445d-a651-4b2afbce0659 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:25.984762 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e842aa-4016-445d-a651-4b2afbce0659 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:25.984762 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e842aa-4016-445d-a651-4b2afbce0659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:26.005055 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-b6e842aa-4016-445d-a651-4b2afbce0659 None None] MFA Rules not processed for user `ecb1c1d7c1e94ec3b1ac9cac30204410`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:26.007622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-b6e842aa-4016-445d-a651-4b2afbce0659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:26.015725 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1277/2567] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:16:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:26.263565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a5396-33f4-4a8c-ab40-c7a6f2ca220f service cinder] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:26.265143 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-386a5396-33f4-4a8c-ab40-c7a6f2ca220f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:26.279652 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a5396-33f4-4a8c-ab40-c7a6f2ca220f service cinder] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:26.284694 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3e2b6e-d271-4f2d-943b-51f9a0b5e6e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:26.285308 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e2b6e-d271-4f2d-943b-51f9a0b5e6e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:26.285581 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e2b6e-d271-4f2d-943b-51f9a0b5e6e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:26.285850 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3e2b6e-d271-4f2d-943b-51f9a0b5e6e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:26.287630 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-cb3e2b6e-d271-4f2d-943b-51f9a0b5e6e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:26.299377 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e2b6e-d271-4f2d-943b-51f9a0b5e6e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:26.300815 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3e2b6e-d271-4f2d-943b-51f9a0b5e6e6 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:26.310298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1291/2568] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:16:26.391304 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e842aa-4016-445d-a651-4b2afbce0659 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:26.392819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-b6e842aa-4016-445d-a651-4b2afbce0659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:26.449498 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:26.479515 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e842aa-4016-445d-a651-4b2afbce0659 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:26.489484 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e278b-3cdc-43c8-9776-711713cfc74f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:26.490553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e278b-3cdc-43c8-9776-711713cfc74f service nova] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:26.490553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e278b-3cdc-43c8-9776-711713cfc74f service nova] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:26.490865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e278b-3cdc-43c8-9776-711713cfc74f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:26.494035 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-1f8e278b-3cdc-43c8-9776-711713cfc74f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:26.508991 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e278b-3cdc-43c8-9776-711713cfc74f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:26.511468 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e278b-3cdc-43c8-9776-711713cfc74f service nova] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:26.531470 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1278/2569] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:16:28.818568 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d4988-0d4b-454c-975f-bf2d33593e8e None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:28.819621 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d4988-0d4b-454c-975f-bf2d33593e8e None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:28.820026 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d4988-0d4b-454c-975f-bf2d33593e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:28.841735 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-250d4988-0d4b-454c-975f-bf2d33593e8e None None] MFA Rules not processed for user `ae9fc5f06a0441da80e656fa1e88db5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:28.843059 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-250d4988-0d4b-454c-975f-bf2d33593e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:28.891539 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:28.905164 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1292/2570] 10.222.0.55 () {58 vars in 967 bytes} [Wed Aug 24 17:16:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:16:28.918424 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e278b-3cdc-43c8-9776-711713cfc74f service nova] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:28.919957 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-1f8e278b-3cdc-43c8-9776-711713cfc74f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:29.003377 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e278b-3cdc-43c8-9776-711713cfc74f service nova] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:29.009673 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268c0c6-1b75-4ac4-8732-c049063ff496 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c067bc2d84b741d08ac47e40adae4b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:29.010278 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268c0c6-1b75-4ac4-8732-c049063ff496 service swift] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:29.010597 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268c0c6-1b75-4ac4-8732-c049063ff496 service swift] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:29.010864 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2268c0c6-1b75-4ac4-8732-c049063ff496 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:29.019700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268c0c6-1b75-4ac4-8732-c049063ff496 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:29.021369 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2268c0c6-1b75-4ac4-8732-c049063ff496 service swift] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:29.032678 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1279/2571] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Aug 24 17:16:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:16:33.919618 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d4988-0d4b-454c-975f-bf2d33593e8e None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:33.925323 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-250d4988-0d4b-454c-975f-bf2d33593e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:33.964164 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d4988-0d4b-454c-975f-bf2d33593e8e None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:33.974694 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb4e29-03f7-40ae-b5d5-6efccb200a7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:33.975775 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb4e29-03f7-40ae-b5d5-6efccb200a7f service nova] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:33.976437 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb4e29-03f7-40ae-b5d5-6efccb200a7f service nova] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:33.976904 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb4e29-03f7-40ae-b5d5-6efccb200a7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:33.980342 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-e1eb4e29-03f7-40ae-b5d5-6efccb200a7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:34.004884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb4e29-03f7-40ae-b5d5-6efccb200a7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:34.009275 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb4e29-03f7-40ae-b5d5-6efccb200a7f service nova] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:34.031196 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1293/2572] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:16:39.028821 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=45 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:40.731700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268c0c6-1b75-4ac4-8732-c049063ff496 service swift] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:40.749795 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2268c0c6-1b75-4ac4-8732-c049063ff496 service swift] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:40.757212 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e21b3-4b0d-4169-af88-f49dc764bcf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:40.757930 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e21b3-4b0d-4169-af88-f49dc764bcf7 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:40.758284 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e21b3-4b0d-4169-af88-f49dc764bcf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:40.758689 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5e21b3-4b0d-4169-af88-f49dc764bcf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:40.761676 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-2d5e21b3-4b0d-4169-af88-f49dc764bcf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:40.778490 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e21b3-4b0d-4169-af88-f49dc764bcf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:40.781448 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5e21b3-4b0d-4169-af88-f49dc764bcf7 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:40.802779 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1280/2573] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:16:44.022952 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=9 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:46.011739 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb4e29-03f7-40ae-b5d5-6efccb200a7f service nova] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:46.013245 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-e1eb4e29-03f7-40ae-b5d5-6efccb200a7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:46.111867 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb4e29-03f7-40ae-b5d5-6efccb200a7f service nova] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:46.117981 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2987a-5506-4d33-9375-e0148adc84a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ef97356edf406aad9ab5f502bdb0af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:46.118618 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2987a-5506-4d33-9375-e0148adc84a9 service placement] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:46.118897 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2987a-5506-4d33-9375-e0148adc84a9 service placement] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:46.119358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2987a-5506-4d33-9375-e0148adc84a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:46.121358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-e6d2987a-5506-4d33-9375-e0148adc84a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:46.134287 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2987a-5506-4d33-9375-e0148adc84a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:46.136024 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2987a-5506-4d33-9375-e0148adc84a9 service placement] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:46.148570 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1294/2574] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:16:46.212431 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e21b3-4b0d-4169-af88-f49dc764bcf7 service neutron] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:46.214856 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-2d5e21b3-4b0d-4169-af88-f49dc764bcf7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:46.240355 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5e21b3-4b0d-4169-af88-f49dc764bcf7 service neutron] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:46.247637 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40faaca-a38d-476f-bb47-9b94b045b58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:46.248489 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40faaca-a38d-476f-bb47-9b94b045b58e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:46.248854 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40faaca-a38d-476f-bb47-9b94b045b58e admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:46.249234 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40faaca-a38d-476f-bb47-9b94b045b58e admin admin] PATH_INFO: `/v3/users/2cad680ebdab4fd4996f39f2e08eabb7` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:46.250655 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40faaca-a38d-476f-bb47-9b94b045b58e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cad680ebdab4fd4996f39f2e08eabb7)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:46.252944 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40faaca-a38d-476f-bb47-9b94b045b58e admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:46.474966 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-d40faaca-a38d-476f-bb47-9b94b045b58e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cad680ebdab4fd4996f39f2e08eabb7'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:46.475744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-d40faaca-a38d-476f-bb47-9b94b045b58e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cad680ebdab4fd4996f39f2e08eabb7'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:46.484588 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-d40faaca-a38d-476f-bb47-9b94b045b58e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cad680ebdab4fd4996f39f2e08eabb7'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:46.485392 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-d40faaca-a38d-476f-bb47-9b94b045b58e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cad680ebdab4fd4996f39f2e08eabb7'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:46.567457 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-d40faaca-a38d-476f-bb47-9b94b045b58e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cad680ebdab4fd4996f39f2e08eabb7'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:46.600352 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1281/2575] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:16:46 2022] DELETE /identity/v3/users/2cad680ebdab4fd4996f39f2e08eabb7 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:47.039357 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2987a-5506-4d33-9375-e0148adc84a9 service placement] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:47.061060 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2987a-5506-4d33-9375-e0148adc84a9 service placement] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:47.144878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e5a8b6-1118-4bad-b717-7b114587a217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:47.145529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5a8b6-1118-4bad-b717-7b114587a217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:47.145810 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5a8b6-1118-4bad-b717-7b114587a217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:47.146083 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e5a8b6-1118-4bad-b717-7b114587a217 admin admin] PATH_INFO: `/v3/projects/5498cab6745f4735b2772cbd2fb9c79b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:47.147378 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e5a8b6-1118-4bad-b717-7b114587a217 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5498cab6745f4735b2772cbd2fb9c79b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:47.149418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e5a8b6-1118-4bad-b717-7b114587a217 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:47.283979 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-47e5a8b6-1118-4bad-b717-7b114587a217 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5498cab6745f4735b2772cbd2fb9c79b', 'request_id': 'req-47e5a8b6-1118-4bad-b717-7b114587a217'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:47.291845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-47e5a8b6-1118-4bad-b717-7b114587a217 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5498cab6745f4735b2772cbd2fb9c79b', 'request_id': 'req-47e5a8b6-1118-4bad-b717-7b114587a217'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:47.368332 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-47e5a8b6-1118-4bad-b717-7b114587a217 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5498cab6745f4735b2772cbd2fb9c79b', 'request_id': 'req-47e5a8b6-1118-4bad-b717-7b114587a217'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:47.403722 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-47e5a8b6-1118-4bad-b717-7b114587a217 admin admin] The token cache is being invalidate because project 5498cab6745f4735b2772cbd2fb9c79b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:16:47.404234 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-47e5a8b6-1118-4bad-b717-7b114587a217 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:47.405348 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-47e5a8b6-1118-4bad-b717-7b114587a217 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:47.408046 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1295/2576] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:16:47 2022] DELETE /identity/v3/projects/5498cab6745f4735b2772cbd2fb9c79b => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:47.414676 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de2d7d-cd28-4522-8bc7-25a3042b35a4 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:47.415311 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de2d7d-cd28-4522-8bc7-25a3042b35a4 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:47.415449 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9de2d7d-cd28-4522-8bc7-25a3042b35a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:47.440042 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-a9de2d7d-cd28-4522-8bc7-25a3042b35a4 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:47.441349 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-a9de2d7d-cd28-4522-8bc7-25a3042b35a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:47.536173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1282/2577] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:16:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:16:47.546341 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b48e06-fabc-4cf0-9fbd-9672b0983d50 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:47.546646 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b48e06-fabc-4cf0-9fbd-9672b0983d50 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:47.546963 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b48e06-fabc-4cf0-9fbd-9672b0983d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:47.571869 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-58b48e06-fabc-4cf0-9fbd-9672b0983d50 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:47.573225 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-58b48e06-fabc-4cf0-9fbd-9672b0983d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:47.582303 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1296/2578] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:16:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:47.589583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de2d7d-cd28-4522-8bc7-25a3042b35a4 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:47.604729 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9de2d7d-cd28-4522-8bc7-25a3042b35a4 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:47.610570 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a3a0e-9232-4ba6-9e36-8358ac929478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:47.611262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a3a0e-9232-4ba6-9e36-8358ac929478 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:47.611543 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a3a0e-9232-4ba6-9e36-8358ac929478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:47.611873 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a3a0e-9232-4ba6-9e36-8358ac929478 admin admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:47.612555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a3a0e-9232-4ba6-9e36-8358ac929478 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:16:47.612858 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a3a0e-9232-4ba6-9e36-8358ac929478 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:47.614530 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a3a0e-9232-4ba6-9e36-8358ac929478 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:47.629901 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1283/2579] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:16:47.641568 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b48e06-fabc-4cf0-9fbd-9672b0983d50 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:47.652890 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b48e06-fabc-4cf0-9fbd-9672b0983d50 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:47.658526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac92ea-6146-49b1-bbed-7328ef741b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:47.659199 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac92ea-6146-49b1-bbed-7328ef741b9e admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:47.659608 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac92ea-6146-49b1-bbed-7328ef741b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:47.659852 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac92ea-6146-49b1-bbed-7328ef741b9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:47.660507 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac92ea-6146-49b1-bbed-7328ef741b9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:47.663644 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac92ea-6146-49b1-bbed-7328ef741b9e admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:47.686689 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:47.786574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1297/2580] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:16:47 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:16:47.792639 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a3a0e-9232-4ba6-9e36-8358ac929478 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:47.804570 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a3a0e-9232-4ba6-9e36-8358ac929478 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:47.873279 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:47.893790 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f70ddf-66b1-43a6-adeb-352920f51c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:47.894535 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f70ddf-66b1-43a6-adeb-352920f51c42 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:47.894854 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f70ddf-66b1-43a6-adeb-352920f51c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:47.895268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f70ddf-66b1-43a6-adeb-352920f51c42 admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:47.896026 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f70ddf-66b1-43a6-adeb-352920f51c42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:47.898931 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f70ddf-66b1-43a6-adeb-352920f51c42 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:47.980421 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1284/2581] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:16:47 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:16:47.987214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac92ea-6146-49b1-bbed-7328ef741b9e admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:48.000089 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac92ea-6146-49b1-bbed-7328ef741b9e admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:48.008602 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cae1d-dad0-4c76-8c46-2a09a3cb96a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:48.009279 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cae1d-dad0-4c76-8c46-2a09a3cb96a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:48.009594 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cae1d-dad0-4c76-8c46-2a09a3cb96a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:48.009906 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cae1d-dad0-4c76-8c46-2a09a3cb96a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:48.010650 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cae1d-dad0-4c76-8c46-2a09a3cb96a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:48.012679 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cae1d-dad0-4c76-8c46-2a09a3cb96a7 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:48.033019 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1298/2582] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:16:48.037991 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f70ddf-66b1-43a6-adeb-352920f51c42 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:48.053493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f70ddf-66b1-43a6-adeb-352920f51c42 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:48.059673 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164bc676-8a99-4f0c-85bd-28726537d295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:48.060310 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bc676-8a99-4f0c-85bd-28726537d295 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:48.060586 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bc676-8a99-4f0c-85bd-28726537d295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:48.060853 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bc676-8a99-4f0c-85bd-28726537d295 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:48.061545 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164bc676-8a99-4f0c-85bd-28726537d295 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:48.063298 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164bc676-8a99-4f0c-85bd-28726537d295 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:48.080715 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1285/2583] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:16:48.086450 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cae1d-dad0-4c76-8c46-2a09a3cb96a7 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:48.103479 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cae1d-dad0-4c76-8c46-2a09a3cb96a7 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:48.108859 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd867fd-4a58-4ff2-b0df-5b0b0e90a31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:48.109631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd867fd-4a58-4ff2-b0df-5b0b0e90a31e admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:48.110015 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd867fd-4a58-4ff2-b0df-5b0b0e90a31e admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:48.110403 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd867fd-4a58-4ff2-b0df-5b0b0e90a31e admin admin] PATH_INFO: `/v3/projects/d278537e0e61446bb273fcafa9a2d6b9/users/50fab90daee04ab1b242cd064ab123cf/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:48.129611 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd867fd-4a58-4ff2-b0df-5b0b0e90a31e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d278537e0e61446bb273fcafa9a2d6b9, user_id=50fab90daee04ab1b242cd064ab123cf, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:48.133207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd867fd-4a58-4ff2-b0df-5b0b0e90a31e admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:48.230534 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1299/2584] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:16:48 2022] PUT /identity/v3/projects/d278537e0e61446bb273fcafa9a2d6b9/users/50fab90daee04ab1b242cd064ab123cf/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:48.243796 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af076fb7-56b0-496d-af72-2a6c45b2cd8b None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:48.244131 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af076fb7-56b0-496d-af72-2a6c45b2cd8b None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:48.244347 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af076fb7-56b0-496d-af72-2a6c45b2cd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:48.281651 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-af076fb7-56b0-496d-af72-2a6c45b2cd8b None None] MFA Rules not processed for user `50fab90daee04ab1b242cd064ab123cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:48.283826 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-af076fb7-56b0-496d-af72-2a6c45b2cd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:48.382588 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1286/2585] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:16:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:16:48.395035 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd867fd-4a58-4ff2-b0df-5b0b0e90a31e admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:48.397962 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-efd867fd-4a58-4ff2-b0df-5b0b0e90a31e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:48.511897 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd867fd-4a58-4ff2-b0df-5b0b0e90a31e admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:48.518212 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078bfee4-4363-472a-8a92-373d63f544e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:48.518846 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bfee4-4363-472a-8a92-373d63f544e4 service nova] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:48.519243 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bfee4-4363-472a-8a92-373d63f544e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:48.520830 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bfee4-4363-472a-8a92-373d63f544e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:48.530883 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078bfee4-4363-472a-8a92-373d63f544e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:48.532762 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078bfee4-4363-472a-8a92-373d63f544e4 service nova] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:48.544521 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1300/2586] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:16:55.268444 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af076fb7-56b0-496d-af72-2a6c45b2cd8b None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:55.340407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af076fb7-56b0-496d-af72-2a6c45b2cd8b None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:55.345075 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806505f-dcb6-4482-baee-95463a398e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:55.345727 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806505f-dcb6-4482-baee-95463a398e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:55.346007 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806505f-dcb6-4482-baee-95463a398e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:55.346277 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806505f-dcb6-4482-baee-95463a398e5b admin admin] PATH_INFO: `/v3/users/50fab90daee04ab1b242cd064ab123cf` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:55.347588 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806505f-dcb6-4482-baee-95463a398e5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=50fab90daee04ab1b242cd064ab123cf)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:55.349571 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806505f-dcb6-4482-baee-95463a398e5b admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:55.645385 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-8806505f-dcb6-4482-baee-95463a398e5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50fab90daee04ab1b242cd064ab123cf'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:55.646214 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-8806505f-dcb6-4482-baee-95463a398e5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50fab90daee04ab1b242cd064ab123cf'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:55.656361 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-8806505f-dcb6-4482-baee-95463a398e5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50fab90daee04ab1b242cd064ab123cf'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:55.657077 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-8806505f-dcb6-4482-baee-95463a398e5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50fab90daee04ab1b242cd064ab123cf'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:55.659268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:55.774066 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-8806505f-dcb6-4482-baee-95463a398e5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50fab90daee04ab1b242cd064ab123cf'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:55.798450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1287/2587] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:16:55 2022] DELETE /identity/v3/users/50fab90daee04ab1b242cd064ab123cf => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:55.803826 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64e1a8-fb91-44c0-8155-11c8a629d328 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:55.803826 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64e1a8-fb91-44c0-8155-11c8a629d328 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:55.805136 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64e1a8-fb91-44c0-8155-11c8a629d328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:55.827991 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-7d64e1a8-fb91-44c0-8155-11c8a629d328 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:55.829261 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-7d64e1a8-fb91-44c0-8155-11c8a629d328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:55.917408 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1301/2588] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:16:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:16:55.938383 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806505f-dcb6-4482-baee-95463a398e5b admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:55.940577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-8806505f-dcb6-4482-baee-95463a398e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:56.040156 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806505f-dcb6-4482-baee-95463a398e5b admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:56.043944 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2cc5b8-c84a-42f9-9bf3-f7adc56c2fb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:56.044775 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cc5b8-c84a-42f9-9bf3-f7adc56c2fb4 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:56.045055 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cc5b8-c84a-42f9-9bf3-f7adc56c2fb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:56.045412 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2cc5b8-c84a-42f9-9bf3-f7adc56c2fb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:56.057023 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2cc5b8-c84a-42f9-9bf3-f7adc56c2fb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:56.058841 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2cc5b8-c84a-42f9-9bf3-f7adc56c2fb4 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:56.070986 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1288/2589] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:16:56.589148 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64e1a8-fb91-44c0-8155-11c8a629d328 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:56.591618 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-7d64e1a8-fb91-44c0-8155-11c8a629d328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:56.616470 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64e1a8-fb91-44c0-8155-11c8a629d328 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:56.625112 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fba81c-9595-4b1e-a2de-f5b84a9490ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:56.626197 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fba81c-9595-4b1e-a2de-f5b84a9490ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:56.626689 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fba81c-9595-4b1e-a2de-f5b84a9490ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:56.627216 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fba81c-9595-4b1e-a2de-f5b84a9490ea admin admin] PATH_INFO: `/v3/projects/d278537e0e61446bb273fcafa9a2d6b9` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:56.629559 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fba81c-9595-4b1e-a2de-f5b84a9490ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=d278537e0e61446bb273fcafa9a2d6b9)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:56.632471 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fba81c-9595-4b1e-a2de-f5b84a9490ea admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:56.762076 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:56.773283 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-05fba81c-9595-4b1e-a2de-f5b84a9490ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd278537e0e61446bb273fcafa9a2d6b9', 'request_id': 'req-05fba81c-9595-4b1e-a2de-f5b84a9490ea'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:56.780401 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-05fba81c-9595-4b1e-a2de-f5b84a9490ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd278537e0e61446bb273fcafa9a2d6b9', 'request_id': 'req-05fba81c-9595-4b1e-a2de-f5b84a9490ea'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:56.938229 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-05fba81c-9595-4b1e-a2de-f5b84a9490ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd278537e0e61446bb273fcafa9a2d6b9', 'request_id': 'req-05fba81c-9595-4b1e-a2de-f5b84a9490ea'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:56.952183 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-05fba81c-9595-4b1e-a2de-f5b84a9490ea admin admin] The token cache is being invalidate because project d278537e0e61446bb273fcafa9a2d6b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:16:56.952471 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-05fba81c-9595-4b1e-a2de-f5b84a9490ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:56.953589 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-05fba81c-9595-4b1e-a2de-f5b84a9490ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:16:56.955358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1302/2590] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:16:56 2022] DELETE /identity/v3/projects/d278537e0e61446bb273fcafa9a2d6b9 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:56.961516 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd0a2b-6303-498d-a69f-f548978f9383 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:56.962437 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd0a2b-6303-498d-a69f-f548978f9383 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:56.962437 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd0a2b-6303-498d-a69f-f548978f9383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:56.984817 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-ffbd0a2b-6303-498d-a69f-f548978f9383 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:56.986144 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-ffbd0a2b-6303-498d-a69f-f548978f9383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:57.064841 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1289/2591] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:16:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:57.074574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf130d5f-0764-43f4-862b-f2ec2dcc1710 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:57.075071 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf130d5f-0764-43f4-862b-f2ec2dcc1710 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:57.075691 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf130d5f-0764-43f4-862b-f2ec2dcc1710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:57.107041 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-cf130d5f-0764-43f4-862b-f2ec2dcc1710 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:57.108751 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-cf130d5f-0764-43f4-862b-f2ec2dcc1710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:57.123366 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1303/2592] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:16:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:57.124914 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd0a2b-6303-498d-a69f-f548978f9383 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:57.137759 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd0a2b-6303-498d-a69f-f548978f9383 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:57.143196 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b13cc2-a7e8-44a8-ac45-5584aa565059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:57.143963 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b13cc2-a7e8-44a8-ac45-5584aa565059 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:57.144282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b13cc2-a7e8-44a8-ac45-5584aa565059 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:57.144614 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b13cc2-a7e8-44a8-ac45-5584aa565059 admin admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:57.145341 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b13cc2-a7e8-44a8-ac45-5584aa565059 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:16:57.145729 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b13cc2-a7e8-44a8-ac45-5584aa565059 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:57.148188 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b13cc2-a7e8-44a8-ac45-5584aa565059 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:57.162254 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1290/2593] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:16:57.167186 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf130d5f-0764-43f4-862b-f2ec2dcc1710 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:57.177707 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf130d5f-0764-43f4-862b-f2ec2dcc1710 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:57.182855 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa9369-905c-4655-b281-816e6baee6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:57.183703 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa9369-905c-4655-b281-816e6baee6b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:57.184140 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa9369-905c-4655-b281-816e6baee6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:57.184516 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa9369-905c-4655-b281-816e6baee6b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:57.185166 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa9369-905c-4655-b281-816e6baee6b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:57.187196 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aa9369-905c-4655-b281-816e6baee6b8 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:57.290945 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1304/2594] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:16:57 2022] POST /identity/v3/projects => generated 369 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:16:57.292477 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b13cc2-a7e8-44a8-ac45-5584aa565059 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:57.307101 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b13cc2-a7e8-44a8-ac45-5584aa565059 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:57.383728 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba54ec2-ee09-48ea-81b8-968fd48c1252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:57.384680 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba54ec2-ee09-48ea-81b8-968fd48c1252 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:57.385706 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba54ec2-ee09-48ea-81b8-968fd48c1252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:57.386198 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba54ec2-ee09-48ea-81b8-968fd48c1252 admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:57.387165 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba54ec2-ee09-48ea-81b8-968fd48c1252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:57.389334 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba54ec2-ee09-48ea-81b8-968fd48c1252 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:57.401506 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:57.489170 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1291/2595] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:16:57 2022] POST /identity/v3/users => generated 285 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:16:57.494113 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa9369-905c-4655-b281-816e6baee6b8 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:57.506159 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aa9369-905c-4655-b281-816e6baee6b8 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:57.512196 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503406e3-2a2c-4c35-845c-83da4666db37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:57.515748 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503406e3-2a2c-4c35-845c-83da4666db37 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:57.515748 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503406e3-2a2c-4c35-845c-83da4666db37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:57.515748 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503406e3-2a2c-4c35-845c-83da4666db37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:57.515748 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503406e3-2a2c-4c35-845c-83da4666db37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:57.515748 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503406e3-2a2c-4c35-845c-83da4666db37 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:57.527661 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1305/2596] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:16:57.532547 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba54ec2-ee09-48ea-81b8-968fd48c1252 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:57.543982 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba54ec2-ee09-48ea-81b8-968fd48c1252 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:57.548991 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f6cfd-19f0-45fc-a88f-57e23ce020cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:57.549980 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f6cfd-19f0-45fc-a88f-57e23ce020cb admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:57.549980 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f6cfd-19f0-45fc-a88f-57e23ce020cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:57.550267 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f6cfd-19f0-45fc-a88f-57e23ce020cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:57.550794 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f6cfd-19f0-45fc-a88f-57e23ce020cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:57.552495 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f6cfd-19f0-45fc-a88f-57e23ce020cb admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:57.565692 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1292/2597] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:16:57.571808 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503406e3-2a2c-4c35-845c-83da4666db37 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:57.590093 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503406e3-2a2c-4c35-845c-83da4666db37 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:57.597702 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0cca3-7c48-4554-929c-ec6d5d34ed83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:57.598830 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0cca3-7c48-4554-929c-ec6d5d34ed83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:57.599403 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0cca3-7c48-4554-929c-ec6d5d34ed83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:57.601529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e0cca3-7c48-4554-929c-ec6d5d34ed83 admin admin] PATH_INFO: `/v3/projects/86e18745a455469ba7a649a4a30152c1/users/982a60212a3c4d75a78363af2cedc082/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:57.627954 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0cca3-7c48-4554-929c-ec6d5d34ed83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86e18745a455469ba7a649a4a30152c1, user_id=982a60212a3c4d75a78363af2cedc082, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:57.634909 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e0cca3-7c48-4554-929c-ec6d5d34ed83 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:57.790852 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1306/2598] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:16:57 2022] PUT /identity/v3/projects/86e18745a455469ba7a649a4a30152c1/users/982a60212a3c4d75a78363af2cedc082/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:57.802912 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a9f80-12ae-49b5-ad4c-257b7f7e4d99 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:57.803252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a9f80-12ae-49b5-ad4c-257b7f7e4d99 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:57.803604 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a9f80-12ae-49b5-ad4c-257b7f7e4d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:57.851860 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-d84a9f80-12ae-49b5-ad4c-257b7f7e4d99 None None] MFA Rules not processed for user `982a60212a3c4d75a78363af2cedc082`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:57.854035 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-d84a9f80-12ae-49b5-ad4c-257b7f7e4d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:57.947051 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1293/2599] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:16:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:57.952126 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0cca3-7c48-4554-929c-ec6d5d34ed83 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:58.029376 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e0cca3-7c48-4554-929c-ec6d5d34ed83 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:58.034485 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cab216-6150-4dd6-9d39-88f92a665b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:58.035183 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cab216-6150-4dd6-9d39-88f92a665b62 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:58.035467 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cab216-6150-4dd6-9d39-88f92a665b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:58.035740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cab216-6150-4dd6-9d39-88f92a665b62 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:58.036398 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cab216-6150-4dd6-9d39-88f92a665b62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:58.038807 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cab216-6150-4dd6-9d39-88f92a665b62 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:58.152537 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1307/2600] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:16:57 2022] POST /identity/v3/projects => generated 367 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:16:58.157125 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a9f80-12ae-49b5-ad4c-257b7f7e4d99 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:58.170351 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a9f80-12ae-49b5-ad4c-257b7f7e4d99 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:58.240669 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34768318-fedc-4f57-bdd1-95ca00f9e91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:58.241996 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34768318-fedc-4f57-bdd1-95ca00f9e91b admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:58.242375 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34768318-fedc-4f57-bdd1-95ca00f9e91b admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:58.242880 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34768318-fedc-4f57-bdd1-95ca00f9e91b admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:58.243670 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34768318-fedc-4f57-bdd1-95ca00f9e91b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:58.245730 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34768318-fedc-4f57-bdd1-95ca00f9e91b admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:58.333628 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1294/2601] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:16:58 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:16:58.340216 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cab216-6150-4dd6-9d39-88f92a665b62 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:58.358979 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cab216-6150-4dd6-9d39-88f92a665b62 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:58.367850 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d31a9-b04d-4350-9dd6-3e89354f12cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:58.368491 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d31a9-b04d-4350-9dd6-3e89354f12cf admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:58.368786 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d31a9-b04d-4350-9dd6-3e89354f12cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:58.369052 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d31a9-b04d-4350-9dd6-3e89354f12cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:58.369719 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d31a9-b04d-4350-9dd6-3e89354f12cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:58.371495 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226d31a9-b04d-4350-9dd6-3e89354f12cf admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:58.388071 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1308/2602] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:16:58.393277 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34768318-fedc-4f57-bdd1-95ca00f9e91b admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:58.404537 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34768318-fedc-4f57-bdd1-95ca00f9e91b admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:58.409661 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c61036-55d4-451b-a6db-90f2b73fd324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:58.410361 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c61036-55d4-451b-a6db-90f2b73fd324 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:58.410643 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c61036-55d4-451b-a6db-90f2b73fd324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:58.410921 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c61036-55d4-451b-a6db-90f2b73fd324 admin admin] PATH_INFO: `/v3/projects/8b14e0639d4c49438b65c0539fd299a1/users/f4c3fa7e15c34c35a79f10c183d9998b/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:58.438181 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c61036-55d4-451b-a6db-90f2b73fd324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b14e0639d4c49438b65c0539fd299a1, user_id=f4c3fa7e15c34c35a79f10c183d9998b, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:58.443510 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c61036-55d4-451b-a6db-90f2b73fd324 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:58.567337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1295/2603] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:16:58 2022] PUT /identity/v3/projects/8b14e0639d4c49438b65c0539fd299a1/users/f4c3fa7e15c34c35a79f10c183d9998b/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:58.572899 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d31a9-b04d-4350-9dd6-3e89354f12cf admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:58.585036 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226d31a9-b04d-4350-9dd6-3e89354f12cf admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:58.626429 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:58.656980 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4520de0f-9b79-478b-8cd3-5071e4c2a4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:58.657771 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520de0f-9b79-478b-8cd3-5071e4c2a4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:58.658094 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520de0f-9b79-478b-8cd3-5071e4c2a4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:58.658426 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4520de0f-9b79-478b-8cd3-5071e4c2a4f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:58.659185 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4520de0f-9b79-478b-8cd3-5071e4c2a4f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:58.660934 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4520de0f-9b79-478b-8cd3-5071e4c2a4f5 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:58.673339 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1309/2604] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:16:58.681003 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c61036-55d4-451b-a6db-90f2b73fd324 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:58.700015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c61036-55d4-451b-a6db-90f2b73fd324 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:58.708214 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe12f46-73e3-4cf3-bad3-524a30a97b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:58.709257 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe12f46-73e3-4cf3-bad3-524a30a97b8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:58.710895 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe12f46-73e3-4cf3-bad3-524a30a97b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:58.711420 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe12f46-73e3-4cf3-bad3-524a30a97b8c admin admin] PATH_INFO: `/v3/projects/8b14e0639d4c49438b65c0539fd299a1/users/f4c3fa7e15c34c35a79f10c183d9998b/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:58.716433 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe12f46-73e3-4cf3-bad3-524a30a97b8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b14e0639d4c49438b65c0539fd299a1, user_id=f4c3fa7e15c34c35a79f10c183d9998b, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:58.720439 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe12f46-73e3-4cf3-bad3-524a30a97b8c admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:58.740002 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1296/2605] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:16:58 2022] PUT /identity/v3/projects/8b14e0639d4c49438b65c0539fd299a1/users/f4c3fa7e15c34c35a79f10c183d9998b/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:16:58.758306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995bf18-dbe6-4aba-b533-4279adceed9e None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:58.758723 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995bf18-dbe6-4aba-b533-4279adceed9e None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:58.759142 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995bf18-dbe6-4aba-b533-4279adceed9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:58.792665 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-c995bf18-dbe6-4aba-b533-4279adceed9e None None] MFA Rules not processed for user `f4c3fa7e15c34c35a79f10c183d9998b`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:16:58.793992 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-c995bf18-dbe6-4aba-b533-4279adceed9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:58.884644 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1310/2606] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:16:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:16:58.898266 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe12f46-73e3-4cf3-bad3-524a30a97b8c admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:58.900394 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-2fe12f46-73e3-4cf3-bad3-524a30a97b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:58.935151 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:16:58.973570 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe12f46-73e3-4cf3-bad3-524a30a97b8c admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:58.979168 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38369846-d7d1-4e79-beed-14a19f18d444 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:58.979811 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38369846-d7d1-4e79-beed-14a19f18d444 service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:58.980094 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38369846-d7d1-4e79-beed-14a19f18d444 service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:58.980369 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38369846-d7d1-4e79-beed-14a19f18d444 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:58.992425 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38369846-d7d1-4e79-beed-14a19f18d444 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:58.993918 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38369846-d7d1-4e79-beed-14a19f18d444 service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:59.005557 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1297/2607] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:58 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:16:59.150481 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995bf18-dbe6-4aba-b533-4279adceed9e None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:16:59.152619 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-c995bf18-dbe6-4aba-b533-4279adceed9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:16:59.173761 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995bf18-dbe6-4aba-b533-4279adceed9e None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:16:59.180197 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f80286-f267-49d9-b6e1-b0b8034a7d6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:16:59.181255 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f80286-f267-49d9-b6e1-b0b8034a7d6d service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:16:59.181749 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f80286-f267-49d9-b6e1-b0b8034a7d6d service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:16:59.182241 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f80286-f267-49d9-b6e1-b0b8034a7d6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:16:59.291090 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f80286-f267-49d9-b6e1-b0b8034a7d6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:16:59.292821 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f80286-f267-49d9-b6e1-b0b8034a7d6d service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:16:59.304072 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1311/2608] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:16:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:05.036511 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38369846-d7d1-4e79-beed-14a19f18d444 service cinder] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:05.115093 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38369846-d7d1-4e79-beed-14a19f18d444 service cinder] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:05.123143 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cbad7-37bb-448b-8ee1-cbeb827d119b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:05.124062 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cbad7-37bb-448b-8ee1-cbeb827d119b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:05.124344 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cbad7-37bb-448b-8ee1-cbeb827d119b admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:05.124619 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cbad7-37bb-448b-8ee1-cbeb827d119b admin admin] PATH_INFO: `/v3/users/982a60212a3c4d75a78363af2cedc082` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:05.125979 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46cbad7-37bb-448b-8ee1-cbeb827d119b admin admin] RBAC: Authorizing `identity:delete_user(user_id=982a60212a3c4d75a78363af2cedc082)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:05.128020 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46cbad7-37bb-448b-8ee1-cbeb827d119b admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:05.374965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-c46cbad7-37bb-448b-8ee1-cbeb827d119b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '982a60212a3c4d75a78363af2cedc082'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:05.375808 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-c46cbad7-37bb-448b-8ee1-cbeb827d119b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '982a60212a3c4d75a78363af2cedc082'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:05.385106 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-c46cbad7-37bb-448b-8ee1-cbeb827d119b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '982a60212a3c4d75a78363af2cedc082'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:05.385972 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-c46cbad7-37bb-448b-8ee1-cbeb827d119b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '982a60212a3c4d75a78363af2cedc082'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:05.480843 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-c46cbad7-37bb-448b-8ee1-cbeb827d119b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '982a60212a3c4d75a78363af2cedc082'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:05.505085 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1298/2609] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:17:05 2022] DELETE /identity/v3/users/982a60212a3c4d75a78363af2cedc082 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:17:05.510477 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c6a43-eea2-477b-a7bf-891e9d2feeb4 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:05.511189 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c6a43-eea2-477b-a7bf-891e9d2feeb4 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:05.511189 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c6a43-eea2-477b-a7bf-891e9d2feeb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:05.533243 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-745c6a43-eea2-477b-a7bf-891e9d2feeb4 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:05.534845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-745c6a43-eea2-477b-a7bf-891e9d2feeb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:05.598452 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:05.614099 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1312/2610] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:17:05.625521 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cbad7-37bb-448b-8ee1-cbeb827d119b admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:05.626981 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-c46cbad7-37bb-448b-8ee1-cbeb827d119b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:05.702500 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:05.708926 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cbad7-37bb-448b-8ee1-cbeb827d119b admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:05.713430 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0397d6-9cd7-42bd-ada4-30e3689fda3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:05.717575 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0397d6-9cd7-42bd-ada4-30e3689fda3d service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:05.717575 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0397d6-9cd7-42bd-ada4-30e3689fda3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:05.717575 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0397d6-9cd7-42bd-ada4-30e3689fda3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:05.725275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0397d6-9cd7-42bd-ada4-30e3689fda3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:05.726758 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0397d6-9cd7-42bd-ada4-30e3689fda3d service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:05.738241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1299/2611] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:06.000829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec2e68-c10b-498f-a82c-8512dfe17166 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:06.001461 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec2e68-c10b-498f-a82c-8512dfe17166 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:06.001826 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec2e68-c10b-498f-a82c-8512dfe17166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:06.028922 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-caec2e68-c10b-498f-a82c-8512dfe17166 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:06.030258 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-caec2e68-c10b-498f-a82c-8512dfe17166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:06.040990 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1313/2612] 10.222.0.47 () {58 vars in 1016 bytes} [Wed Aug 24 17:17:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:17:06.066195 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0397d6-9cd7-42bd-ada4-30e3689fda3d service neutron] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:06.068172 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-3c0397d6-9cd7-42bd-ada4-30e3689fda3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:06.175939 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0397d6-9cd7-42bd-ada4-30e3689fda3d service neutron] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:06.182541 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df169b97-49df-4a13-8c43-55f80e50e485 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:06.183308 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df169b97-49df-4a13-8c43-55f80e50e485 service nova] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:06.183596 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df169b97-49df-4a13-8c43-55f80e50e485 service nova] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:06.183876 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df169b97-49df-4a13-8c43-55f80e50e485 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:06.194397 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df169b97-49df-4a13-8c43-55f80e50e485 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:06.196584 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df169b97-49df-4a13-8c43-55f80e50e485 service nova] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:06.208577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1300/2613] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:17:06.331424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec2e68-c10b-498f-a82c-8512dfe17166 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:06.334195 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-caec2e68-c10b-498f-a82c-8512dfe17166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:06.355481 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec2e68-c10b-498f-a82c-8512dfe17166 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:06.360813 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c40ce4-8213-4e09-9e8d-4b84261ef984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:06.361454 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c40ce4-8213-4e09-9e8d-4b84261ef984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:06.361728 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c40ce4-8213-4e09-9e8d-4b84261ef984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:06.361999 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c40ce4-8213-4e09-9e8d-4b84261ef984 admin admin] PATH_INFO: `/v3/projects/86e18745a455469ba7a649a4a30152c1` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:06.363395 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c40ce4-8213-4e09-9e8d-4b84261ef984 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86e18745a455469ba7a649a4a30152c1)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:06.365337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c40ce4-8213-4e09-9e8d-4b84261ef984 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:06.558876 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-d9c40ce4-8213-4e09-9e8d-4b84261ef984 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86e18745a455469ba7a649a4a30152c1', 'request_id': 'req-d9c40ce4-8213-4e09-9e8d-4b84261ef984'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:06.566389 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-d9c40ce4-8213-4e09-9e8d-4b84261ef984 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86e18745a455469ba7a649a4a30152c1', 'request_id': 'req-d9c40ce4-8213-4e09-9e8d-4b84261ef984'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:06.664181 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-d9c40ce4-8213-4e09-9e8d-4b84261ef984 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86e18745a455469ba7a649a4a30152c1', 'request_id': 'req-d9c40ce4-8213-4e09-9e8d-4b84261ef984'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:06.679581 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-d9c40ce4-8213-4e09-9e8d-4b84261ef984 admin admin] The token cache is being invalidate because project 86e18745a455469ba7a649a4a30152c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:17:06.680023 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-d9c40ce4-8213-4e09-9e8d-4b84261ef984 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:06.680834 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-d9c40ce4-8213-4e09-9e8d-4b84261ef984 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:06.682458 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1314/2614] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:17:06 2022] DELETE /identity/v3/projects/86e18745a455469ba7a649a4a30152c1 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:06.687711 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df169b97-49df-4a13-8c43-55f80e50e485 service nova] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:06.699603 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df169b97-49df-4a13-8c43-55f80e50e485 service nova] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:06.774559 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79659d7-f5b4-4199-85cd-c5167052cac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:06.775384 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79659d7-f5b4-4199-85cd-c5167052cac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:06.775715 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79659d7-f5b4-4199-85cd-c5167052cac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:06.776082 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79659d7-f5b4-4199-85cd-c5167052cac1 admin admin] PATH_INFO: `/v3/users/f4c3fa7e15c34c35a79f10c183d9998b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:06.777424 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79659d7-f5b4-4199-85cd-c5167052cac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4c3fa7e15c34c35a79f10c183d9998b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:06.779490 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79659d7-f5b4-4199-85cd-c5167052cac1 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:07.028882 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-b79659d7-f5b4-4199-85cd-c5167052cac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4c3fa7e15c34c35a79f10c183d9998b'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:07.029577 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-b79659d7-f5b4-4199-85cd-c5167052cac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4c3fa7e15c34c35a79f10c183d9998b'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:07.037731 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-b79659d7-f5b4-4199-85cd-c5167052cac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4c3fa7e15c34c35a79f10c183d9998b'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:07.038482 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-b79659d7-f5b4-4199-85cd-c5167052cac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4c3fa7e15c34c35a79f10c183d9998b'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:07.120053 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-b79659d7-f5b4-4199-85cd-c5167052cac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4c3fa7e15c34c35a79f10c183d9998b'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:07.134154 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:07.142335 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1301/2615] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:17:06 2022] DELETE /identity/v3/users/f4c3fa7e15c34c35a79f10c183d9998b => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:07.693048 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c40ce4-8213-4e09-9e8d-4b84261ef984 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:07.693048 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-d9c40ce4-8213-4e09-9e8d-4b84261ef984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:07.712304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c40ce4-8213-4e09-9e8d-4b84261ef984 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:07.792271 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b755a0-d82f-445d-b481-253c627ff71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:07.793278 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b755a0-d82f-445d-b481-253c627ff71e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:07.793681 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b755a0-d82f-445d-b481-253c627ff71e admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:07.800512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b755a0-d82f-445d-b481-253c627ff71e admin admin] PATH_INFO: `/v3/projects/8b14e0639d4c49438b65c0539fd299a1` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:07.800512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b755a0-d82f-445d-b481-253c627ff71e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b14e0639d4c49438b65c0539fd299a1)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:07.800512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b755a0-d82f-445d-b481-253c627ff71e admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:07.949752 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-65b755a0-d82f-445d-b481-253c627ff71e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b14e0639d4c49438b65c0539fd299a1', 'request_id': 'req-65b755a0-d82f-445d-b481-253c627ff71e'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:07.956384 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-65b755a0-d82f-445d-b481-253c627ff71e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b14e0639d4c49438b65c0539fd299a1', 'request_id': 'req-65b755a0-d82f-445d-b481-253c627ff71e'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:08.074469 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-65b755a0-d82f-445d-b481-253c627ff71e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b14e0639d4c49438b65c0539fd299a1', 'request_id': 'req-65b755a0-d82f-445d-b481-253c627ff71e'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:08.088348 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-65b755a0-d82f-445d-b481-253c627ff71e admin admin] The token cache is being invalidate because project 8b14e0639d4c49438b65c0539fd299a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:17:08.088701 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-65b755a0-d82f-445d-b481-253c627ff71e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:08.089416 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-65b755a0-d82f-445d-b481-253c627ff71e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:08.091025 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1315/2616] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:17:07 2022] DELETE /identity/v3/projects/8b14e0639d4c49438b65c0539fd299a1 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:08.096340 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af1306-f39c-4ffd-b0e4-50c380045dd6 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:08.096633 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af1306-f39c-4ffd-b0e4-50c380045dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:08.096923 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af1306-f39c-4ffd-b0e4-50c380045dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:08.121438 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-44af1306-f39c-4ffd-b0e4-50c380045dd6 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:08.122744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-44af1306-f39c-4ffd-b0e4-50c380045dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:08.196978 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1302/2617] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:08.205440 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171932f0-3975-4b6a-8959-933f52b79ff2 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:08.205638 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171932f0-3975-4b6a-8959-933f52b79ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:08.205889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171932f0-3975-4b6a-8959-933f52b79ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:08.214350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:08.228923 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-171932f0-3975-4b6a-8959-933f52b79ff2 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:08.230190 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-171932f0-3975-4b6a-8959-933f52b79ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:08.238789 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1316/2618] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:17:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:08.244025 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af1306-f39c-4ffd-b0e4-50c380045dd6 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:08.254569 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af1306-f39c-4ffd-b0e4-50c380045dd6 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:08.262390 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b429b29-74fd-4612-985c-29c0d7eddac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:08.263036 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b429b29-74fd-4612-985c-29c0d7eddac5 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:08.263371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b429b29-74fd-4612-985c-29c0d7eddac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:08.263652 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b429b29-74fd-4612-985c-29c0d7eddac5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:08.264363 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b429b29-74fd-4612-985c-29c0d7eddac5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:17:08.264673 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b429b29-74fd-4612-985c-29c0d7eddac5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:08.266475 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b429b29-74fd-4612-985c-29c0d7eddac5 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:08.280809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1303/2619] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:17:08.285542 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171932f0-3975-4b6a-8959-933f52b79ff2 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:08.296567 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171932f0-3975-4b6a-8959-933f52b79ff2 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:08.302867 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09028ba-d2b5-44c7-b60a-4e467f2dffa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:08.304776 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09028ba-d2b5-44c7-b60a-4e467f2dffa9 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:08.305064 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09028ba-d2b5-44c7-b60a-4e467f2dffa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:08.305414 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09028ba-d2b5-44c7-b60a-4e467f2dffa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:08.306081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09028ba-d2b5-44c7-b60a-4e467f2dffa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:08.308112 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09028ba-d2b5-44c7-b60a-4e467f2dffa9 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:08.409432 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1317/2620] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:17:08 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:08.414942 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b429b29-74fd-4612-985c-29c0d7eddac5 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:08.426273 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b429b29-74fd-4612-985c-29c0d7eddac5 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:08.505288 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55fa0b-3b23-40cf-8067-880629a81e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:08.505288 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55fa0b-3b23-40cf-8067-880629a81e64 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:08.505288 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55fa0b-3b23-40cf-8067-880629a81e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:08.505288 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb55fa0b-3b23-40cf-8067-880629a81e64 admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:08.506023 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb55fa0b-3b23-40cf-8067-880629a81e64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:08.508700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb55fa0b-3b23-40cf-8067-880629a81e64 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:08.573464 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1304/2621] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:17:08 2022] POST /identity/v3/users => generated 294 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:08.578581 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09028ba-d2b5-44c7-b60a-4e467f2dffa9 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:08.591642 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09028ba-d2b5-44c7-b60a-4e467f2dffa9 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:08.597222 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75ac5f-73a5-4e9b-8b94-b2457f365742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:08.597942 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75ac5f-73a5-4e9b-8b94-b2457f365742 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:08.598351 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75ac5f-73a5-4e9b-8b94-b2457f365742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:08.598781 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b75ac5f-73a5-4e9b-8b94-b2457f365742 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:08.599607 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75ac5f-73a5-4e9b-8b94-b2457f365742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:08.602052 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b75ac5f-73a5-4e9b-8b94-b2457f365742 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:08.613727 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1318/2622] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:17:08.618348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55fa0b-3b23-40cf-8067-880629a81e64 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:08.629555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb55fa0b-3b23-40cf-8067-880629a81e64 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:08.634847 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c74fff-0ce2-4bcc-a256-6fd72c2c0cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:08.635524 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c74fff-0ce2-4bcc-a256-6fd72c2c0cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:08.635787 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c74fff-0ce2-4bcc-a256-6fd72c2c0cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:08.636059 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c74fff-0ce2-4bcc-a256-6fd72c2c0cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:08.636721 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c74fff-0ce2-4bcc-a256-6fd72c2c0cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:08.638370 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c74fff-0ce2-4bcc-a256-6fd72c2c0cc5 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:08.651291 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1305/2623] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:17:08.655947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75ac5f-73a5-4e9b-8b94-b2457f365742 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:08.668072 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b75ac5f-73a5-4e9b-8b94-b2457f365742 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:08.674019 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826c506-1352-4a26-baf4-74d61f533e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:08.674906 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826c506-1352-4a26-baf4-74d61f533e62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:08.675284 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826c506-1352-4a26-baf4-74d61f533e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:08.675609 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7826c506-1352-4a26-baf4-74d61f533e62 admin admin] PATH_INFO: `/v3/projects/ef8e22de5fd14f4daf89c9e4f2f09ec8/users/4a38bfc64f4b4e9ca422000361a6e182/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:08.692963 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826c506-1352-4a26-baf4-74d61f533e62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef8e22de5fd14f4daf89c9e4f2f09ec8, user_id=4a38bfc64f4b4e9ca422000361a6e182, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:08.695782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7826c506-1352-4a26-baf4-74d61f533e62 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:08.808062 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1319/2624] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:17:08 2022] PUT /identity/v3/projects/ef8e22de5fd14f4daf89c9e4f2f09ec8/users/4a38bfc64f4b4e9ca422000361a6e182/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:08.822423 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a1126-fba5-4751-aec2-fbb94b55a1fe None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:08.822964 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a1126-fba5-4751-aec2-fbb94b55a1fe None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:08.827306 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a1126-fba5-4751-aec2-fbb94b55a1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:08.874798 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-629a1126-fba5-4751-aec2-fbb94b55a1fe None None] MFA Rules not processed for user `4a38bfc64f4b4e9ca422000361a6e182`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:08.876201 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-629a1126-fba5-4751-aec2-fbb94b55a1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:08.957586 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:08.993550 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1306/2625] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:17:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:09.000703 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826c506-1352-4a26-baf4-74d61f533e62 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:09.078411 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7826c506-1352-4a26-baf4-74d61f533e62 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:09.083620 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e108d7-2f18-492e-a098-5f67db5dde2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:09.084330 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e108d7-2f18-492e-a098-5f67db5dde2d admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:09.084708 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e108d7-2f18-492e-a098-5f67db5dde2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:09.085048 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e108d7-2f18-492e-a098-5f67db5dde2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:09.085842 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e108d7-2f18-492e-a098-5f67db5dde2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:09.088054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e108d7-2f18-492e-a098-5f67db5dde2d admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:09.197477 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1320/2626] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:17:08 2022] POST /identity/v3/projects => generated 387 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:09.202270 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a1126-fba5-4751-aec2-fbb94b55a1fe None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:09.215041 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a1126-fba5-4751-aec2-fbb94b55a1fe None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:09.283428 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1721e-651c-441c-8bb7-1ea68375c212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:09.284083 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1721e-651c-441c-8bb7-1ea68375c212 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:09.284366 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1721e-651c-441c-8bb7-1ea68375c212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:09.284641 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1721e-651c-441c-8bb7-1ea68375c212 admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:09.285300 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1721e-651c-441c-8bb7-1ea68375c212 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:09.287382 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1721e-651c-441c-8bb7-1ea68375c212 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:09.395531 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1307/2627] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:17:09 2022] POST /identity/v3/users => generated 300 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:09.399996 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e108d7-2f18-492e-a098-5f67db5dde2d admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:09.411818 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e108d7-2f18-492e-a098-5f67db5dde2d admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:09.417251 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51aa3c-f76e-4aec-ab9e-c315ff6419e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:09.417876 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51aa3c-f76e-4aec-ab9e-c315ff6419e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:09.418161 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51aa3c-f76e-4aec-ab9e-c315ff6419e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:09.418448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51aa3c-f76e-4aec-ab9e-c315ff6419e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:09.419094 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51aa3c-f76e-4aec-ab9e-c315ff6419e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:09.420753 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a51aa3c-f76e-4aec-ab9e-c315ff6419e6 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:09.434339 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1321/2628] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:17:09.439177 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1721e-651c-441c-8bb7-1ea68375c212 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:09.451422 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1721e-651c-441c-8bb7-1ea68375c212 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:09.456353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ce039-de02-4711-89a4-3b1c52aa78d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:09.457044 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ce039-de02-4711-89a4-3b1c52aa78d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:09.457328 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ce039-de02-4711-89a4-3b1c52aa78d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:09.457608 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ce039-de02-4711-89a4-3b1c52aa78d4 admin admin] PATH_INFO: `/v3/projects/30d96d0439984f0082942a1452ffacea/users/cd3e8f8af7764c0393a9941973105ec6/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:09.475445 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ce039-de02-4711-89a4-3b1c52aa78d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30d96d0439984f0082942a1452ffacea, user_id=cd3e8f8af7764c0393a9941973105ec6, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:09.481791 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ce039-de02-4711-89a4-3b1c52aa78d4 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:09.554287 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1308/2629] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:17:09 2022] PUT /identity/v3/projects/30d96d0439984f0082942a1452ffacea/users/cd3e8f8af7764c0393a9941973105ec6/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:09.560339 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51aa3c-f76e-4aec-ab9e-c315ff6419e6 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:09.574611 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51aa3c-f76e-4aec-ab9e-c315ff6419e6 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:09.672294 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85070591-1e6a-41d6-b3fa-7c098bf184c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:09.673005 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85070591-1e6a-41d6-b3fa-7c098bf184c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:09.673289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85070591-1e6a-41d6-b3fa-7c098bf184c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:09.673603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85070591-1e6a-41d6-b3fa-7c098bf184c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:09.674223 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85070591-1e6a-41d6-b3fa-7c098bf184c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:09.675893 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85070591-1e6a-41d6-b3fa-7c098bf184c5 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:09.688724 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1322/2630] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:09 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:17:09.695429 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ce039-de02-4711-89a4-3b1c52aa78d4 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:09.707239 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ce039-de02-4711-89a4-3b1c52aa78d4 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:09.712413 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c27f1-9a22-4303-9dd2-098931aa89d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:09.713255 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c27f1-9a22-4303-9dd2-098931aa89d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:09.713547 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c27f1-9a22-4303-9dd2-098931aa89d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:09.716777 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c27f1-9a22-4303-9dd2-098931aa89d5 admin admin] PATH_INFO: `/v3/projects/30d96d0439984f0082942a1452ffacea/users/cd3e8f8af7764c0393a9941973105ec6/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:09.716777 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c27f1-9a22-4303-9dd2-098931aa89d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30d96d0439984f0082942a1452ffacea, user_id=cd3e8f8af7764c0393a9941973105ec6, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:09.718927 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97c27f1-9a22-4303-9dd2-098931aa89d5 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:09.732627 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1309/2631] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:17:09 2022] PUT /identity/v3/projects/30d96d0439984f0082942a1452ffacea/users/cd3e8f8af7764c0393a9941973105ec6/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:17:09.745293 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b154a-9e98-4d85-84b9-86c64e8f2cb7 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:09.746127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b154a-9e98-4d85-84b9-86c64e8f2cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:09.746127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b154a-9e98-4d85-84b9-86c64e8f2cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:09.770328 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:09.781992 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-689b154a-9e98-4d85-84b9-86c64e8f2cb7 None None] MFA Rules not processed for user `cd3e8f8af7764c0393a9941973105ec6`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:09.785408 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-689b154a-9e98-4d85-84b9-86c64e8f2cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:09.889840 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1323/2632] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:17:09 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:17:09.904266 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c27f1-9a22-4303-9dd2-098931aa89d5 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:09.906872 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-d97c27f1-9a22-4303-9dd2-098931aa89d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:09.988706 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c27f1-9a22-4303-9dd2-098931aa89d5 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:09.993578 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb850a5-83d7-4577-afbb-62e31c066089 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:09.994243 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb850a5-83d7-4577-afbb-62e31c066089 service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:09.994550 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb850a5-83d7-4577-afbb-62e31c066089 service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:09.994821 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb850a5-83d7-4577-afbb-62e31c066089 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:10.007622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb850a5-83d7-4577-afbb-62e31c066089 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:10.009827 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb850a5-83d7-4577-afbb-62e31c066089 service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:10.034345 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1310/2633] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:09 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:10.121869 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b154a-9e98-4d85-84b9-86c64e8f2cb7 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:10.194577 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b154a-9e98-4d85-84b9-86c64e8f2cb7 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:10.199674 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08cbb7-03ad-4952-bbaa-5263b8ea1d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:10.200342 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08cbb7-03ad-4952-bbaa-5263b8ea1d12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:10.200614 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08cbb7-03ad-4952-bbaa-5263b8ea1d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:10.200889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08cbb7-03ad-4952-bbaa-5263b8ea1d12 admin admin] PATH_INFO: `/v3/users/4a38bfc64f4b4e9ca422000361a6e182` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:10.202121 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08cbb7-03ad-4952-bbaa-5263b8ea1d12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a38bfc64f4b4e9ca422000361a6e182)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:10.204217 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08cbb7-03ad-4952-bbaa-5263b8ea1d12 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:10.385863 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f326619-0d32-4619-a2b4-d1c4ad84544c None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:10.386503 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f326619-0d32-4619-a2b4-d1c4ad84544c None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:10.386503 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f326619-0d32-4619-a2b4-d1c4ad84544c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:10.409455 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-4f326619-0d32-4619-a2b4-d1c4ad84544c None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:10.410810 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-4f326619-0d32-4619-a2b4-d1c4ad84544c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:10.416844 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-8c08cbb7-03ad-4952-bbaa-5263b8ea1d12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a38bfc64f4b4e9ca422000361a6e182'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:10.421579 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1311/2634] 10.222.0.47 () {58 vars in 1016 bytes} [Wed Aug 24 17:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:17:10.426004 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-8c08cbb7-03ad-4952-bbaa-5263b8ea1d12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a38bfc64f4b4e9ca422000361a6e182'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:10.439148 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f326619-0d32-4619-a2b4-d1c4ad84544c None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:10.440742 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-4f326619-0d32-4619-a2b4-d1c4ad84544c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:10.491048 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:10.492065 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-8c08cbb7-03ad-4952-bbaa-5263b8ea1d12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a38bfc64f4b4e9ca422000361a6e182'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:10.493088 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-8c08cbb7-03ad-4952-bbaa-5263b8ea1d12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a38bfc64f4b4e9ca422000361a6e182'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:10.493694 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-8c08cbb7-03ad-4952-bbaa-5263b8ea1d12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a38bfc64f4b4e9ca422000361a6e182'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:10.518186 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1324/2635] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:17:10 2022] DELETE /identity/v3/users/4a38bfc64f4b4e9ca422000361a6e182 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:10.523984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca22fc-eeb3-4a51-b298-cb778f4327f4 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:10.524268 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca22fc-eeb3-4a51-b298-cb778f4327f4 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:10.524576 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca22fc-eeb3-4a51-b298-cb778f4327f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:10.529222 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f326619-0d32-4619-a2b4-d1c4ad84544c None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:10.545918 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-80ca22fc-eeb3-4a51-b298-cb778f4327f4 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:10.547322 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-80ca22fc-eeb3-4a51-b298-cb778f4327f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:10.557596 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:10.608729 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48455e93-c762-4936-bbe0-647b84dda4be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:10.609369 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48455e93-c762-4936-bbe0-647b84dda4be service nova] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:10.609688 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48455e93-c762-4936-bbe0-647b84dda4be service nova] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:10.610015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48455e93-c762-4936-bbe0-647b84dda4be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:10.612244 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-48455e93-c762-4936-bbe0-647b84dda4be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:10.626913 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1325/2636] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:10.642911 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca22fc-eeb3-4a51-b298-cb778f4327f4 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:10.644410 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-80ca22fc-eeb3-4a51-b298-cb778f4327f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:10.692332 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48455e93-c762-4936-bbe0-647b84dda4be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:10.694737 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48455e93-c762-4936-bbe0-647b84dda4be service nova] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:10.706703 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1312/2637] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:17:10.717678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca22fc-eeb3-4a51-b298-cb778f4327f4 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:10.722208 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b134cd-7eba-4c58-8590-a5cc7d4914da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:10.722870 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b134cd-7eba-4c58-8590-a5cc7d4914da service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:10.723185 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b134cd-7eba-4c58-8590-a5cc7d4914da service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:10.723465 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b134cd-7eba-4c58-8590-a5cc7d4914da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:10.737266 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b134cd-7eba-4c58-8590-a5cc7d4914da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:10.739913 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b134cd-7eba-4c58-8590-a5cc7d4914da service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:10.752337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1326/2638] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:17:11.277253 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48455e93-c762-4936-bbe0-647b84dda4be service nova] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:11.279070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-48455e93-c762-4936-bbe0-647b84dda4be service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:11.299033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48455e93-c762-4936-bbe0-647b84dda4be service nova] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:11.305987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e355c4-bfaf-4164-830f-cd35385480e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:11.307251 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e355c4-bfaf-4164-830f-cd35385480e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:11.307616 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e355c4-bfaf-4164-830f-cd35385480e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:11.308099 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e355c4-bfaf-4164-830f-cd35385480e7 admin admin] PATH_INFO: `/v3/projects/ef8e22de5fd14f4daf89c9e4f2f09ec8` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:11.310289 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e355c4-bfaf-4164-830f-cd35385480e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef8e22de5fd14f4daf89c9e4f2f09ec8)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:11.314248 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e355c4-bfaf-4164-830f-cd35385480e7 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:11.490636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-44e355c4-bfaf-4164-830f-cd35385480e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef8e22de5fd14f4daf89c9e4f2f09ec8', 'request_id': 'req-44e355c4-bfaf-4164-830f-cd35385480e7'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:11.497090 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-44e355c4-bfaf-4164-830f-cd35385480e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef8e22de5fd14f4daf89c9e4f2f09ec8', 'request_id': 'req-44e355c4-bfaf-4164-830f-cd35385480e7'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:11.504173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-44e355c4-bfaf-4164-830f-cd35385480e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef8e22de5fd14f4daf89c9e4f2f09ec8', 'request_id': 'req-44e355c4-bfaf-4164-830f-cd35385480e7'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:11.506622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:11.594780 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-44e355c4-bfaf-4164-830f-cd35385480e7 admin admin] The token cache is being invalidate because project ef8e22de5fd14f4daf89c9e4f2f09ec8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:17:11.595086 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-44e355c4-bfaf-4164-830f-cd35385480e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:11.595827 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-44e355c4-bfaf-4164-830f-cd35385480e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:11.597661 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1313/2639] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:17:11 2022] DELETE /identity/v3/projects/ef8e22de5fd14f4daf89c9e4f2f09ec8 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:11.602423 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b134cd-7eba-4c58-8590-a5cc7d4914da service neutron] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:11.613290 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b134cd-7eba-4c58-8590-a5cc7d4914da service neutron] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:11.691138 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9da01bb-fda1-4a79-9c43-34a7b244bcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:11.691886 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da01bb-fda1-4a79-9c43-34a7b244bcff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:11.692259 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da01bb-fda1-4a79-9c43-34a7b244bcff admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:11.692579 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9da01bb-fda1-4a79-9c43-34a7b244bcff admin admin] PATH_INFO: `/v3/users/cd3e8f8af7764c0393a9941973105ec6` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:11.694049 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da01bb-fda1-4a79-9c43-34a7b244bcff admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd3e8f8af7764c0393a9941973105ec6)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:11.696500 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9da01bb-fda1-4a79-9c43-34a7b244bcff admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:11.929295 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-c9da01bb-fda1-4a79-9c43-34a7b244bcff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd3e8f8af7764c0393a9941973105ec6'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:11.940334 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-c9da01bb-fda1-4a79-9c43-34a7b244bcff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd3e8f8af7764c0393a9941973105ec6'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:11.945842 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:12.063740 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-c9da01bb-fda1-4a79-9c43-34a7b244bcff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd3e8f8af7764c0393a9941973105ec6'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:12.064556 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-c9da01bb-fda1-4a79-9c43-34a7b244bcff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd3e8f8af7764c0393a9941973105ec6'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:12.065329 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-c9da01bb-fda1-4a79-9c43-34a7b244bcff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd3e8f8af7764c0393a9941973105ec6'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:12.088816 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1327/2640] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:17:11 2022] DELETE /identity/v3/users/cd3e8f8af7764c0393a9941973105ec6 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:12.940356 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e355c4-bfaf-4164-830f-cd35385480e7 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:12.947503 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-44e355c4-bfaf-4164-830f-cd35385480e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:12.964902 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e355c4-bfaf-4164-830f-cd35385480e7 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:13.042474 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8064a-4bdc-4c3c-af7f-ce1c8d773dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:13.043260 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8064a-4bdc-4c3c-af7f-ce1c8d773dbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:13.043678 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8064a-4bdc-4c3c-af7f-ce1c8d773dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:13.044022 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8064a-4bdc-4c3c-af7f-ce1c8d773dbf admin admin] PATH_INFO: `/v3/projects/30d96d0439984f0082942a1452ffacea` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:13.045700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf8064a-4bdc-4c3c-af7f-ce1c8d773dbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=30d96d0439984f0082942a1452ffacea)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:13.048180 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf8064a-4bdc-4c3c-af7f-ce1c8d773dbf admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:13.217149 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-6bf8064a-4bdc-4c3c-af7f-ce1c8d773dbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30d96d0439984f0082942a1452ffacea', 'request_id': 'req-6bf8064a-4bdc-4c3c-af7f-ce1c8d773dbf'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:13.223942 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-6bf8064a-4bdc-4c3c-af7f-ce1c8d773dbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30d96d0439984f0082942a1452ffacea', 'request_id': 'req-6bf8064a-4bdc-4c3c-af7f-ce1c8d773dbf'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:13.232130 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-6bf8064a-4bdc-4c3c-af7f-ce1c8d773dbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30d96d0439984f0082942a1452ffacea', 'request_id': 'req-6bf8064a-4bdc-4c3c-af7f-ce1c8d773dbf'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:13.339682 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-6bf8064a-4bdc-4c3c-af7f-ce1c8d773dbf admin admin] The token cache is being invalidate because project 30d96d0439984f0082942a1452ffacea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:17:13.340187 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-6bf8064a-4bdc-4c3c-af7f-ce1c8d773dbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:13.341253 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-6bf8064a-4bdc-4c3c-af7f-ce1c8d773dbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:13.343993 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1314/2641] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:17:12 2022] DELETE /identity/v3/projects/30d96d0439984f0082942a1452ffacea => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:17:13.350635 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194668f7-ac30-42f7-a010-3aef31deec09 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:13.351505 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194668f7-ac30-42f7-a010-3aef31deec09 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:13.351505 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194668f7-ac30-42f7-a010-3aef31deec09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:13.376107 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-194668f7-ac30-42f7-a010-3aef31deec09 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:13.377553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-194668f7-ac30-42f7-a010-3aef31deec09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:13.459981 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1328/2642] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:17:13.471478 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf794f3-307c-446c-936e-8ff63f5c26bc None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:13.472051 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf794f3-307c-446c-936e-8ff63f5c26bc None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:13.472575 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf794f3-307c-446c-936e-8ff63f5c26bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:13.509583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-1cf794f3-307c-446c-936e-8ff63f5c26bc None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:13.511849 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-1cf794f3-307c-446c-936e-8ff63f5c26bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:13.531178 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1315/2643] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:17:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:13.534819 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194668f7-ac30-42f7-a010-3aef31deec09 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:13.555897 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194668f7-ac30-42f7-a010-3aef31deec09 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:13.564510 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331f331-382d-4fbe-9a2a-8a57304f9762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:13.566106 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331f331-382d-4fbe-9a2a-8a57304f9762 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:13.566622 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331f331-382d-4fbe-9a2a-8a57304f9762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:13.567087 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331f331-382d-4fbe-9a2a-8a57304f9762 admin admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:13.568289 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331f331-382d-4fbe-9a2a-8a57304f9762 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:17:13.569457 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331f331-382d-4fbe-9a2a-8a57304f9762 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:13.572794 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331f331-382d-4fbe-9a2a-8a57304f9762 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:13.590374 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1329/2644] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:17:13.595415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf794f3-307c-446c-936e-8ff63f5c26bc None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:13.607044 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf794f3-307c-446c-936e-8ff63f5c26bc None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:13.612659 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b823f-390a-4ed8-bc83-beb86a1ecd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:13.613459 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b823f-390a-4ed8-bc83-beb86a1ecd8e admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:13.613776 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b823f-390a-4ed8-bc83-beb86a1ecd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:13.614130 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b823f-390a-4ed8-bc83-beb86a1ecd8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:13.614832 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b823f-390a-4ed8-bc83-beb86a1ecd8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:13.617936 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b823f-390a-4ed8-bc83-beb86a1ecd8e admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:13.775054 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1316/2645] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:17:13 2022] POST /identity/v3/projects => generated 381 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:17:13.780083 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331f331-382d-4fbe-9a2a-8a57304f9762 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:13.791605 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331f331-382d-4fbe-9a2a-8a57304f9762 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:13.885591 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d13f16-0cd7-4e4c-a3a9-5d824f6e76b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:13.886658 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d13f16-0cd7-4e4c-a3a9-5d824f6e76b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:13.887183 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d13f16-0cd7-4e4c-a3a9-5d824f6e76b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:13.887660 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d13f16-0cd7-4e4c-a3a9-5d824f6e76b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:13.888797 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d13f16-0cd7-4e4c-a3a9-5d824f6e76b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:13.892788 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d13f16-0cd7-4e4c-a3a9-5d824f6e76b3 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:14.107102 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1330/2646] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:17:13 2022] POST /identity/v3/users => generated 291 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:17:14.112813 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b823f-390a-4ed8-bc83-beb86a1ecd8e admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:14.127058 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b823f-390a-4ed8-bc83-beb86a1ecd8e admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:14.133170 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97f28d-adb1-48e3-9683-561affc155c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:14.136055 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97f28d-adb1-48e3-9683-561affc155c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:14.136055 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97f28d-adb1-48e3-9683-561affc155c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:14.136055 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f97f28d-adb1-48e3-9683-561affc155c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:14.136055 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97f28d-adb1-48e3-9683-561affc155c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:14.136641 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f97f28d-adb1-48e3-9683-561affc155c2 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:14.150447 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1317/2647] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:17:14.154968 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d13f16-0cd7-4e4c-a3a9-5d824f6e76b3 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:14.167258 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d13f16-0cd7-4e4c-a3a9-5d824f6e76b3 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:14.172804 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520d08b-3421-4817-809e-726719c3c49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:14.173435 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520d08b-3421-4817-809e-726719c3c49e admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:14.173713 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520d08b-3421-4817-809e-726719c3c49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:14.174703 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520d08b-3421-4817-809e-726719c3c49e admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:14.174703 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520d08b-3421-4817-809e-726719c3c49e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:14.176504 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520d08b-3421-4817-809e-726719c3c49e admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:14.200250 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1331/2648] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:17:14.201372 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97f28d-adb1-48e3-9683-561affc155c2 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:14.234531 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f97f28d-adb1-48e3-9683-561affc155c2 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:14.234531 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f915020-60f1-4ff2-a790-f2d4d923b630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:14.234531 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f915020-60f1-4ff2-a790-f2d4d923b630 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:14.234531 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f915020-60f1-4ff2-a790-f2d4d923b630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:14.235227 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f915020-60f1-4ff2-a790-f2d4d923b630 admin admin] PATH_INFO: `/v3/projects/279ca72fc0764432ae8e9e36f33b04d7/users/7a14c03dea974d4cb97ebb4c422d45c2/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:14.249564 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f915020-60f1-4ff2-a790-f2d4d923b630 admin admin] RBAC: Authorizing `identity:create_grant(project_id=279ca72fc0764432ae8e9e36f33b04d7, user_id=7a14c03dea974d4cb97ebb4c422d45c2, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:14.252601 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f915020-60f1-4ff2-a790-f2d4d923b630 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:14.407639 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1318/2649] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:17:14 2022] PUT /identity/v3/projects/279ca72fc0764432ae8e9e36f33b04d7/users/7a14c03dea974d4cb97ebb4c422d45c2/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:14.418632 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38676c-0bde-43ff-aab8-6c59f9af2c96 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:14.419264 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38676c-0bde-43ff-aab8-6c59f9af2c96 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:14.419463 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38676c-0bde-43ff-aab8-6c59f9af2c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:14.456772 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-1a38676c-0bde-43ff-aab8-6c59f9af2c96 None None] MFA Rules not processed for user `7a14c03dea974d4cb97ebb4c422d45c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:14.458059 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-1a38676c-0bde-43ff-aab8-6c59f9af2c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:14.498684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:14.542794 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1332/2650] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:17:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:14.548336 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f915020-60f1-4ff2-a790-f2d4d923b630 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:14.572525 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:14.645070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f915020-60f1-4ff2-a790-f2d4d923b630 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:14.653789 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c04dde-42d2-483a-9e80-cf2866e89764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:14.654824 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c04dde-42d2-483a-9e80-cf2866e89764 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:14.655356 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c04dde-42d2-483a-9e80-cf2866e89764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:14.655806 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c04dde-42d2-483a-9e80-cf2866e89764 admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:14.656881 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c04dde-42d2-483a-9e80-cf2866e89764 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:14.660962 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c04dde-42d2-483a-9e80-cf2866e89764 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:14.785696 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1319/2651] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:17:14 2022] POST /identity/v3/projects => generated 379 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:14.790781 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38676c-0bde-43ff-aab8-6c59f9af2c96 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:14.812025 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a38676c-0bde-43ff-aab8-6c59f9af2c96 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:14.936236 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca55d3c-2d57-45a2-a6bd-2a737a4053ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:14.937243 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca55d3c-2d57-45a2-a6bd-2a737a4053ec admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:14.937958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca55d3c-2d57-45a2-a6bd-2a737a4053ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:14.938378 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca55d3c-2d57-45a2-a6bd-2a737a4053ec admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:14.939242 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca55d3c-2d57-45a2-a6bd-2a737a4053ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:14.941822 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca55d3c-2d57-45a2-a6bd-2a737a4053ec admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:15.031529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1333/2652] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:17:14 2022] POST /identity/v3/users => generated 296 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:15.036548 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c04dde-42d2-483a-9e80-cf2866e89764 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:15.059554 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c04dde-42d2-483a-9e80-cf2866e89764 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:15.069033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ef069-c484-4061-ad11-916713c24689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:15.069732 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ef069-c484-4061-ad11-916713c24689 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:15.077901 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ef069-c484-4061-ad11-916713c24689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:15.077901 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919ef069-c484-4061-ad11-916713c24689 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:15.077901 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ef069-c484-4061-ad11-916713c24689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:15.077901 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919ef069-c484-4061-ad11-916713c24689 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:15.094006 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1320/2653] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:17:15.096026 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca55d3c-2d57-45a2-a6bd-2a737a4053ec admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:15.115372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca55d3c-2d57-45a2-a6bd-2a737a4053ec admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:15.123730 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f9e77-7056-4c83-8900-36cb43e99266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:15.124725 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f9e77-7056-4c83-8900-36cb43e99266 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:15.125221 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f9e77-7056-4c83-8900-36cb43e99266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:15.125693 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f9e77-7056-4c83-8900-36cb43e99266 admin admin] PATH_INFO: `/v3/projects/effe84fe3aca41c3a32bd639d86bd700/users/90543f40c1b24793baaded7d7e202631/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:15.155726 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f9e77-7056-4c83-8900-36cb43e99266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=effe84fe3aca41c3a32bd639d86bd700, user_id=90543f40c1b24793baaded7d7e202631, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:15.160318 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f9e77-7056-4c83-8900-36cb43e99266 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:15.363882 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1334/2654] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:17:15 2022] PUT /identity/v3/projects/effe84fe3aca41c3a32bd639d86bd700/users/90543f40c1b24793baaded7d7e202631/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:15.369155 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ef069-c484-4061-ad11-916713c24689 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:15.392661 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919ef069-c484-4061-ad11-916713c24689 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:15.579724 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bfbb25-a003-4b22-b338-e3ccd57ac53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:15.580845 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfbb25-a003-4b22-b338-e3ccd57ac53d admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:15.581474 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfbb25-a003-4b22-b338-e3ccd57ac53d admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:15.587554 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bfbb25-a003-4b22-b338-e3ccd57ac53d admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:15.587554 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bfbb25-a003-4b22-b338-e3ccd57ac53d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:15.587554 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bfbb25-a003-4b22-b338-e3ccd57ac53d admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:15.614985 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1321/2655] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:15 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:17:15.619300 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f9e77-7056-4c83-8900-36cb43e99266 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:15.634762 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f9e77-7056-4c83-8900-36cb43e99266 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:15.642970 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9f1dc-7efd-4ff7-a14b-ee50952491b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:15.644292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9f1dc-7efd-4ff7-a14b-ee50952491b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:15.644792 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9f1dc-7efd-4ff7-a14b-ee50952491b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:15.645116 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9f1dc-7efd-4ff7-a14b-ee50952491b0 admin admin] PATH_INFO: `/v3/projects/effe84fe3aca41c3a32bd639d86bd700/users/90543f40c1b24793baaded7d7e202631/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:15.651416 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9f1dc-7efd-4ff7-a14b-ee50952491b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=effe84fe3aca41c3a32bd639d86bd700, user_id=90543f40c1b24793baaded7d7e202631, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:15.664895 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bfbb25-a003-4b22-b338-e3ccd57ac53d admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:15.665205 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9f1dc-7efd-4ff7-a14b-ee50952491b0 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:15.667036 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-16bfbb25-a003-4b22-b338-e3ccd57ac53d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:15.688370 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1335/2656] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:17:15 2022] PUT /identity/v3/projects/effe84fe3aca41c3a32bd639d86bd700/users/90543f40c1b24793baaded7d7e202631/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:17:15.710008 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179989b-2bd3-4034-a1e5-a8c4df5d3f98 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:15.710432 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179989b-2bd3-4034-a1e5-a8c4df5d3f98 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:15.711331 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179989b-2bd3-4034-a1e5-a8c4df5d3f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:15.763651 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-a179989b-2bd3-4034-a1e5-a8c4df5d3f98 None None] MFA Rules not processed for user `90543f40c1b24793baaded7d7e202631`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:15.777438 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-a179989b-2bd3-4034-a1e5-a8c4df5d3f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:15.781232 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bfbb25-a003-4b22-b338-e3ccd57ac53d admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:15.893975 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:15.908472 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7365e04-c4b4-4437-ab82-d1cdb31ebdea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:15.909792 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7365e04-c4b4-4437-ab82-d1cdb31ebdea service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:15.911578 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7365e04-c4b4-4437-ab82-d1cdb31ebdea service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:15.912738 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7365e04-c4b4-4437-ab82-d1cdb31ebdea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:15.917957 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-f7365e04-c4b4-4437-ab82-d1cdb31ebdea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:15.930157 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1336/2657] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:17:15 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:15.956597 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179989b-2bd3-4034-a1e5-a8c4df5d3f98 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:15.959846 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-a179989b-2bd3-4034-a1e5-a8c4df5d3f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:15.990270 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:16.025293 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7365e04-c4b4-4437-ab82-d1cdb31ebdea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:16.028853 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7365e04-c4b4-4437-ab82-d1cdb31ebdea service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:16.041639 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1322/2658] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:17:16.128384 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179989b-2bd3-4034-a1e5-a8c4df5d3f98 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:16.139676 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88704d-c938-4bc7-9899-66e84ed6ff87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:16.141360 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88704d-c938-4bc7-9899-66e84ed6ff87 service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:16.148516 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88704d-c938-4bc7-9899-66e84ed6ff87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:16.148516 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a88704d-c938-4bc7-9899-66e84ed6ff87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:16.168963 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88704d-c938-4bc7-9899-66e84ed6ff87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:16.173038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a88704d-c938-4bc7-9899-66e84ed6ff87 service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:16.215105 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1337/2659] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:15 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:17:16.602862 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2850fc-4173-4cfc-a105-27af270626eb None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:16.604361 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2850fc-4173-4cfc-a105-27af270626eb None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:16.605110 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2850fc-4173-4cfc-a105-27af270626eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:16.645697 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-fb2850fc-4173-4cfc-a105-27af270626eb None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:16.648304 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-fb2850fc-4173-4cfc-a105-27af270626eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:16.780302 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1323/2660] 10.222.0.47 () {58 vars in 1016 bytes} [Wed Aug 24 17:17:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:16.797462 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88704d-c938-4bc7-9899-66e84ed6ff87 service cinder] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:16.799373 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-7a88704d-c938-4bc7-9899-66e84ed6ff87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:16.906124 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a88704d-c938-4bc7-9899-66e84ed6ff87 service cinder] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:16.916248 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12f9a8-65c6-43f8-9678-007ae657d381 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:16.917145 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12f9a8-65c6-43f8-9678-007ae657d381 service nova] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:16.917611 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12f9a8-65c6-43f8-9678-007ae657d381 service nova] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:16.918191 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12f9a8-65c6-43f8-9678-007ae657d381 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:16.939374 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12f9a8-65c6-43f8-9678-007ae657d381 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:16.942447 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12f9a8-65c6-43f8-9678-007ae657d381 service nova] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:16.957273 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1338/2661] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:17.746254 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2850fc-4173-4cfc-a105-27af270626eb None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:17.759462 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2850fc-4173-4cfc-a105-27af270626eb None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:17.765448 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75ef9c-5d50-4056-8302-d8a5bcd14d3d tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90543f40c1b24793baaded7d7e202631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'effe84fe3aca41c3a32bd639d86bd700', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:17.766262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75ef9c-5d50-4056-8302-d8a5bcd14d3d tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:17.766693 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75ef9c-5d50-4056-8302-d8a5bcd14d3d tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:17.767066 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75ef9c-5d50-4056-8302-d8a5bcd14d3d tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:17.768051 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75ef9c-5d50-4056-8302-d8a5bcd14d3d tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:17:17.768505 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75ef9c-5d50-4056-8302-d8a5bcd14d3d tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:17.770759 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75ef9c-5d50-4056-8302-d8a5bcd14d3d tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:17.790128 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1324/2662] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:17:17.793634 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12f9a8-65c6-43f8-9678-007ae657d381 service nova] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:17.805844 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12f9a8-65c6-43f8-9678-007ae657d381 service nova] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:17.811258 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abae2cf-7094-4453-b58d-3e2f1222cab0 tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90543f40c1b24793baaded7d7e202631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'effe84fe3aca41c3a32bd639d86bd700', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:17.811903 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abae2cf-7094-4453-b58d-3e2f1222cab0 tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:17.812194 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abae2cf-7094-4453-b58d-3e2f1222cab0 tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:17.812463 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abae2cf-7094-4453-b58d-3e2f1222cab0 tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:17.813115 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abae2cf-7094-4453-b58d-3e2f1222cab0 tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:17.815098 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abae2cf-7094-4453-b58d-3e2f1222cab0 tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:17.991980 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1339/2663] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:17:17 2022] POST /identity/v3/projects => generated 355 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:18.001242 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75ef9c-5d50-4056-8302-d8a5bcd14d3d tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:18.028694 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75ef9c-5d50-4056-8302-d8a5bcd14d3d tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:18.138631 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6d5df-f95d-4d8c-8b95-b3c3275e8121 tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90543f40c1b24793baaded7d7e202631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'effe84fe3aca41c3a32bd639d86bd700', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:18.141137 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6d5df-f95d-4d8c-8b95-b3c3275e8121 tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:18.144387 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6d5df-f95d-4d8c-8b95-b3c3275e8121 tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:18.148150 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6d5df-f95d-4d8c-8b95-b3c3275e8121 tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:18.152683 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6d5df-f95d-4d8c-8b95-b3c3275e8121 tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:17:18.153018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6d5df-f95d-4d8c-8b95-b3c3275e8121 tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:18.154908 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6d5df-f95d-4d8c-8b95-b3c3275e8121 tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:18.174177 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1325/2664] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:17:18.225397 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abae2cf-7094-4453-b58d-3e2f1222cab0 tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:18.242249 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abae2cf-7094-4453-b58d-3e2f1222cab0 tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:18.251488 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68be8d4c-4cab-46bf-ace3-2f7c5a7c9539 tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '90543f40c1b24793baaded7d7e202631', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'effe84fe3aca41c3a32bd639d86bd700', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:18.252207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be8d4c-4cab-46bf-ace3-2f7c5a7c9539 tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:18.252557 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be8d4c-4cab-46bf-ace3-2f7c5a7c9539 tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:18.252838 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68be8d4c-4cab-46bf-ace3-2f7c5a7c9539 tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] PATH_INFO: `/v3/projects/2434ddb0b2644e3da3ccd0f27c1188f8` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:18.254705 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be8d4c-4cab-46bf-ace3-2f7c5a7c9539 tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2434ddb0b2644e3da3ccd0f27c1188f8)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:18.256905 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68be8d4c-4cab-46bf-ace3-2f7c5a7c9539 tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:18.407032 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-68be8d4c-4cab-46bf-ace3-2f7c5a7c9539 tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2434ddb0b2644e3da3ccd0f27c1188f8', 'request_id': 'req-68be8d4c-4cab-46bf-ace3-2f7c5a7c9539'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:18.418737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-68be8d4c-4cab-46bf-ace3-2f7c5a7c9539 tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2434ddb0b2644e3da3ccd0f27c1188f8', 'request_id': 'req-68be8d4c-4cab-46bf-ace3-2f7c5a7c9539'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:18.583206 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-68be8d4c-4cab-46bf-ace3-2f7c5a7c9539 tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2434ddb0b2644e3da3ccd0f27c1188f8', 'request_id': 'req-68be8d4c-4cab-46bf-ace3-2f7c5a7c9539'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:18.597067 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:18.602318 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-68be8d4c-4cab-46bf-ace3-2f7c5a7c9539 tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] The token cache is being invalidate because project 2434ddb0b2644e3da3ccd0f27c1188f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:17:18.603076 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-68be8d4c-4cab-46bf-ace3-2f7c5a7c9539 tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:18.607603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-68be8d4c-4cab-46bf-ace3-2f7c5a7c9539 tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:18.607603 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1340/2665] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:17:18 2022] DELETE /identity/v3/projects/2434ddb0b2644e3da3ccd0f27c1188f8 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:17:19.574225 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6d5df-f95d-4d8c-8b95-b3c3275e8121 tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:19.576381 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-bbc6d5df-f95d-4d8c-8b95-b3c3275e8121 tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:19.604632 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:19.681015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6d5df-f95d-4d8c-8b95-b3c3275e8121 tempest-VolumeQuotaClassesTest-584837772 tempest-VolumeQuotaClassesTest-584837772-project-admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:19.755237 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eaa0fb-ccf5-4bab-89e5-88701a6bbc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:19.756477 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaa0fb-ccf5-4bab-89e5-88701a6bbc89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:19.756815 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaa0fb-ccf5-4bab-89e5-88701a6bbc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:19.757195 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaa0fb-ccf5-4bab-89e5-88701a6bbc89 admin admin] PATH_INFO: `/v3/users/7a14c03dea974d4cb97ebb4c422d45c2` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:19.758678 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eaa0fb-ccf5-4bab-89e5-88701a6bbc89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a14c03dea974d4cb97ebb4c422d45c2)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:19.761103 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eaa0fb-ccf5-4bab-89e5-88701a6bbc89 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:20.129061 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-97eaa0fb-ccf5-4bab-89e5-88701a6bbc89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a14c03dea974d4cb97ebb4c422d45c2'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:20.130198 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-97eaa0fb-ccf5-4bab-89e5-88701a6bbc89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a14c03dea974d4cb97ebb4c422d45c2'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:20.140192 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-97eaa0fb-ccf5-4bab-89e5-88701a6bbc89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a14c03dea974d4cb97ebb4c422d45c2'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:20.141155 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-97eaa0fb-ccf5-4bab-89e5-88701a6bbc89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a14c03dea974d4cb97ebb4c422d45c2'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:20.234962 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-97eaa0fb-ccf5-4bab-89e5-88701a6bbc89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a14c03dea974d4cb97ebb4c422d45c2'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:20.259661 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1326/2666] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:17:19 2022] DELETE /identity/v3/users/7a14c03dea974d4cb97ebb4c422d45c2 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:17:20.264574 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e180a-6144-4823-8061-a5d41def48e9 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:20.265271 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e180a-6144-4823-8061-a5d41def48e9 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:20.265609 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e180a-6144-4823-8061-a5d41def48e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:20.288270 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-c90e180a-6144-4823-8061-a5d41def48e9 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:20.289598 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-c90e180a-6144-4823-8061-a5d41def48e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:20.367904 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1341/2667] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:17:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:17:20.376612 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eaa0fb-ccf5-4bab-89e5-88701a6bbc89 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:20.380259 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-97eaa0fb-ccf5-4bab-89e5-88701a6bbc89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:20.480603 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:20.490069 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eaa0fb-ccf5-4bab-89e5-88701a6bbc89 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:20.496323 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae20e23-622b-44ac-aa8c-83371a578a5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:20.497270 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae20e23-622b-44ac-aa8c-83371a578a5a service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:20.497677 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae20e23-622b-44ac-aa8c-83371a578a5a service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:20.498131 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae20e23-622b-44ac-aa8c-83371a578a5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:20.512571 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae20e23-622b-44ac-aa8c-83371a578a5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:20.515053 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae20e23-622b-44ac-aa8c-83371a578a5a service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:20.530091 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1327/2668] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:17:21.212844 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e180a-6144-4823-8061-a5d41def48e9 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:21.214812 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-c90e180a-6144-4823-8061-a5d41def48e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:21.232875 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e180a-6144-4823-8061-a5d41def48e9 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:21.242183 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d9ace-8997-4b68-bfc4-02b58784f100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:21.243312 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d9ace-8997-4b68-bfc4-02b58784f100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:21.244234 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d9ace-8997-4b68-bfc4-02b58784f100 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:21.244936 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d9ace-8997-4b68-bfc4-02b58784f100 admin admin] PATH_INFO: `/v3/projects/279ca72fc0764432ae8e9e36f33b04d7` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:21.247793 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d9ace-8997-4b68-bfc4-02b58784f100 admin admin] RBAC: Authorizing `identity:delete_project(project_id=279ca72fc0764432ae8e9e36f33b04d7)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:21.252241 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d9ace-8997-4b68-bfc4-02b58784f100 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:21.381631 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-298d9ace-8997-4b68-bfc4-02b58784f100 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '279ca72fc0764432ae8e9e36f33b04d7', 'request_id': 'req-298d9ace-8997-4b68-bfc4-02b58784f100'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:21.388672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-298d9ace-8997-4b68-bfc4-02b58784f100 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '279ca72fc0764432ae8e9e36f33b04d7', 'request_id': 'req-298d9ace-8997-4b68-bfc4-02b58784f100'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:21.491982 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-298d9ace-8997-4b68-bfc4-02b58784f100 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '279ca72fc0764432ae8e9e36f33b04d7', 'request_id': 'req-298d9ace-8997-4b68-bfc4-02b58784f100'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:21.513571 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-298d9ace-8997-4b68-bfc4-02b58784f100 admin admin] The token cache is being invalidate because project 279ca72fc0764432ae8e9e36f33b04d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:17:21.514151 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-298d9ace-8997-4b68-bfc4-02b58784f100 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:21.515299 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-298d9ace-8997-4b68-bfc4-02b58784f100 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:21.518075 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1342/2669] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:17:21 2022] DELETE /identity/v3/projects/279ca72fc0764432ae8e9e36f33b04d7 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:21.524474 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae20e23-622b-44ac-aa8c-83371a578a5a service neutron] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:21.535362 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae20e23-622b-44ac-aa8c-83371a578a5a service neutron] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:21.634606 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4aa49-4329-40c6-b8cd-bddc3e94ae24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:21.635310 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4aa49-4329-40c6-b8cd-bddc3e94ae24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:21.635584 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4aa49-4329-40c6-b8cd-bddc3e94ae24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:21.635956 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b4aa49-4329-40c6-b8cd-bddc3e94ae24 admin admin] PATH_INFO: `/v3/users/90543f40c1b24793baaded7d7e202631` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:21.637358 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4aa49-4329-40c6-b8cd-bddc3e94ae24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90543f40c1b24793baaded7d7e202631)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:21.639444 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b4aa49-4329-40c6-b8cd-bddc3e94ae24 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:21.899791 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-88b4aa49-4329-40c6-b8cd-bddc3e94ae24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90543f40c1b24793baaded7d7e202631'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:21.900510 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-88b4aa49-4329-40c6-b8cd-bddc3e94ae24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90543f40c1b24793baaded7d7e202631'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:21.909299 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-88b4aa49-4329-40c6-b8cd-bddc3e94ae24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90543f40c1b24793baaded7d7e202631'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:21.912185 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-88b4aa49-4329-40c6-b8cd-bddc3e94ae24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90543f40c1b24793baaded7d7e202631'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:22.064685 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-88b4aa49-4329-40c6-b8cd-bddc3e94ae24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90543f40c1b24793baaded7d7e202631'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:22.134671 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1328/2670] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:17:21 2022] DELETE /identity/v3/users/90543f40c1b24793baaded7d7e202631 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:17:22.222751 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d9ace-8997-4b68-bfc4-02b58784f100 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:22.226247 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-298d9ace-8997-4b68-bfc4-02b58784f100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:22.348644 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d9ace-8997-4b68-bfc4-02b58784f100 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:22.436611 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:22.465514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954e7a9-1ab7-4330-a8ff-f32850e21c66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:22.466829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954e7a9-1ab7-4330-a8ff-f32850e21c66 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:22.467711 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954e7a9-1ab7-4330-a8ff-f32850e21c66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:22.468383 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954e7a9-1ab7-4330-a8ff-f32850e21c66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:22.471695 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-d954e7a9-1ab7-4330-a8ff-f32850e21c66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:22.571847 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d954e7a9-1ab7-4330-a8ff-f32850e21c66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:22.574654 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d954e7a9-1ab7-4330-a8ff-f32850e21c66 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:22.594146 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1343/2671] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:22.964077 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4aa49-4329-40c6-b8cd-bddc3e94ae24 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:22.966241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-88b4aa49-4329-40c6-b8cd-bddc3e94ae24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:22.992615 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b4aa49-4329-40c6-b8cd-bddc3e94ae24 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:23.003378 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a095129-29e0-4fdf-9225-c0b72637b21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:23.008106 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a095129-29e0-4fdf-9225-c0b72637b21d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:23.008106 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a095129-29e0-4fdf-9225-c0b72637b21d admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:23.008106 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a095129-29e0-4fdf-9225-c0b72637b21d admin admin] PATH_INFO: `/v3/projects/effe84fe3aca41c3a32bd639d86bd700` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:23.008942 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a095129-29e0-4fdf-9225-c0b72637b21d admin admin] RBAC: Authorizing `identity:delete_project(project_id=effe84fe3aca41c3a32bd639d86bd700)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:23.011269 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a095129-29e0-4fdf-9225-c0b72637b21d admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:23.169262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-4a095129-29e0-4fdf-9225-c0b72637b21d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'effe84fe3aca41c3a32bd639d86bd700', 'request_id': 'req-4a095129-29e0-4fdf-9225-c0b72637b21d'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:23.178096 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-4a095129-29e0-4fdf-9225-c0b72637b21d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'effe84fe3aca41c3a32bd639d86bd700', 'request_id': 'req-4a095129-29e0-4fdf-9225-c0b72637b21d'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:23.190571 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-4a095129-29e0-4fdf-9225-c0b72637b21d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'effe84fe3aca41c3a32bd639d86bd700', 'request_id': 'req-4a095129-29e0-4fdf-9225-c0b72637b21d'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:23.196404 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:23.327952 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-4a095129-29e0-4fdf-9225-c0b72637b21d admin admin] The token cache is being invalidate because project effe84fe3aca41c3a32bd639d86bd700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:17:23.328358 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-4a095129-29e0-4fdf-9225-c0b72637b21d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:23.330100 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-4a095129-29e0-4fdf-9225-c0b72637b21d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:23.337818 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1329/2672] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:17:22 2022] DELETE /identity/v3/projects/effe84fe3aca41c3a32bd639d86bd700 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:17:23.341162 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8951a91-b481-4866-8881-277365b5fc8d None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:23.341162 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8951a91-b481-4866-8881-277365b5fc8d None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:23.341487 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8951a91-b481-4866-8881-277365b5fc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:23.374682 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-c8951a91-b481-4866-8881-277365b5fc8d None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:23.376637 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-c8951a91-b481-4866-8881-277365b5fc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:23.501090 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1344/2673] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:23.513682 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294b141-3a14-4fd3-807c-cc24f7c9377c None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:23.514149 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294b141-3a14-4fd3-807c-cc24f7c9377c None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:23.514766 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294b141-3a14-4fd3-807c-cc24f7c9377c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:23.554821 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-a294b141-3a14-4fd3-807c-cc24f7c9377c None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:23.557300 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-a294b141-3a14-4fd3-807c-cc24f7c9377c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:23.577134 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1330/2674] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:23.583636 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8951a91-b481-4866-8881-277365b5fc8d None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:23.636635 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8951a91-b481-4866-8881-277365b5fc8d None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:23.657241 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5884f4a1-b70d-4999-b48f-d45d86657067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:23.658255 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884f4a1-b70d-4999-b48f-d45d86657067 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:23.658815 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884f4a1-b70d-4999-b48f-d45d86657067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:23.659194 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5884f4a1-b70d-4999-b48f-d45d86657067 admin admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:23.670064 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884f4a1-b70d-4999-b48f-d45d86657067 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:17:23.670064 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884f4a1-b70d-4999-b48f-d45d86657067 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:23.670064 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5884f4a1-b70d-4999-b48f-d45d86657067 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:23.719000 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1345/2675] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:17:23.727692 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294b141-3a14-4fd3-807c-cc24f7c9377c None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:23.753713 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294b141-3a14-4fd3-807c-cc24f7c9377c None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:23.774346 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee2b34-6ef3-4a43-bab8-7c2271579696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:23.775754 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee2b34-6ef3-4a43-bab8-7c2271579696 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:23.777731 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee2b34-6ef3-4a43-bab8-7c2271579696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:23.778903 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee2b34-6ef3-4a43-bab8-7c2271579696 admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:23.780293 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee2b34-6ef3-4a43-bab8-7c2271579696 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:23.784595 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faee2b34-6ef3-4a43-bab8-7c2271579696 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:23.990435 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b331d-a778-4169-a5e1-794e42f009b0 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:23.991052 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b331d-a778-4169-a5e1-794e42f009b0 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:23.992022 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b331d-a778-4169-a5e1-794e42f009b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:24.045858 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1331/2676] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:17:23 2022] POST /identity/v3/projects => generated 385 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:24.049965 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee2b34-6ef3-4a43-bab8-7c2271579696 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:24.074694 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-f68b331d-a778-4169-a5e1-794e42f009b0 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:24.076907 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-f68b331d-a778-4169-a5e1-794e42f009b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:24.193093 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee2b34-6ef3-4a43-bab8-7c2271579696 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:24.198638 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59699625-6c03-4c91-a80c-52fd89067b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:24.199396 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59699625-6c03-4c91-a80c-52fd89067b94 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:24.199639 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59699625-6c03-4c91-a80c-52fd89067b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:24.199871 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59699625-6c03-4c91-a80c-52fd89067b94 admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:24.200512 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59699625-6c03-4c91-a80c-52fd89067b94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:24.202511 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59699625-6c03-4c91-a80c-52fd89067b94 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:24.214749 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1346/2677] 10.222.0.47 () {58 vars in 1016 bytes} [Wed Aug 24 17:17:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:24.234302 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b331d-a778-4169-a5e1-794e42f009b0 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:24.237338 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-f68b331d-a778-4169-a5e1-794e42f009b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:24.265418 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:24.330018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1332/2678] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:17:24 2022] POST /identity/v3/users => generated 293 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:24.332710 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59699625-6c03-4c91-a80c-52fd89067b94 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:24.366923 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59699625-6c03-4c91-a80c-52fd89067b94 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:24.373820 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b331d-a778-4169-a5e1-794e42f009b0 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:24.382437 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95021d-ebf5-4379-8c98-cbf64bc6a225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:24.383525 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95021d-ebf5-4379-8c98-cbf64bc6a225 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:24.384007 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95021d-ebf5-4379-8c98-cbf64bc6a225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:24.384494 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95021d-ebf5-4379-8c98-cbf64bc6a225 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:24.384766 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03645ed5-4d03-4dfc-9ab1-f7ca58a401c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:24.385526 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95021d-ebf5-4379-8c98-cbf64bc6a225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:24.386025 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03645ed5-4d03-4dfc-9ab1-f7ca58a401c2 service nova] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:24.386550 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03645ed5-4d03-4dfc-9ab1-f7ca58a401c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:24.387091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03645ed5-4d03-4dfc-9ab1-f7ca58a401c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:24.390857 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95021d-ebf5-4379-8c98-cbf64bc6a225 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:24.408180 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03645ed5-4d03-4dfc-9ab1-f7ca58a401c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:24.415412 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03645ed5-4d03-4dfc-9ab1-f7ca58a401c2 service nova] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:24.415819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1333/2679] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:17:24.420967 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95021d-ebf5-4379-8c98-cbf64bc6a225 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:24.433884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1347/2680] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:24.452932 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95021d-ebf5-4379-8c98-cbf64bc6a225 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:24.462458 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f26da5-a63b-45d7-b901-06aee4fe5275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:24.463615 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f26da5-a63b-45d7-b901-06aee4fe5275 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:24.464087 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f26da5-a63b-45d7-b901-06aee4fe5275 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:24.464548 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f26da5-a63b-45d7-b901-06aee4fe5275 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:24.465648 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f26da5-a63b-45d7-b901-06aee4fe5275 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:24.469388 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f26da5-a63b-45d7-b901-06aee4fe5275 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:24.493662 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1334/2681] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:17:24.500004 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03645ed5-4d03-4dfc-9ab1-f7ca58a401c2 service nova] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:24.531996 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03645ed5-4d03-4dfc-9ab1-f7ca58a401c2 service nova] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:24.542319 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec97d54-23e3-4fc4-9104-49bfcc7295c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:24.543007 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec97d54-23e3-4fc4-9104-49bfcc7295c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:24.543409 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec97d54-23e3-4fc4-9104-49bfcc7295c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:24.543698 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec97d54-23e3-4fc4-9104-49bfcc7295c0 admin admin] PATH_INFO: `/v3/projects/eb18d35ca72e46399d2e063afc5c0fcf/users/53b0f721d7b048aca0e03afd609a36f5/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:24.567008 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec97d54-23e3-4fc4-9104-49bfcc7295c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb18d35ca72e46399d2e063afc5c0fcf, user_id=53b0f721d7b048aca0e03afd609a36f5, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:24.570206 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec97d54-23e3-4fc4-9104-49bfcc7295c0 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:24.661862 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1348/2682] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:17:24 2022] PUT /identity/v3/projects/eb18d35ca72e46399d2e063afc5c0fcf/users/53b0f721d7b048aca0e03afd609a36f5/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:17:24.682827 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8f84d-a5cf-4e3a-8989-5e1f5be72642 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:24.683444 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8f84d-a5cf-4e3a-8989-5e1f5be72642 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:24.684075 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf8f84d-a5cf-4e3a-8989-5e1f5be72642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:24.724974 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-6cf8f84d-a5cf-4e3a-8989-5e1f5be72642 None None] MFA Rules not processed for user `53b0f721d7b048aca0e03afd609a36f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:24.726166 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-6cf8f84d-a5cf-4e3a-8989-5e1f5be72642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:24.815159 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1335/2683] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:17:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:17:24.830788 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec97d54-23e3-4fc4-9104-49bfcc7295c0 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:24.833114 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-eec97d54-23e3-4fc4-9104-49bfcc7295c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:24.922846 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec97d54-23e3-4fc4-9104-49bfcc7295c0 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:24.929880 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fdc03f-49dd-465f-a2a3-cc2e6e570570 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:24.931024 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdc03f-49dd-465f-a2a3-cc2e6e570570 service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:24.931621 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdc03f-49dd-465f-a2a3-cc2e6e570570 service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:24.932117 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdc03f-49dd-465f-a2a3-cc2e6e570570 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:24.950676 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fdc03f-49dd-465f-a2a3-cc2e6e570570 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:24.954060 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fdc03f-49dd-465f-a2a3-cc2e6e570570 service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:24.978241 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1349/2684] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:28.400814 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8f84d-a5cf-4e3a-8989-5e1f5be72642 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:28.402357 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-6cf8f84d-a5cf-4e3a-8989-5e1f5be72642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:28.431539 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:INSERT=5,keystone:DELETE=1,keystone:SELECT=94 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:28.461674 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f78cd7-a44e-4aa6-ab8b-7279ee0c5380 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:28.462271 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f78cd7-a44e-4aa6-ab8b-7279ee0c5380 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:28.462845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f78cd7-a44e-4aa6-ab8b-7279ee0c5380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:28.485132 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf8f84d-a5cf-4e3a-8989-5e1f5be72642 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:28.493292 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86606484-762d-4862-a35d-6ff13cf6a3a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:28.494333 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86606484-762d-4862-a35d-6ff13cf6a3a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:28.494832 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86606484-762d-4862-a35d-6ff13cf6a3a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:28.495432 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86606484-762d-4862-a35d-6ff13cf6a3a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:28.498407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-86606484-762d-4862-a35d-6ff13cf6a3a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:28.506244 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-b6f78cd7-a44e-4aa6-ab8b-7279ee0c5380 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:28.508836 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-b6f78cd7-a44e-4aa6-ab8b-7279ee0c5380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:28.585451 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1350/2685] 10.222.0.47 () {58 vars in 1016 bytes} [Wed Aug 24 17:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:28.585818 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86606484-762d-4862-a35d-6ff13cf6a3a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:28.586454 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f78cd7-a44e-4aa6-ab8b-7279ee0c5380 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:28.587127 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86606484-762d-4862-a35d-6ff13cf6a3a5 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:28.587837 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-b6f78cd7-a44e-4aa6-ab8b-7279ee0c5380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:28.598205 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1336/2686] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:17:28.611045 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:28.631308 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86606484-762d-4862-a35d-6ff13cf6a3a5 service neutron] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:28.633944 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-86606484-762d-4862-a35d-6ff13cf6a3a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:28.670996 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f78cd7-a44e-4aa6-ab8b-7279ee0c5380 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:28.676541 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acee95-fc08-41de-8761-58088bd83063 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ef97356edf406aad9ab5f502bdb0af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:28.677254 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acee95-fc08-41de-8761-58088bd83063 service placement] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:28.677680 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acee95-fc08-41de-8761-58088bd83063 service placement] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:28.678060 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13acee95-fc08-41de-8761-58088bd83063 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:28.679987 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-13acee95-fc08-41de-8761-58088bd83063 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:28.695568 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13acee95-fc08-41de-8761-58088bd83063 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:28.700703 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13acee95-fc08-41de-8761-58088bd83063 service placement] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:28.714072 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1351/2687] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:28.714995 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acee95-fc08-41de-8761-58088bd83063 service placement] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:28.716515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-13acee95-fc08-41de-8761-58088bd83063 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:28.741884 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86606484-762d-4862-a35d-6ff13cf6a3a5 service neutron] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:28.742281 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13acee95-fc08-41de-8761-58088bd83063 service placement] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:28.749357 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a691261-0d30-4395-875e-81fc27891279 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:28.750258 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a691261-0d30-4395-875e-81fc27891279 service nova] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:28.750639 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a691261-0d30-4395-875e-81fc27891279 service nova] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:28.750985 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a691261-0d30-4395-875e-81fc27891279 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:28.751560 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501dbd7-72cc-4ea8-ab1d-048b86699a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:28.752769 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501dbd7-72cc-4ea8-ab1d-048b86699a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:28.753276 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501dbd7-72cc-4ea8-ab1d-048b86699a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:28.753759 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501dbd7-72cc-4ea8-ab1d-048b86699a7b admin admin] PATH_INFO: `/v3/users/9d829f56be8a4000946c6ca93007937c` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:28.756997 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501dbd7-72cc-4ea8-ab1d-048b86699a7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d829f56be8a4000946c6ca93007937c)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:28.760985 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501dbd7-72cc-4ea8-ab1d-048b86699a7b admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:28.763576 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a691261-0d30-4395-875e-81fc27891279 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:28.765404 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a691261-0d30-4395-875e-81fc27891279 service nova] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:28.778979 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1337/2688] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:17:29.018423 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-e501dbd7-72cc-4ea8-ab1d-048b86699a7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d829f56be8a4000946c6ca93007937c'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:29.027515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-e501dbd7-72cc-4ea8-ab1d-048b86699a7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d829f56be8a4000946c6ca93007937c'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:29.103639 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-e501dbd7-72cc-4ea8-ab1d-048b86699a7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d829f56be8a4000946c6ca93007937c'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:29.104406 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-e501dbd7-72cc-4ea8-ab1d-048b86699a7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d829f56be8a4000946c6ca93007937c'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:29.105098 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-e501dbd7-72cc-4ea8-ab1d-048b86699a7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d829f56be8a4000946c6ca93007937c'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:29.127308 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1352/2689] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:17:28 2022] DELETE /identity/v3/users/9d829f56be8a4000946c6ca93007937c => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:29.617540 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a691261-0d30-4395-875e-81fc27891279 service nova] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:29.653749 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a691261-0d30-4395-875e-81fc27891279 service nova] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:29.738614 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=100 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:29.747689 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40781c5-5a4c-4deb-a726-808b42404654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:29.748458 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40781c5-5a4c-4deb-a726-808b42404654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:29.748879 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40781c5-5a4c-4deb-a726-808b42404654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:29.749231 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40781c5-5a4c-4deb-a726-808b42404654 admin admin] PATH_INFO: `/v3/projects/e170dd65d39649de9b6bdd5d367091be` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:29.750861 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40781c5-5a4c-4deb-a726-808b42404654 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e170dd65d39649de9b6bdd5d367091be)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:29.754460 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40781c5-5a4c-4deb-a726-808b42404654 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:29.934474 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-e40781c5-5a4c-4deb-a726-808b42404654 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e170dd65d39649de9b6bdd5d367091be', 'request_id': 'req-e40781c5-5a4c-4deb-a726-808b42404654'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:29.942981 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-e40781c5-5a4c-4deb-a726-808b42404654 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e170dd65d39649de9b6bdd5d367091be', 'request_id': 'req-e40781c5-5a4c-4deb-a726-808b42404654'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:29.953443 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-e40781c5-5a4c-4deb-a726-808b42404654 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e170dd65d39649de9b6bdd5d367091be', 'request_id': 'req-e40781c5-5a4c-4deb-a726-808b42404654'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:30.074206 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-e40781c5-5a4c-4deb-a726-808b42404654 admin admin] The token cache is being invalidate because project e170dd65d39649de9b6bdd5d367091be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:17:30.074206 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-e40781c5-5a4c-4deb-a726-808b42404654 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:30.075714 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-e40781c5-5a4c-4deb-a726-808b42404654 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:30.081651 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1338/2690] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:17:29 2022] DELETE /identity/v3/projects/e170dd65d39649de9b6bdd5d367091be => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:17:30.086971 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa0063-0dbe-4004-8ad9-1b2e4436a016 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:30.087621 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa0063-0dbe-4004-8ad9-1b2e4436a016 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:30.088206 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fa0063-0dbe-4004-8ad9-1b2e4436a016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:30.141726 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-c5fa0063-0dbe-4004-8ad9-1b2e4436a016 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:30.148958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-c5fa0063-0dbe-4004-8ad9-1b2e4436a016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:30.246396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1353/2691] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:17:30.256940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf15f2-298f-425e-a586-808bc38d6472 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:30.257222 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf15f2-298f-425e-a586-808bc38d6472 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:30.257801 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bf15f2-298f-425e-a586-808bc38d6472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:30.281804 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-66bf15f2-298f-425e-a586-808bc38d6472 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:30.285845 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-66bf15f2-298f-425e-a586-808bc38d6472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:30.299907 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1339/2692] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:30.303703 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa0063-0dbe-4004-8ad9-1b2e4436a016 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:30.314431 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fa0063-0dbe-4004-8ad9-1b2e4436a016 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:30.320967 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86daa3e4-aad0-4373-8c52-aeb70a708688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:30.321602 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86daa3e4-aad0-4373-8c52-aeb70a708688 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:30.321879 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86daa3e4-aad0-4373-8c52-aeb70a708688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:30.322156 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86daa3e4-aad0-4373-8c52-aeb70a708688 admin admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:30.322877 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86daa3e4-aad0-4373-8c52-aeb70a708688 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:17:30.323236 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86daa3e4-aad0-4373-8c52-aeb70a708688 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:30.325058 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86daa3e4-aad0-4373-8c52-aeb70a708688 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:30.346321 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1354/2693] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 17:17:30.350650 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf15f2-298f-425e-a586-808bc38d6472 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:30.365762 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bf15f2-298f-425e-a586-808bc38d6472 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:30.372553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984e238-c8de-40f3-96c3-fd99a3799e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:30.373755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984e238-c8de-40f3-96c3-fd99a3799e4b admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:30.373755 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984e238-c8de-40f3-96c3-fd99a3799e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:30.374175 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a984e238-c8de-40f3-96c3-fd99a3799e4b admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:30.375065 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a984e238-c8de-40f3-96c3-fd99a3799e4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:30.377344 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a984e238-c8de-40f3-96c3-fd99a3799e4b admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:30.509130 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86daa3e4-aad0-4373-8c52-aeb70a708688 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:30.516685 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1340/2694] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:17:30 2022] POST /identity/v3/projects => generated 375 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:30.522568 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86daa3e4-aad0-4373-8c52-aeb70a708688 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:30.531360 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:30.689005 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec7f43-c660-4f71-83d6-9c5ea45cd285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:30.689005 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec7f43-c660-4f71-83d6-9c5ea45cd285 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:30.689005 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec7f43-c660-4f71-83d6-9c5ea45cd285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:30.689005 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec7f43-c660-4f71-83d6-9c5ea45cd285 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:30.689933 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec7f43-c660-4f71-83d6-9c5ea45cd285 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:30.694907 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec7f43-c660-4f71-83d6-9c5ea45cd285 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:30.805956 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1355/2695] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:17:30 2022] POST /identity/v3/users => generated 288 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:30.807391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984e238-c8de-40f3-96c3-fd99a3799e4b admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:30.819260 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a984e238-c8de-40f3-96c3-fd99a3799e4b admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:30.827061 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caad0cf-27a4-4fc5-8d57-51b67d0e6481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:30.828008 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caad0cf-27a4-4fc5-8d57-51b67d0e6481 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:30.828487 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caad0cf-27a4-4fc5-8d57-51b67d0e6481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:30.828912 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caad0cf-27a4-4fc5-8d57-51b67d0e6481 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:30.829820 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caad0cf-27a4-4fc5-8d57-51b67d0e6481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:30.832001 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caad0cf-27a4-4fc5-8d57-51b67d0e6481 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:30.846660 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1341/2696] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:17:30.848019 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec7f43-c660-4f71-83d6-9c5ea45cd285 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:30.861851 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec7f43-c660-4f71-83d6-9c5ea45cd285 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:30.876184 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3a3ec-e329-42a3-88a2-abff06bd5ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:30.878047 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3a3ec-e329-42a3-88a2-abff06bd5ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:30.879759 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3a3ec-e329-42a3-88a2-abff06bd5ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:30.880255 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3a3ec-e329-42a3-88a2-abff06bd5ce4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:30.881534 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3a3ec-e329-42a3-88a2-abff06bd5ce4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:30.883228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3a3ec-e329-42a3-88a2-abff06bd5ce4 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:30.901361 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1356/2697] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:30 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:17:30.907007 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caad0cf-27a4-4fc5-8d57-51b67d0e6481 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:30.919180 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caad0cf-27a4-4fc5-8d57-51b67d0e6481 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:30.927180 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edf0fb-6de9-4767-b828-8666dbd8aee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:30.927180 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edf0fb-6de9-4767-b828-8666dbd8aee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:30.928093 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edf0fb-6de9-4767-b828-8666dbd8aee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:30.928225 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4edf0fb-6de9-4767-b828-8666dbd8aee4 admin admin] PATH_INFO: `/v3/projects/469c96ececba46669cc249d7a2dc442a/users/adf3e223aab14e06983667ef5493eb16/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:30.949268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4edf0fb-6de9-4767-b828-8666dbd8aee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=469c96ececba46669cc249d7a2dc442a, user_id=adf3e223aab14e06983667ef5493eb16, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:30.952987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4edf0fb-6de9-4767-b828-8666dbd8aee4 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:31.140314 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1342/2698] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:17:30 2022] PUT /identity/v3/projects/469c96ececba46669cc249d7a2dc442a/users/adf3e223aab14e06983667ef5493eb16/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:17:31.147902 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bf6e8-b0da-4365-972e-f52dd65cde54 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:31.147902 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bf6e8-b0da-4365-972e-f52dd65cde54 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:31.147902 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087bf6e8-b0da-4365-972e-f52dd65cde54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:31.176804 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-087bf6e8-b0da-4365-972e-f52dd65cde54 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:31.179672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-087bf6e8-b0da-4365-972e-f52dd65cde54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:31.263205 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1357/2699] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:17:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:31.276509 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edf0fb-6de9-4767-b828-8666dbd8aee4 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:31.282790 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-d4edf0fb-6de9-4767-b828-8666dbd8aee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:31.352893 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4edf0fb-6de9-4767-b828-8666dbd8aee4 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:31.356711 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7fe05-0556-43b0-8a47-d793937f0708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:31.357397 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7fe05-0556-43b0-8a47-d793937f0708 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:31.357745 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7fe05-0556-43b0-8a47-d793937f0708 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:31.358156 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7fe05-0556-43b0-8a47-d793937f0708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:31.372892 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7fe05-0556-43b0-8a47-d793937f0708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:31.374397 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7fe05-0556-43b0-8a47-d793937f0708 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:31.387590 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1343/2700] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:32.022275 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3fae0-25b0-4679-b0bc-6adb8a0f9a2c None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:32.023356 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3fae0-25b0-4679-b0bc-6adb8a0f9a2c None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:32.027589 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3fae0-25b0-4679-b0bc-6adb8a0f9a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:32.051599 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-87b3fae0-25b0-4679-b0bc-6adb8a0f9a2c None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:32.054000 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-87b3fae0-25b0-4679-b0bc-6adb8a0f9a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:32.064292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1358/2701] 10.222.0.47 () {58 vars in 1016 bytes} [Wed Aug 24 17:17:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:32.083531 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7fe05-0556-43b0-8a47-d793937f0708 service neutron] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:32.088982 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-49f7fe05-0556-43b0-8a47-d793937f0708 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:32.134130 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:32.232624 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7fe05-0556-43b0-8a47-d793937f0708 service neutron] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:32.238999 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a34d62-fd38-4d18-afba-6cc4ba631c7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:32.240073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a34d62-fd38-4d18-afba-6cc4ba631c7f service nova] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:32.240786 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a34d62-fd38-4d18-afba-6cc4ba631c7f service nova] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:32.240962 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a34d62-fd38-4d18-afba-6cc4ba631c7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:32.252834 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a34d62-fd38-4d18-afba-6cc4ba631c7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:32.255196 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a34d62-fd38-4d18-afba-6cc4ba631c7f service nova] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:32.273764 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1344/2702] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:33.477765 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3fae0-25b0-4679-b0bc-6adb8a0f9a2c None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:33.479344 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-87b3fae0-25b0-4679-b0bc-6adb8a0f9a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:33.492916 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3fae0-25b0-4679-b0bc-6adb8a0f9a2c None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:33.498276 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b521dc-5349-4f5e-a80a-89b6da3a1dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:33.499334 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b521dc-5349-4f5e-a80a-89b6da3a1dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:33.499818 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b521dc-5349-4f5e-a80a-89b6da3a1dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:33.500288 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b521dc-5349-4f5e-a80a-89b6da3a1dec admin admin] PATH_INFO: `/v3/users/53b0f721d7b048aca0e03afd609a36f5` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:33.501785 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b521dc-5349-4f5e-a80a-89b6da3a1dec admin admin] RBAC: Authorizing `identity:delete_user(user_id=53b0f721d7b048aca0e03afd609a36f5)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:33.504304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b521dc-5349-4f5e-a80a-89b6da3a1dec admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:33.747386 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-58b521dc-5349-4f5e-a80a-89b6da3a1dec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53b0f721d7b048aca0e03afd609a36f5'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:33.755929 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-58b521dc-5349-4f5e-a80a-89b6da3a1dec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53b0f721d7b048aca0e03afd609a36f5'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:33.852554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-58b521dc-5349-4f5e-a80a-89b6da3a1dec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53b0f721d7b048aca0e03afd609a36f5'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:33.853584 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-58b521dc-5349-4f5e-a80a-89b6da3a1dec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53b0f721d7b048aca0e03afd609a36f5'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:33.859600 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-58b521dc-5349-4f5e-a80a-89b6da3a1dec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53b0f721d7b048aca0e03afd609a36f5'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:33.876326 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:33.890643 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1359/2703] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:17:33 2022] DELETE /identity/v3/users/53b0f721d7b048aca0e03afd609a36f5 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:33.894206 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106b23f-d2fb-435e-ac0d-bbd5bd768b56 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:33.895039 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106b23f-d2fb-435e-ac0d-bbd5bd768b56 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:33.895039 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2106b23f-d2fb-435e-ac0d-bbd5bd768b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:33.923942 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-2106b23f-d2fb-435e-ac0d-bbd5bd768b56 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:33.925211 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-2106b23f-d2fb-435e-ac0d-bbd5bd768b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:34.163350 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1345/2704] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:34.169277 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b521dc-5349-4f5e-a80a-89b6da3a1dec admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:34.171437 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-58b521dc-5349-4f5e-a80a-89b6da3a1dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:34.280334 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b521dc-5349-4f5e-a80a-89b6da3a1dec admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:34.285107 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff5532f-235a-4b55-89e3-5e6ea1bacdc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:34.285752 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5532f-235a-4b55-89e3-5e6ea1bacdc5 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:34.286267 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5532f-235a-4b55-89e3-5e6ea1bacdc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:34.286447 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff5532f-235a-4b55-89e3-5e6ea1bacdc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:34.299562 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5532f-235a-4b55-89e3-5e6ea1bacdc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:34.301165 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff5532f-235a-4b55-89e3-5e6ea1bacdc5 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:34.314455 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1360/2705] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:35.040989 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106b23f-d2fb-435e-ac0d-bbd5bd768b56 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:35.043402 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-2106b23f-d2fb-435e-ac0d-bbd5bd768b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:35.078230 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2106b23f-d2fb-435e-ac0d-bbd5bd768b56 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:35.086103 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528223f-da8c-4cc6-99e9-1b1c43d4299f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:35.087193 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528223f-da8c-4cc6-99e9-1b1c43d4299f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:35.087717 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528223f-da8c-4cc6-99e9-1b1c43d4299f admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:35.088300 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528223f-da8c-4cc6-99e9-1b1c43d4299f admin admin] PATH_INFO: `/v3/projects/eb18d35ca72e46399d2e063afc5c0fcf` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:35.090408 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528223f-da8c-4cc6-99e9-1b1c43d4299f admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb18d35ca72e46399d2e063afc5c0fcf)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:35.092854 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528223f-da8c-4cc6-99e9-1b1c43d4299f admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:35.258051 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-8528223f-da8c-4cc6-99e9-1b1c43d4299f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb18d35ca72e46399d2e063afc5c0fcf', 'request_id': 'req-8528223f-da8c-4cc6-99e9-1b1c43d4299f'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:35.267242 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-8528223f-da8c-4cc6-99e9-1b1c43d4299f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb18d35ca72e46399d2e063afc5c0fcf', 'request_id': 'req-8528223f-da8c-4cc6-99e9-1b1c43d4299f'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:35.276419 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-8528223f-da8c-4cc6-99e9-1b1c43d4299f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb18d35ca72e46399d2e063afc5c0fcf', 'request_id': 'req-8528223f-da8c-4cc6-99e9-1b1c43d4299f'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:35.385211 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-8528223f-da8c-4cc6-99e9-1b1c43d4299f admin admin] The token cache is being invalidate because project eb18d35ca72e46399d2e063afc5c0fcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:17:35.385211 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-8528223f-da8c-4cc6-99e9-1b1c43d4299f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:35.385211 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-8528223f-da8c-4cc6-99e9-1b1c43d4299f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:35.386734 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1346/2706] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:17:35 2022] DELETE /identity/v3/projects/eb18d35ca72e46399d2e063afc5c0fcf => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:35.393137 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79059001-9e21-4c52-99a3-737b1aa713b2 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:35.393702 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79059001-9e21-4c52-99a3-737b1aa713b2 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:35.393702 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79059001-9e21-4c52-99a3-737b1aa713b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:35.420864 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-79059001-9e21-4c52-99a3-737b1aa713b2 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:35.424345 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-79059001-9e21-4c52-99a3-737b1aa713b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:35.535007 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1361/2707] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:35.544674 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d3a06-6592-437e-b7fa-659a76f74731 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:35.544951 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d3a06-6592-437e-b7fa-659a76f74731 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:35.545224 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0d3a06-6592-437e-b7fa-659a76f74731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:35.574440 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-fb0d3a06-6592-437e-b7fa-659a76f74731 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:35.576136 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-fb0d3a06-6592-437e-b7fa-659a76f74731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:35.594065 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1347/2708] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:35.603320 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79059001-9e21-4c52-99a3-737b1aa713b2 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:35.626298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79059001-9e21-4c52-99a3-737b1aa713b2 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:35.634673 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3db78e-3da8-46a4-99ec-fc42cdee2411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:35.637959 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3db78e-3da8-46a4-99ec-fc42cdee2411 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:35.639095 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3db78e-3da8-46a4-99ec-fc42cdee2411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:35.639939 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3db78e-3da8-46a4-99ec-fc42cdee2411 admin admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:35.641640 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3db78e-3da8-46a4-99ec-fc42cdee2411 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:17:35.642217 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3db78e-3da8-46a4-99ec-fc42cdee2411 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:35.646482 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3db78e-3da8-46a4-99ec-fc42cdee2411 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:35.694745 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d3a06-6592-437e-b7fa-659a76f74731 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:35.707056 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1362/2709] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:17:35.718982 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0d3a06-6592-437e-b7fa-659a76f74731 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:35.731392 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a38abb-9126-4368-a351-0f8eda56c4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:35.732723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a38abb-9126-4368-a351-0f8eda56c4a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:35.733245 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a38abb-9126-4368-a351-0f8eda56c4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:35.734188 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a38abb-9126-4368-a351-0f8eda56c4a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:35.735598 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a38abb-9126-4368-a351-0f8eda56c4a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:35.742574 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a38abb-9126-4368-a351-0f8eda56c4a6 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:35.980016 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1348/2710] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:17:35 2022] POST /identity/v3/projects => generated 361 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:35.984195 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3db78e-3da8-46a4-99ec-fc42cdee2411 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:36.007104 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3db78e-3da8-46a4-99ec-fc42cdee2411 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:36.178088 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a7924-1ee0-453e-96c4-a7ef9cd32a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:36.178705 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a7924-1ee0-453e-96c4-a7ef9cd32a96 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:36.179102 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a7924-1ee0-453e-96c4-a7ef9cd32a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:36.179492 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a7924-1ee0-453e-96c4-a7ef9cd32a96 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:36.180330 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a7924-1ee0-453e-96c4-a7ef9cd32a96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:36.182474 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98a7924-1ee0-453e-96c4-a7ef9cd32a96 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:36.310587 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1363/2711] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:17:35 2022] POST /identity/v3/users => generated 281 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:17:36.315654 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a38abb-9126-4368-a351-0f8eda56c4a6 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:36.333290 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:36.343641 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a38abb-9126-4368-a351-0f8eda56c4a6 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:36.356953 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397e269-b09e-4e07-8164-5c426e3a271c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:36.357514 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397e269-b09e-4e07-8164-5c426e3a271c admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:36.357958 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397e269-b09e-4e07-8164-5c426e3a271c admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:36.358232 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397e269-b09e-4e07-8164-5c426e3a271c admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:36.358897 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397e269-b09e-4e07-8164-5c426e3a271c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:36.361160 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397e269-b09e-4e07-8164-5c426e3a271c admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:36.381752 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1349/2712] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:17:36.385932 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a7924-1ee0-453e-96c4-a7ef9cd32a96 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:36.400516 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a7924-1ee0-453e-96c4-a7ef9cd32a96 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:36.410252 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c9240-98f2-4fe0-a876-b97a5237452e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:36.411287 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c9240-98f2-4fe0-a876-b97a5237452e admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:36.415153 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c9240-98f2-4fe0-a876-b97a5237452e admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:36.415153 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c9240-98f2-4fe0-a876-b97a5237452e admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:36.415153 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c9240-98f2-4fe0-a876-b97a5237452e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:36.415604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c9240-98f2-4fe0-a876-b97a5237452e admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:36.432719 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1364/2713] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:17:36.434068 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397e269-b09e-4e07-8164-5c426e3a271c admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:36.449021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397e269-b09e-4e07-8164-5c426e3a271c admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:36.454981 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e23096-f413-4082-9f4c-19d1f1adc2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:36.455893 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e23096-f413-4082-9f4c-19d1f1adc2f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:36.456175 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e23096-f413-4082-9f4c-19d1f1adc2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:36.457061 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e23096-f413-4082-9f4c-19d1f1adc2f6 admin admin] PATH_INFO: `/v3/projects/1d1292a7e8eb4b26936e7cbdfc150400/users/88924fca667444e3b6e398ce2a184d89/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:36.479389 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e23096-f413-4082-9f4c-19d1f1adc2f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d1292a7e8eb4b26936e7cbdfc150400, user_id=88924fca667444e3b6e398ce2a184d89, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:36.482673 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e23096-f413-4082-9f4c-19d1f1adc2f6 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:36.604974 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1350/2714] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:17:36 2022] PUT /identity/v3/projects/1d1292a7e8eb4b26936e7cbdfc150400/users/88924fca667444e3b6e398ce2a184d89/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:36.622108 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed013716-96e3-4f7f-a515-ecc3f863ada0 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:36.623011 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed013716-96e3-4f7f-a515-ecc3f863ada0 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:36.623575 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed013716-96e3-4f7f-a515-ecc3f863ada0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:36.635465 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:36.675828 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-ed013716-96e3-4f7f-a515-ecc3f863ada0 None None] MFA Rules not processed for user `88924fca667444e3b6e398ce2a184d89`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:36.678350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-ed013716-96e3-4f7f-a515-ecc3f863ada0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:36.787817 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1365/2715] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:17:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:36.856180 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e23096-f413-4082-9f4c-19d1f1adc2f6 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:36.860740 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-c2e23096-f413-4082-9f4c-19d1f1adc2f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:36.948223 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e23096-f413-4082-9f4c-19d1f1adc2f6 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:36.952146 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df40ae25-6435-4c7e-94a2-1954bdb3658c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:36.952875 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40ae25-6435-4c7e-94a2-1954bdb3658c service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:36.953244 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40ae25-6435-4c7e-94a2-1954bdb3658c service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:36.953757 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df40ae25-6435-4c7e-94a2-1954bdb3658c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:36.963364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40ae25-6435-4c7e-94a2-1954bdb3658c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:36.964905 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df40ae25-6435-4c7e-94a2-1954bdb3658c service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:36.974067 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1351/2716] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:17:36.990560 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed013716-96e3-4f7f-a515-ecc3f863ada0 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:37.087204 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed013716-96e3-4f7f-a515-ecc3f863ada0 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:37.093145 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217ff38-fa69-497d-ae1f-ef170434e2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:37.094178 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217ff38-fa69-497d-ae1f-ef170434e2ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:37.094466 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217ff38-fa69-497d-ae1f-ef170434e2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:37.094780 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f217ff38-fa69-497d-ae1f-ef170434e2ed admin admin] PATH_INFO: `/v3/users/88924fca667444e3b6e398ce2a184d89` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:37.096415 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217ff38-fa69-497d-ae1f-ef170434e2ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=88924fca667444e3b6e398ce2a184d89)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:37.100165 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f217ff38-fa69-497d-ae1f-ef170434e2ed admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:37.483442 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-f217ff38-fa69-497d-ae1f-ef170434e2ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88924fca667444e3b6e398ce2a184d89'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:37.499217 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-f217ff38-fa69-497d-ae1f-ef170434e2ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88924fca667444e3b6e398ce2a184d89'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:37.582691 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-f217ff38-fa69-497d-ae1f-ef170434e2ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88924fca667444e3b6e398ce2a184d89'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:37.583405 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-f217ff38-fa69-497d-ae1f-ef170434e2ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88924fca667444e3b6e398ce2a184d89'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:37.583909 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-f217ff38-fa69-497d-ae1f-ef170434e2ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88924fca667444e3b6e398ce2a184d89'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:37.630810 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1366/2717] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:17:36 2022] DELETE /identity/v3/users/88924fca667444e3b6e398ce2a184d89 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:37.633177 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d34c8-80aa-4341-a717-34954ec4335a None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:37.633702 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d34c8-80aa-4341-a717-34954ec4335a None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:37.634471 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d34c8-80aa-4341-a717-34954ec4335a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:37.703808 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-081d34c8-80aa-4341-a717-34954ec4335a None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:37.709616 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-081d34c8-80aa-4341-a717-34954ec4335a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:37.811093 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1352/2718] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:37.821773 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217ff38-fa69-497d-ae1f-ef170434e2ed admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:37.824017 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-f217ff38-fa69-497d-ae1f-ef170434e2ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:37.990661 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f217ff38-fa69-497d-ae1f-ef170434e2ed admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:37.996680 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685480b-ca5d-4e75-8efe-db3597187120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:37.997322 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685480b-ca5d-4e75-8efe-db3597187120 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:37.997896 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685480b-ca5d-4e75-8efe-db3597187120 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:37.997896 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685480b-ca5d-4e75-8efe-db3597187120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:38.022838 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685480b-ca5d-4e75-8efe-db3597187120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:38.023840 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d685480b-ca5d-4e75-8efe-db3597187120 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:38.044379 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1367/2719] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:17:38.191420 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:38.902370 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d34c8-80aa-4341-a717-34954ec4335a None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:38.905365 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-081d34c8-80aa-4341-a717-34954ec4335a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:38.949751 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d34c8-80aa-4341-a717-34954ec4335a None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:38.966923 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775822fd-0ada-414b-97c5-28a42a52b29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:38.968151 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775822fd-0ada-414b-97c5-28a42a52b29b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:38.969698 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775822fd-0ada-414b-97c5-28a42a52b29b admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:38.970539 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775822fd-0ada-414b-97c5-28a42a52b29b admin admin] PATH_INFO: `/v3/projects/1d1292a7e8eb4b26936e7cbdfc150400` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:38.975369 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775822fd-0ada-414b-97c5-28a42a52b29b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d1292a7e8eb4b26936e7cbdfc150400)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:38.992914 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775822fd-0ada-414b-97c5-28a42a52b29b admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:39.193276 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-775822fd-0ada-414b-97c5-28a42a52b29b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d1292a7e8eb4b26936e7cbdfc150400', 'request_id': 'req-775822fd-0ada-414b-97c5-28a42a52b29b'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:39.201744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-775822fd-0ada-414b-97c5-28a42a52b29b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d1292a7e8eb4b26936e7cbdfc150400', 'request_id': 'req-775822fd-0ada-414b-97c5-28a42a52b29b'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:39.231288 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-775822fd-0ada-414b-97c5-28a42a52b29b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d1292a7e8eb4b26936e7cbdfc150400', 'request_id': 'req-775822fd-0ada-414b-97c5-28a42a52b29b'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:39.244262 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:39.355541 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-775822fd-0ada-414b-97c5-28a42a52b29b admin admin] The token cache is being invalidate because project 1d1292a7e8eb4b26936e7cbdfc150400 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:17:39.356031 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-775822fd-0ada-414b-97c5-28a42a52b29b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:39.356809 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-775822fd-0ada-414b-97c5-28a42a52b29b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:39.358618 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1353/2720] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:17:38 2022] DELETE /identity/v3/projects/1d1292a7e8eb4b26936e7cbdfc150400 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:17:40.919909 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27509fd7-6822-4b37-883b-c0735dc5a1ca None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:40.920394 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27509fd7-6822-4b37-883b-c0735dc5a1ca None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:40.920541 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27509fd7-6822-4b37-883b-c0735dc5a1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:40.955778 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-27509fd7-6822-4b37-883b-c0735dc5a1ca None None] MFA Rules not processed for user `adf3e223aab14e06983667ef5493eb16`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:40.957021 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-27509fd7-6822-4b37-883b-c0735dc5a1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:41.031287 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775822fd-0ada-414b-97c5-28a42a52b29b admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:41.033272 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-775822fd-0ada-414b-97c5-28a42a52b29b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:41.059660 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1368/2721] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:17:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:41.076806 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27509fd7-6822-4b37-883b-c0735dc5a1ca None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:41.078175 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-27509fd7-6822-4b37-883b-c0735dc5a1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:41.129429 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775822fd-0ada-414b-97c5-28a42a52b29b admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:41.134998 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021cdc91-8e64-49db-a523-9a3efe2e9c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:41.135771 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cdc91-8e64-49db-a523-9a3efe2e9c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:41.136053 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cdc91-8e64-49db-a523-9a3efe2e9c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:41.136328 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021cdc91-8e64-49db-a523-9a3efe2e9c46 admin admin] PATH_INFO: `/v3/users/190cccbe419249338c60fdec264f2bd0` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:41.137771 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021cdc91-8e64-49db-a523-9a3efe2e9c46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=190cccbe419249338c60fdec264f2bd0)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:41.139843 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021cdc91-8e64-49db-a523-9a3efe2e9c46 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:41.173291 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27509fd7-6822-4b37-883b-c0735dc5a1ca None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:41.182202 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d235d-1b54-4f10-a41f-177ef8d69331 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:41.183068 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d235d-1b54-4f10-a41f-177ef8d69331 service nova] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:41.183502 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d235d-1b54-4f10-a41f-177ef8d69331 service nova] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:41.188758 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3d235d-1b54-4f10-a41f-177ef8d69331 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:41.193947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d235d-1b54-4f10-a41f-177ef8d69331 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:41.195931 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3d235d-1b54-4f10-a41f-177ef8d69331 service nova] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:41.206467 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1369/2722] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:17:41.379843 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-021cdc91-8e64-49db-a523-9a3efe2e9c46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '190cccbe419249338c60fdec264f2bd0'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:41.381114 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-021cdc91-8e64-49db-a523-9a3efe2e9c46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '190cccbe419249338c60fdec264f2bd0'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:41.397627 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-021cdc91-8e64-49db-a523-9a3efe2e9c46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '190cccbe419249338c60fdec264f2bd0'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:41.398878 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-021cdc91-8e64-49db-a523-9a3efe2e9c46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '190cccbe419249338c60fdec264f2bd0'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:41.498585 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-021cdc91-8e64-49db-a523-9a3efe2e9c46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '190cccbe419249338c60fdec264f2bd0'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:41.542423 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1354/2723] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:17:41 2022] DELETE /identity/v3/users/190cccbe419249338c60fdec264f2bd0 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:17:41.955512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d235d-1b54-4f10-a41f-177ef8d69331 service nova] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:41.976425 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3d235d-1b54-4f10-a41f-177ef8d69331 service nova] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:42.043258 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=100 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:42.119450 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47741ef1-69ed-437e-bdb8-ac6734adffa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:42.120214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47741ef1-69ed-437e-bdb8-ac6734adffa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:42.120511 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47741ef1-69ed-437e-bdb8-ac6734adffa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:42.120949 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47741ef1-69ed-437e-bdb8-ac6734adffa2 admin admin] PATH_INFO: `/v3/projects/0ba64a90f44c4ec08bb88e418b4f2572` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:42.124054 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47741ef1-69ed-437e-bdb8-ac6734adffa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ba64a90f44c4ec08bb88e418b4f2572)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:42.126163 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47741ef1-69ed-437e-bdb8-ac6734adffa2 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:42.303380 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-47741ef1-69ed-437e-bdb8-ac6734adffa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ba64a90f44c4ec08bb88e418b4f2572', 'request_id': 'req-47741ef1-69ed-437e-bdb8-ac6734adffa2'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:42.314999 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-47741ef1-69ed-437e-bdb8-ac6734adffa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ba64a90f44c4ec08bb88e418b4f2572', 'request_id': 'req-47741ef1-69ed-437e-bdb8-ac6734adffa2'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:42.382982 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-47741ef1-69ed-437e-bdb8-ac6734adffa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ba64a90f44c4ec08bb88e418b4f2572', 'request_id': 'req-47741ef1-69ed-437e-bdb8-ac6734adffa2'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:42.397671 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-47741ef1-69ed-437e-bdb8-ac6734adffa2 admin admin] The token cache is being invalidate because project 0ba64a90f44c4ec08bb88e418b4f2572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:17:42.397919 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-47741ef1-69ed-437e-bdb8-ac6734adffa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:42.398649 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-47741ef1-69ed-437e-bdb8-ac6734adffa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:42.400304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1370/2724] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:17:41 2022] DELETE /identity/v3/projects/0ba64a90f44c4ec08bb88e418b4f2572 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:17:42.404727 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021cdc91-8e64-49db-a523-9a3efe2e9c46 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:42.406199 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-021cdc91-8e64-49db-a523-9a3efe2e9c46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:42.421554 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021cdc91-8e64-49db-a523-9a3efe2e9c46 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:42.519907 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf961008-9b37-4944-84c3-147ced6be634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:42.521200 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf961008-9b37-4944-84c3-147ced6be634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:42.521704 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf961008-9b37-4944-84c3-147ced6be634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:42.522199 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf961008-9b37-4944-84c3-147ced6be634 admin admin] PATH_INFO: `/v3/users/7c4e022b582942cea096bb8f6062ce80` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:42.524991 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf961008-9b37-4944-84c3-147ced6be634 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c4e022b582942cea096bb8f6062ce80)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:42.528853 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf961008-9b37-4944-84c3-147ced6be634 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:42.570302 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:42.749683 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-cf961008-9b37-4944-84c3-147ced6be634 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c4e022b582942cea096bb8f6062ce80'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:42.750720 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-cf961008-9b37-4944-84c3-147ced6be634 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c4e022b582942cea096bb8f6062ce80'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:42.761173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-cf961008-9b37-4944-84c3-147ced6be634 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c4e022b582942cea096bb8f6062ce80'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:42.762040 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-cf961008-9b37-4944-84c3-147ced6be634 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c4e022b582942cea096bb8f6062ce80'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:42.835102 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-cf961008-9b37-4944-84c3-147ced6be634 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c4e022b582942cea096bb8f6062ce80'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:42.859860 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1355/2725] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:17:42 2022] DELETE /identity/v3/users/7c4e022b582942cea096bb8f6062ce80 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:43.189057 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47741ef1-69ed-437e-bdb8-ac6734adffa2 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:43.190748 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-47741ef1-69ed-437e-bdb8-ac6734adffa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:43.212339 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47741ef1-69ed-437e-bdb8-ac6734adffa2 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:43.309914 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d1e25-2738-4257-ad82-14bafa5cf8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:43.310672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d1e25-2738-4257-ad82-14bafa5cf8d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:43.310980 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d1e25-2738-4257-ad82-14bafa5cf8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:43.311452 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d1e25-2738-4257-ad82-14bafa5cf8d1 admin admin] PATH_INFO: `/v3/projects/0098a14dbf494aa8940e4cc3e69b0894` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:43.312967 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d1e25-2738-4257-ad82-14bafa5cf8d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0098a14dbf494aa8940e4cc3e69b0894)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:43.315329 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d1e25-2738-4257-ad82-14bafa5cf8d1 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:43.526617 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-064d1e25-2738-4257-ad82-14bafa5cf8d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0098a14dbf494aa8940e4cc3e69b0894', 'request_id': 'req-064d1e25-2738-4257-ad82-14bafa5cf8d1'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:43.561352 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-064d1e25-2738-4257-ad82-14bafa5cf8d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0098a14dbf494aa8940e4cc3e69b0894', 'request_id': 'req-064d1e25-2738-4257-ad82-14bafa5cf8d1'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:43.564580 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:17:43.765778 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-064d1e25-2738-4257-ad82-14bafa5cf8d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0098a14dbf494aa8940e4cc3e69b0894', 'request_id': 'req-064d1e25-2738-4257-ad82-14bafa5cf8d1'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:43.787358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-064d1e25-2738-4257-ad82-14bafa5cf8d1 admin admin] The token cache is being invalidate because project 0098a14dbf494aa8940e4cc3e69b0894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:17:43.788128 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-064d1e25-2738-4257-ad82-14bafa5cf8d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:43.789549 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-064d1e25-2738-4257-ad82-14bafa5cf8d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:17:43.793516 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1371/2726] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:17:43 2022] DELETE /identity/v3/projects/0098a14dbf494aa8940e4cc3e69b0894 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:17:44.688799 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4f89e-0ff3-44d7-9d94-5c3b33b5371f None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:44.689358 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4f89e-0ff3-44d7-9d94-5c3b33b5371f None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:44.689861 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4f89e-0ff3-44d7-9d94-5c3b33b5371f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:44.712198 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-85e4f89e-0ff3-44d7-9d94-5c3b33b5371f None None] MFA Rules not processed for user `adf3e223aab14e06983667ef5493eb16`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:44.713448 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-85e4f89e-0ff3-44d7-9d94-5c3b33b5371f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:44.783157 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1356/2727] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:17:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:17:50.598961 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1f1ac-b9b9-4f1d-9855-f495c4d287d4 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:50.599873 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1f1ac-b9b9-4f1d-9855-f495c4d287d4 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:50.599873 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1f1ac-b9b9-4f1d-9855-f495c4d287d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:50.623304 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-eab1f1ac-b9b9-4f1d-9855-f495c4d287d4 None None] MFA Rules not processed for user `ecb1c1d7c1e94ec3b1ac9cac30204410`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:17:50.624709 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-eab1f1ac-b9b9-4f1d-9855-f495c4d287d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:50.699593 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1372/2728] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:17:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:17:51.057663 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4f89e-0ff3-44d7-9d94-5c3b33b5371f None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:17:51.059141 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-85e4f89e-0ff3-44d7-9d94-5c3b33b5371f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:51.130676 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4f89e-0ff3-44d7-9d94-5c3b33b5371f None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:17:51.134840 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791fc9b-b46e-4b80-9edf-5f2166804fcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:17:51.135507 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791fc9b-b46e-4b80-9edf-5f2166804fcf service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:17:51.135790 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791fc9b-b46e-4b80-9edf-5f2166804fcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:17:51.136065 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791fc9b-b46e-4b80-9edf-5f2166804fcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:17:51.137960 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-1791fc9b-b46e-4b80-9edf-5f2166804fcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:17:51.149816 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791fc9b-b46e-4b80-9edf-5f2166804fcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:17:51.151337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791fc9b-b46e-4b80-9edf-5f2166804fcf service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:17:51.161660 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1357/2729] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:17:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:18:00.688683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:DELETE=1,keystone:SELECT=29 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:01.156602 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:DELETE=9,keystone:SELECT=71,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:10.053449 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1916d-c9b5-4c64-ab67-3cc3ffc00348 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:10.054101 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1916d-c9b5-4c64-ab67-3cc3ffc00348 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:10.054101 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1916d-c9b5-4c64-ab67-3cc3ffc00348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:10.075344 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-90d1916d-c9b5-4c64-ab67-3cc3ffc00348 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:10.076586 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-90d1916d-c9b5-4c64-ab67-3cc3ffc00348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:10.156027 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1373/2730] 10.222.0.47 () {58 vars in 1016 bytes} [Wed Aug 24 17:18:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:10.192042 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791fc9b-b46e-4b80-9edf-5f2166804fcf service neutron] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:10.194066 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-1791fc9b-b46e-4b80-9edf-5f2166804fcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:10.275785 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791fc9b-b46e-4b80-9edf-5f2166804fcf service neutron] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:10.281952 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb764c0-4ba4-499e-aebd-97d895c15b8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:10.284934 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb764c0-4ba4-499e-aebd-97d895c15b8c service nova] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:10.284934 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb764c0-4ba4-499e-aebd-97d895c15b8c service nova] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:10.284934 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb764c0-4ba4-499e-aebd-97d895c15b8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:10.294546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb764c0-4ba4-499e-aebd-97d895c15b8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:10.296191 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb764c0-4ba4-499e-aebd-97d895c15b8c service nova] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:10.307723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1358/2731] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:18:13.868526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144249b5-a20d-41e5-b2d7-d51b2ecc4aec None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:13.869241 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144249b5-a20d-41e5-b2d7-d51b2ecc4aec None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:13.869412 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144249b5-a20d-41e5-b2d7-d51b2ecc4aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:13.893644 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-144249b5-a20d-41e5-b2d7-d51b2ecc4aec None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:13.895600 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-144249b5-a20d-41e5-b2d7-d51b2ecc4aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:13.905212 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1374/2732] 10.222.0.47 () {58 vars in 1016 bytes} [Wed Aug 24 17:18:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:13.921511 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb764c0-4ba4-499e-aebd-97d895c15b8c service nova] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:13.923393 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-3eb764c0-4ba4-499e-aebd-97d895c15b8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:13.940031 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb764c0-4ba4-499e-aebd-97d895c15b8c service nova] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:13.946793 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81c79e-1c65-4217-8727-8cb1e117eaca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:13.947467 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81c79e-1c65-4217-8727-8cb1e117eaca service nova] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:13.947744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81c79e-1c65-4217-8727-8cb1e117eaca service nova] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:13.948016 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd81c79e-1c65-4217-8727-8cb1e117eaca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:13.959102 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81c79e-1c65-4217-8727-8cb1e117eaca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:13.960832 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd81c79e-1c65-4217-8727-8cb1e117eaca service nova] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:13.971895 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1359/2733] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:18:16.771193 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e5aaa-d298-4597-af5d-618cf5e08746 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:16.771685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e5aaa-d298-4597-af5d-618cf5e08746 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:16.771685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e5aaa-d298-4597-af5d-618cf5e08746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:16.792358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-f83e5aaa-d298-4597-af5d-618cf5e08746 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:16.793877 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-f83e5aaa-d298-4597-af5d-618cf5e08746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:16.801810 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1375/2734] 10.222.0.47 () {58 vars in 1016 bytes} [Wed Aug 24 17:18:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:16.818887 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81c79e-1c65-4217-8727-8cb1e117eaca service nova] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:16.830713 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd81c79e-1c65-4217-8727-8cb1e117eaca service nova] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:16.837243 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645dd8ce-4c4a-4273-97e6-4b8ffb1f25bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:16.837903 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645dd8ce-4c4a-4273-97e6-4b8ffb1f25bc service nova] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:16.838185 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645dd8ce-4c4a-4273-97e6-4b8ffb1f25bc service nova] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:16.838682 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645dd8ce-4c4a-4273-97e6-4b8ffb1f25bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:16.847418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645dd8ce-4c4a-4273-97e6-4b8ffb1f25bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:16.849027 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645dd8ce-4c4a-4273-97e6-4b8ffb1f25bc service nova] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:16.860985 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1360/2735] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:18:20.055353 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc901dc-5d16-4ea0-b8d3-8ebe739280c2 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:20.055906 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc901dc-5d16-4ea0-b8d3-8ebe739280c2 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:20.056036 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc901dc-5d16-4ea0-b8d3-8ebe739280c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:20.076302 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-9cc901dc-5d16-4ea0-b8d3-8ebe739280c2 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:20.077511 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-9cc901dc-5d16-4ea0-b8d3-8ebe739280c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:20.085988 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1376/2736] 10.222.0.47 () {58 vars in 1016 bytes} [Wed Aug 24 17:18:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:20.103372 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645dd8ce-4c4a-4273-97e6-4b8ffb1f25bc service nova] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:20.116461 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645dd8ce-4c4a-4273-97e6-4b8ffb1f25bc service nova] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:20.123208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54438042-d4bc-4ca3-8ee2-4bac630235ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:20.123842 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54438042-d4bc-4ca3-8ee2-4bac630235ef service nova] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:20.124128 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54438042-d4bc-4ca3-8ee2-4bac630235ef service nova] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:20.124401 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54438042-d4bc-4ca3-8ee2-4bac630235ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:20.133731 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54438042-d4bc-4ca3-8ee2-4bac630235ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:20.135323 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54438042-d4bc-4ca3-8ee2-4bac630235ef service nova] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:20.145329 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1361/2737] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:18:23.301470 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039cbc7-073e-4b80-aa6c-dde1a13aa690 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:23.302078 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039cbc7-073e-4b80-aa6c-dde1a13aa690 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:23.302183 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3039cbc7-073e-4b80-aa6c-dde1a13aa690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:23.396798 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-3039cbc7-073e-4b80-aa6c-dde1a13aa690 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:23.398113 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-3039cbc7-073e-4b80-aa6c-dde1a13aa690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:23.466238 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1377/2738] 10.222.0.47 () {58 vars in 1016 bytes} [Wed Aug 24 17:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:23.482770 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54438042-d4bc-4ca3-8ee2-4bac630235ef service nova] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:23.575021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54438042-d4bc-4ca3-8ee2-4bac630235ef service nova] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:23.584089 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21163d7c-d3bb-406d-927d-63b40b0f8828 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:23.585129 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21163d7c-d3bb-406d-927d-63b40b0f8828 service nova] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:23.585602 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21163d7c-d3bb-406d-927d-63b40b0f8828 service nova] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:23.586072 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21163d7c-d3bb-406d-927d-63b40b0f8828 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:23.601047 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21163d7c-d3bb-406d-927d-63b40b0f8828 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:23.604234 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21163d7c-d3bb-406d-927d-63b40b0f8828 service nova] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:23.624931 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1362/2739] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:18:33.463219 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=81 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:33.616237 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=82 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:58.050472 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039cbc7-073e-4b80-aa6c-dde1a13aa690 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:58.052067 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-3039cbc7-073e-4b80-aa6c-dde1a13aa690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:58.064320 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3039cbc7-073e-4b80-aa6c-dde1a13aa690 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:58.069862 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aedc58-7c71-4618-8ef8-7c6c13a5cc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:58.070502 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aedc58-7c71-4618-8ef8-7c6c13a5cc4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:58.070945 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aedc58-7c71-4618-8ef8-7c6c13a5cc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:58.071313 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aedc58-7c71-4618-8ef8-7c6c13a5cc4b admin admin] PATH_INFO: `/v3/users/ecb1c1d7c1e94ec3b1ac9cac30204410` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:58.072607 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aedc58-7c71-4618-8ef8-7c6c13a5cc4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecb1c1d7c1e94ec3b1ac9cac30204410)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:58.075648 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aedc58-7c71-4618-8ef8-7c6c13a5cc4b admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:58.288425 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-f7aedc58-7c71-4618-8ef8-7c6c13a5cc4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecb1c1d7c1e94ec3b1ac9cac30204410'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:58.295336 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-f7aedc58-7c71-4618-8ef8-7c6c13a5cc4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecb1c1d7c1e94ec3b1ac9cac30204410'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:58.347053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-f7aedc58-7c71-4618-8ef8-7c6c13a5cc4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecb1c1d7c1e94ec3b1ac9cac30204410'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:58.347700 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-f7aedc58-7c71-4618-8ef8-7c6c13a5cc4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecb1c1d7c1e94ec3b1ac9cac30204410'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:58.348306 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-f7aedc58-7c71-4618-8ef8-7c6c13a5cc4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecb1c1d7c1e94ec3b1ac9cac30204410'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:58.366168 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1378/2740] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:18:58 2022] DELETE /identity/v3/users/ecb1c1d7c1e94ec3b1ac9cac30204410 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:58.604079 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21163d7c-d3bb-406d-927d-63b40b0f8828 service nova] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:58.614482 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21163d7c-d3bb-406d-927d-63b40b0f8828 service nova] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:58.680815 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019fa678-d048-4811-ae1f-35fb20823692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:58.681489 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fa678-d048-4811-ae1f-35fb20823692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:58.681751 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fa678-d048-4811-ae1f-35fb20823692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:58.682014 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019fa678-d048-4811-ae1f-35fb20823692 admin admin] PATH_INFO: `/v3/projects/830cea74f85c4f258face31a3923f324` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:58.683176 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019fa678-d048-4811-ae1f-35fb20823692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=830cea74f85c4f258face31a3923f324)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:58.685099 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019fa678-d048-4811-ae1f-35fb20823692 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:58.820499 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-019fa678-d048-4811-ae1f-35fb20823692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '830cea74f85c4f258face31a3923f324', 'request_id': 'req-019fa678-d048-4811-ae1f-35fb20823692'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:58.829045 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-019fa678-d048-4811-ae1f-35fb20823692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '830cea74f85c4f258face31a3923f324', 'request_id': 'req-019fa678-d048-4811-ae1f-35fb20823692'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:58.836293 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-019fa678-d048-4811-ae1f-35fb20823692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '830cea74f85c4f258face31a3923f324', 'request_id': 'req-019fa678-d048-4811-ae1f-35fb20823692'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:58.912391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-019fa678-d048-4811-ae1f-35fb20823692 admin admin] The token cache is being invalidate because project 830cea74f85c4f258face31a3923f324 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:18:58.912676 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-019fa678-d048-4811-ae1f-35fb20823692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:58.913309 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-019fa678-d048-4811-ae1f-35fb20823692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:18:58.915017 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1363/2741] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:18:58 2022] DELETE /identity/v3/projects/830cea74f85c4f258face31a3923f324 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:58.919928 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287faad-ec62-4ca7-b7ba-8fbfaa0245d2 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:58.921982 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287faad-ec62-4ca7-b7ba-8fbfaa0245d2 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:58.921982 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0287faad-ec62-4ca7-b7ba-8fbfaa0245d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:58.941920 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-0287faad-ec62-4ca7-b7ba-8fbfaa0245d2 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:58.943285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-0287faad-ec62-4ca7-b7ba-8fbfaa0245d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:59.009143 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1379/2742] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:59.017368 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd88ee-c578-452c-8912-057f0c56d98c None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:59.017651 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd88ee-c578-452c-8912-057f0c56d98c None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:59.017927 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bd88ee-c578-452c-8912-057f0c56d98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:59.037876 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-f9bd88ee-c578-452c-8912-057f0c56d98c None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:59.039092 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-f9bd88ee-c578-452c-8912-057f0c56d98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:59.047969 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1364/2743] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:18:59.052287 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287faad-ec62-4ca7-b7ba-8fbfaa0245d2 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:59.062695 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0287faad-ec62-4ca7-b7ba-8fbfaa0245d2 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:59.067384 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9af2fa-0483-433f-82d7-a95f2b16e372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:59.067994 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9af2fa-0483-433f-82d7-a95f2b16e372 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:59.068263 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9af2fa-0483-433f-82d7-a95f2b16e372 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:59.068529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9af2fa-0483-433f-82d7-a95f2b16e372 admin admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:59.069172 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9af2fa-0483-433f-82d7-a95f2b16e372 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:18:59.069469 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9af2fa-0483-433f-82d7-a95f2b16e372 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:59.071134 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9af2fa-0483-433f-82d7-a95f2b16e372 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:59.082986 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1380/2744] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:18:59.087689 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd88ee-c578-452c-8912-057f0c56d98c None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:59.097092 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bd88ee-c578-452c-8912-057f0c56d98c None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:59.102412 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc0172-6962-4a69-bdc5-611af86c7f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:59.103088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc0172-6962-4a69-bdc5-611af86c7f9c admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:59.103388 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc0172-6962-4a69-bdc5-611af86c7f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:59.103655 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc0172-6962-4a69-bdc5-611af86c7f9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:59.104289 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc0172-6962-4a69-bdc5-611af86c7f9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:59.106203 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc0172-6962-4a69-bdc5-611af86c7f9c admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:59.216040 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1365/2745] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:18:59 2022] POST /identity/v3/projects => generated 399 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:18:59.220735 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9af2fa-0483-433f-82d7-a95f2b16e372 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:59.232411 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9af2fa-0483-433f-82d7-a95f2b16e372 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:59.298589 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae7291-bf96-4588-b319-56832159a2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:59.299260 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae7291-bf96-4588-b319-56832159a2e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:59.299542 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae7291-bf96-4588-b319-56832159a2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:59.299814 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abae7291-bf96-4588-b319-56832159a2e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:59.300470 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae7291-bf96-4588-b319-56832159a2e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:59.302536 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abae7291-bf96-4588-b319-56832159a2e3 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:59.311632 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:59.417333 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1381/2746] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:18:59 2022] POST /identity/v3/users => generated 300 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:18:59.422386 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc0172-6962-4a69-bdc5-611af86c7f9c admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:59.432857 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc0172-6962-4a69-bdc5-611af86c7f9c admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:59.437779 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db95d4-5ed4-4b59-b29b-815296e2ecd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:59.438400 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db95d4-5ed4-4b59-b29b-815296e2ecd9 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:59.438674 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db95d4-5ed4-4b59-b29b-815296e2ecd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:59.438942 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db95d4-5ed4-4b59-b29b-815296e2ecd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:59.439628 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db95d4-5ed4-4b59-b29b-815296e2ecd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:59.441226 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db95d4-5ed4-4b59-b29b-815296e2ecd9 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:59.452188 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1366/2747] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:18:59.456387 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae7291-bf96-4588-b319-56832159a2e3 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:59.469896 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abae7291-bf96-4588-b319-56832159a2e3 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:59.475569 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcfef3-300d-4f7f-9c53-6fecb0172240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:59.480036 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcfef3-300d-4f7f-9c53-6fecb0172240 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:59.480036 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcfef3-300d-4f7f-9c53-6fecb0172240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:59.480036 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcfef3-300d-4f7f-9c53-6fecb0172240 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:59.480036 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcfef3-300d-4f7f-9c53-6fecb0172240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:59.480036 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcfef3-300d-4f7f-9c53-6fecb0172240 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:59.491358 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1382/2748] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:18:59.506049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db95d4-5ed4-4b59-b29b-815296e2ecd9 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:59.516694 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db95d4-5ed4-4b59-b29b-815296e2ecd9 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:59.521535 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313ae32-939d-4ba4-ad17-2c1de2a9cb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:59.522260 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313ae32-939d-4ba4-ad17-2c1de2a9cb66 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:59.522519 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313ae32-939d-4ba4-ad17-2c1de2a9cb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:59.522791 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313ae32-939d-4ba4-ad17-2c1de2a9cb66 admin admin] PATH_INFO: `/v3/projects/08d11f1ce72742cc8d6e9af604904f4f/users/7719be72bd4c4accb4f1aa8dfbae8c76/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:59.539070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313ae32-939d-4ba4-ad17-2c1de2a9cb66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08d11f1ce72742cc8d6e9af604904f4f, user_id=7719be72bd4c4accb4f1aa8dfbae8c76, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:59.543279 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313ae32-939d-4ba4-ad17-2c1de2a9cb66 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:59.657552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1367/2749] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:18:59 2022] PUT /identity/v3/projects/08d11f1ce72742cc8d6e9af604904f4f/users/7719be72bd4c4accb4f1aa8dfbae8c76/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:18:59.725741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7909a7-ffe9-439f-933b-7a3ed1868508 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:59.725961 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7909a7-ffe9-439f-933b-7a3ed1868508 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:59.726211 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7909a7-ffe9-439f-933b-7a3ed1868508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:59.754696 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-6b7909a7-ffe9-439f-933b-7a3ed1868508 None None] MFA Rules not processed for user `7719be72bd4c4accb4f1aa8dfbae8c76`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:18:59.756024 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-6b7909a7-ffe9-439f-933b-7a3ed1868508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:59.826014 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1383/2750] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:18:59 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:18:59.838251 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313ae32-939d-4ba4-ad17-2c1de2a9cb66 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:18:59.839981 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-4313ae32-939d-4ba4-ad17-2c1de2a9cb66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:18:59.874919 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:18:59.926387 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313ae32-939d-4ba4-ad17-2c1de2a9cb66 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:18:59.930168 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a01185-b543-47a6-b9c3-3a5aaabee26b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:18:59.934520 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a01185-b543-47a6-b9c3-3a5aaabee26b service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:18:59.934520 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a01185-b543-47a6-b9c3-3a5aaabee26b service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:18:59.934520 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a01185-b543-47a6-b9c3-3a5aaabee26b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:18:59.940085 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a01185-b543-47a6-b9c3-3a5aaabee26b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:18:59.941518 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a01185-b543-47a6-b9c3-3a5aaabee26b service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:18:59.951647 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1368/2751] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:18:59 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:19:06.152062 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7909a7-ffe9-439f-933b-7a3ed1868508 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:06.226565 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7909a7-ffe9-439f-933b-7a3ed1868508 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:06.232462 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b46a29-11a2-4864-b598-001e552735df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:06.233107 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b46a29-11a2-4864-b598-001e552735df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:06.233390 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b46a29-11a2-4864-b598-001e552735df admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:06.233660 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b46a29-11a2-4864-b598-001e552735df admin admin] PATH_INFO: `/v3/users/7719be72bd4c4accb4f1aa8dfbae8c76` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:06.234826 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b46a29-11a2-4864-b598-001e552735df admin admin] RBAC: Authorizing `identity:delete_user(user_id=7719be72bd4c4accb4f1aa8dfbae8c76)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:06.236861 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b46a29-11a2-4864-b598-001e552735df admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:06.507298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-29b46a29-11a2-4864-b598-001e552735df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7719be72bd4c4accb4f1aa8dfbae8c76'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:06.516757 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-29b46a29-11a2-4864-b598-001e552735df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7719be72bd4c4accb4f1aa8dfbae8c76'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:06.586984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-29b46a29-11a2-4864-b598-001e552735df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7719be72bd4c4accb4f1aa8dfbae8c76'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:06.588214 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-29b46a29-11a2-4864-b598-001e552735df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7719be72bd4c4accb4f1aa8dfbae8c76'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:06.588845 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-29b46a29-11a2-4864-b598-001e552735df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7719be72bd4c4accb4f1aa8dfbae8c76'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:06.594865 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:19:06.612959 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1384/2752] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:19:06 2022] DELETE /identity/v3/users/7719be72bd4c4accb4f1aa8dfbae8c76 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:19:06.617460 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18618131-46f9-4c25-ad70-a42eb94e9e5e None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:06.617969 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18618131-46f9-4c25-ad70-a42eb94e9e5e None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:06.618071 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18618131-46f9-4c25-ad70-a42eb94e9e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:06.637570 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-18618131-46f9-4c25-ad70-a42eb94e9e5e None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:19:06.640729 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-18618131-46f9-4c25-ad70-a42eb94e9e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:06.700483 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1369/2753] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:19:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:19:06.710247 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b46a29-11a2-4864-b598-001e552735df admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:06.711758 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-29b46a29-11a2-4864-b598-001e552735df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:06.798958 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b46a29-11a2-4864-b598-001e552735df admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:06.802643 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38514cd9-ec0a-4426-85db-14f719a49b2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:06.803285 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38514cd9-ec0a-4426-85db-14f719a49b2d service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:06.803559 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38514cd9-ec0a-4426-85db-14f719a49b2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:06.803828 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38514cd9-ec0a-4426-85db-14f719a49b2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:06.815075 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38514cd9-ec0a-4426-85db-14f719a49b2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:06.816647 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38514cd9-ec0a-4426-85db-14f719a49b2d service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:06.827789 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1385/2754] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:19:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:19:07.263897 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18618131-46f9-4c25-ad70-a42eb94e9e5e None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:07.266057 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-18618131-46f9-4c25-ad70-a42eb94e9e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:07.280984 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18618131-46f9-4c25-ad70-a42eb94e9e5e None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:07.285954 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b2fb3-f4a2-4722-8cd4-0bc0a8e3163e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:07.286626 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b2fb3-f4a2-4722-8cd4-0bc0a8e3163e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:07.286891 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b2fb3-f4a2-4722-8cd4-0bc0a8e3163e admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:07.287189 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6b2fb3-f4a2-4722-8cd4-0bc0a8e3163e admin admin] PATH_INFO: `/v3/projects/08d11f1ce72742cc8d6e9af604904f4f` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:07.288386 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b2fb3-f4a2-4722-8cd4-0bc0a8e3163e admin admin] RBAC: Authorizing `identity:delete_project(project_id=08d11f1ce72742cc8d6e9af604904f4f)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:07.290369 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6b2fb3-f4a2-4722-8cd4-0bc0a8e3163e admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:07.428193 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-ef6b2fb3-f4a2-4722-8cd4-0bc0a8e3163e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08d11f1ce72742cc8d6e9af604904f4f', 'request_id': 'req-ef6b2fb3-f4a2-4722-8cd4-0bc0a8e3163e'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:07.435356 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-ef6b2fb3-f4a2-4722-8cd4-0bc0a8e3163e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08d11f1ce72742cc8d6e9af604904f4f', 'request_id': 'req-ef6b2fb3-f4a2-4722-8cd4-0bc0a8e3163e'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:07.446116 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-ef6b2fb3-f4a2-4722-8cd4-0bc0a8e3163e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08d11f1ce72742cc8d6e9af604904f4f', 'request_id': 'req-ef6b2fb3-f4a2-4722-8cd4-0bc0a8e3163e'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:07.581930 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-ef6b2fb3-f4a2-4722-8cd4-0bc0a8e3163e admin admin] The token cache is being invalidate because project 08d11f1ce72742cc8d6e9af604904f4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:19:07.582451 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-ef6b2fb3-f4a2-4722-8cd4-0bc0a8e3163e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:07.583645 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-ef6b2fb3-f4a2-4722-8cd4-0bc0a8e3163e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:19:07.586826 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1370/2755] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:19:07 2022] DELETE /identity/v3/projects/08d11f1ce72742cc8d6e9af604904f4f => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:19:16.823051 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=40,keystone:DELETE=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:19:17.574939 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:19:34.631445 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38514cd9-ec0a-4426-85db-14f719a49b2d service neutron] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:19:34.633308 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-38514cd9-ec0a-4426-85db-14f719a49b2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:34.763972 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38514cd9-ec0a-4426-85db-14f719a49b2d service neutron] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:19:34.837526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853de1d-ea90-4030-ae7f-6c2a03ce0629 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ef97356edf406aad9ab5f502bdb0af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:19:34.838599 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853de1d-ea90-4030-ae7f-6c2a03ce0629 service placement] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:19:34.839104 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853de1d-ea90-4030-ae7f-6c2a03ce0629 service placement] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:19:34.839652 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853de1d-ea90-4030-ae7f-6c2a03ce0629 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:19:34.842877 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-5853de1d-ea90-4030-ae7f-6c2a03ce0629 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:19:34.864187 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5853de1d-ea90-4030-ae7f-6c2a03ce0629 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:19:34.866065 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5853de1d-ea90-4030-ae7f-6c2a03ce0629 service placement] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:19:34.878532 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1386/2756] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:19:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:19:44.873920 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=67 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:20:47.032143 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b2fb3-f4a2-4722-8cd4-0bc0a8e3163e admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:20:47.033882 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-ef6b2fb3-f4a2-4722-8cd4-0bc0a8e3163e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:20:47.105319 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6b2fb3-f4a2-4722-8cd4-0bc0a8e3163e admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:20:47.109423 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06810cd9-648d-408b-91c9-f0834e7521f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:20:47.110086 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06810cd9-648d-408b-91c9-f0834e7521f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:47.110404 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06810cd9-648d-408b-91c9-f0834e7521f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:47.110765 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06810cd9-648d-408b-91c9-f0834e7521f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:47.113136 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-06810cd9-648d-408b-91c9-f0834e7521f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:20:47.206071 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06810cd9-648d-408b-91c9-f0834e7521f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:20:47.207472 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06810cd9-648d-408b-91c9-f0834e7521f3 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:20:47.220730 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1371/2757] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:20:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:20:48.431833 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853de1d-ea90-4030-ae7f-6c2a03ce0629 service placement] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:20:48.443483 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853de1d-ea90-4030-ae7f-6c2a03ce0629 service placement] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:20:48.447621 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c1131-1676-44a2-b081-35d122ce7d60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:20:48.452920 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c1131-1676-44a2-b081-35d122ce7d60 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:48.452920 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c1131-1676-44a2-b081-35d122ce7d60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:48.452920 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c1131-1676-44a2-b081-35d122ce7d60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:48.452920 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-b96c1131-1676-44a2-b081-35d122ce7d60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:20:48.466752 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c1131-1676-44a2-b081-35d122ce7d60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:20:48.468427 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c1131-1676-44a2-b081-35d122ce7d60 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:20:48.482664 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1387/2758] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:20:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:20:56.167956 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5f5b3-01ea-4f43-90d7-b3ef28cfcc52 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:20:56.168570 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5f5b3-01ea-4f43-90d7-b3ef28cfcc52 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:20:56.168976 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5f5b3-01ea-4f43-90d7-b3ef28cfcc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:20:56.200660 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-b5a5f5b3-01ea-4f43-90d7-b3ef28cfcc52 None None] MFA Rules not processed for user `adf3e223aab14e06983667ef5493eb16`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:20:56.228383 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-b5a5f5b3-01ea-4f43-90d7-b3ef28cfcc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:20:56.269082 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1372/2759] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:20:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:20:58.475951 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=6 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:21:01.796430 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c1131-1676-44a2-b081-35d122ce7d60 service neutron] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:21:01.799208 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-b96c1131-1676-44a2-b081-35d122ce7d60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:21:01.813894 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c1131-1676-44a2-b081-35d122ce7d60 service neutron] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:21:01.818894 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf20a5-8fd8-412a-b978-d193aef62a74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:21:01.819806 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf20a5-8fd8-412a-b978-d193aef62a74 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:21:01.820202 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf20a5-8fd8-412a-b978-d193aef62a74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:21:01.820649 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf20a5-8fd8-412a-b978-d193aef62a74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:21:01.823268 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-d5bf20a5-8fd8-412a-b978-d193aef62a74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:21:01.838446 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf20a5-8fd8-412a-b978-d193aef62a74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:21:01.840696 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf20a5-8fd8-412a-b978-d193aef62a74 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:21:01.853870 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1388/2760] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:21:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:21:06.261426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=84 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:21:11.554990 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a5f5b3-01ea-4f43-90d7-b3ef28cfcc52 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:21:11.556206 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-b5a5f5b3-01ea-4f43-90d7-b3ef28cfcc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:21:11.573812 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a5f5b3-01ea-4f43-90d7-b3ef28cfcc52 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:21:11.580823 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1477ca2-a3ee-45f2-ad75-e1361c7d2aab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:21:11.581460 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1477ca2-a3ee-45f2-ad75-e1361c7d2aab service nova] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:21:11.581738 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1477ca2-a3ee-45f2-ad75-e1361c7d2aab service nova] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:21:11.582025 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1477ca2-a3ee-45f2-ad75-e1361c7d2aab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:21:11.584540 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-f1477ca2-a3ee-45f2-ad75-e1361c7d2aab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:21:11.598204 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1477ca2-a3ee-45f2-ad75-e1361c7d2aab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:21:11.602110 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1477ca2-a3ee-45f2-ad75-e1361c7d2aab service nova] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:21:11.613014 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1373/2761] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:21:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:21:11.846568 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=6 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:21:21.607204 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=6 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:22:13.355244 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf20a5-8fd8-412a-b978-d193aef62a74 service neutron] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:13.356927 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-d5bf20a5-8fd8-412a-b978-d193aef62a74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:13.373850 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf20a5-8fd8-412a-b978-d193aef62a74 service neutron] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:13.379705 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e5e6e-77a6-4fa3-ab02-efae0cd22e4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:13.380342 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e5e6e-77a6-4fa3-ab02-efae0cd22e4b service nova] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:13.381459 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e5e6e-77a6-4fa3-ab02-efae0cd22e4b service nova] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:13.381459 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e5e6e-77a6-4fa3-ab02-efae0cd22e4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:13.384881 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-069e5e6e-77a6-4fa3-ab02-efae0cd22e4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:13.407088 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e5e6e-77a6-4fa3-ab02-efae0cd22e4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:13.408779 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e5e6e-77a6-4fa3-ab02-efae0cd22e4b service nova] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:13.422201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1389/2762] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:22:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:22:23.416145 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=6 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:22:23.848288 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1477ca2-a3ee-45f2-ad75-e1361c7d2aab service nova] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:23.849975 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-f1477ca2-a3ee-45f2-ad75-e1361c7d2aab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:23.941948 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1477ca2-a3ee-45f2-ad75-e1361c7d2aab service nova] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:23.948053 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1554f6-7615-42dd-ba63-776a9b141b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:23.948903 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1554f6-7615-42dd-ba63-776a9b141b3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:23.949220 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1554f6-7615-42dd-ba63-776a9b141b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:23.949502 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1554f6-7615-42dd-ba63-776a9b141b3d admin admin] PATH_INFO: `/v3/users/adf3e223aab14e06983667ef5493eb16` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:23.950857 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1554f6-7615-42dd-ba63-776a9b141b3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=adf3e223aab14e06983667ef5493eb16)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:23.952906 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1554f6-7615-42dd-ba63-776a9b141b3d admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:24.228121 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-5b1554f6-7615-42dd-ba63-776a9b141b3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adf3e223aab14e06983667ef5493eb16'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:24.228741 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-5b1554f6-7615-42dd-ba63-776a9b141b3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adf3e223aab14e06983667ef5493eb16'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:24.236370 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-5b1554f6-7615-42dd-ba63-776a9b141b3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adf3e223aab14e06983667ef5493eb16'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:24.237158 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-5b1554f6-7615-42dd-ba63-776a9b141b3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adf3e223aab14e06983667ef5493eb16'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:24.372180 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-5b1554f6-7615-42dd-ba63-776a9b141b3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adf3e223aab14e06983667ef5493eb16'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:24.401569 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1374/2763] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:22:23 2022] DELETE /identity/v3/users/adf3e223aab14e06983667ef5493eb16 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:22:24.784880 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e5e6e-77a6-4fa3-ab02-efae0cd22e4b service nova] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:24.797307 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e5e6e-77a6-4fa3-ab02-efae0cd22e4b service nova] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:24.866133 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc52ae3-7bf0-45fa-926a-cb00e10d0a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:24.867203 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc52ae3-7bf0-45fa-926a-cb00e10d0a32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:24.867364 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc52ae3-7bf0-45fa-926a-cb00e10d0a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:24.867633 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc52ae3-7bf0-45fa-926a-cb00e10d0a32 admin admin] PATH_INFO: `/v3/projects/469c96ececba46669cc249d7a2dc442a` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:24.868948 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc52ae3-7bf0-45fa-926a-cb00e10d0a32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=469c96ececba46669cc249d7a2dc442a)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:24.871062 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc52ae3-7bf0-45fa-926a-cb00e10d0a32 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:25.014030 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0dc52ae3-7bf0-45fa-926a-cb00e10d0a32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '469c96ececba46669cc249d7a2dc442a', 'request_id': 'req-0dc52ae3-7bf0-45fa-926a-cb00e10d0a32'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:25.019730 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0dc52ae3-7bf0-45fa-926a-cb00e10d0a32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '469c96ececba46669cc249d7a2dc442a', 'request_id': 'req-0dc52ae3-7bf0-45fa-926a-cb00e10d0a32'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:25.063177 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0dc52ae3-7bf0-45fa-926a-cb00e10d0a32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '469c96ececba46669cc249d7a2dc442a', 'request_id': 'req-0dc52ae3-7bf0-45fa-926a-cb00e10d0a32'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:25.075873 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0dc52ae3-7bf0-45fa-926a-cb00e10d0a32 admin admin] The token cache is being invalidate because project 469c96ececba46669cc249d7a2dc442a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:22:25.076163 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0dc52ae3-7bf0-45fa-926a-cb00e10d0a32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:25.076835 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0dc52ae3-7bf0-45fa-926a-cb00e10d0a32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:25.078378 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1390/2764] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:22:24 2022] DELETE /identity/v3/projects/469c96ececba46669cc249d7a2dc442a => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:22:25.083345 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfe911-d513-4760-a52e-a70ca9dc33a9 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:25.083915 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfe911-d513-4760-a52e-a70ca9dc33a9 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:25.083915 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfe911-d513-4760-a52e-a70ca9dc33a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:25.105015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-e4bfe911-d513-4760-a52e-a70ca9dc33a9 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:22:25.112694 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-e4bfe911-d513-4760-a52e-a70ca9dc33a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:25.173293 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1375/2765] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:22:25.182220 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bd66b-d755-474f-a29f-04b8d7b324b3 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:25.182500 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bd66b-d755-474f-a29f-04b8d7b324b3 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:25.182774 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bd66b-d755-474f-a29f-04b8d7b324b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:25.204665 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-911bd66b-d755-474f-a29f-04b8d7b324b3 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:22:25.205907 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-911bd66b-d755-474f-a29f-04b8d7b324b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:25.214431 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1391/2766] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:22:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:22:25.218836 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfe911-d513-4760-a52e-a70ca9dc33a9 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:25.229008 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfe911-d513-4760-a52e-a70ca9dc33a9 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:25.233701 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9fb8c-9b05-4ec6-9613-8de6a463aafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:25.234440 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9fb8c-9b05-4ec6-9613-8de6a463aafa admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:25.234759 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9fb8c-9b05-4ec6-9613-8de6a463aafa admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:25.235069 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a9fb8c-9b05-4ec6-9613-8de6a463aafa admin admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:25.236014 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a9fb8c-9b05-4ec6-9613-8de6a463aafa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:22:25.236369 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a9fb8c-9b05-4ec6-9613-8de6a463aafa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:25.238049 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a9fb8c-9b05-4ec6-9613-8de6a463aafa admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:25.251815 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1376/2767] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:22:25.256165 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911bd66b-d755-474f-a29f-04b8d7b324b3 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:25.266656 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911bd66b-d755-474f-a29f-04b8d7b324b3 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:25.271519 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97630545-439f-4ae3-9a3d-84dda30c8b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:25.272365 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97630545-439f-4ae3-9a3d-84dda30c8b7d admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:25.272717 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97630545-439f-4ae3-9a3d-84dda30c8b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:25.272980 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97630545-439f-4ae3-9a3d-84dda30c8b7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:25.273679 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97630545-439f-4ae3-9a3d-84dda30c8b7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:25.275867 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97630545-439f-4ae3-9a3d-84dda30c8b7d admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:25.396433 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1392/2768] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:22:25 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:22:25.401672 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9fb8c-9b05-4ec6-9613-8de6a463aafa admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:25.411929 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a9fb8c-9b05-4ec6-9613-8de6a463aafa admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:25.417119 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:22:25.473598 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be9012-cc87-4207-8bcf-d215612abf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:25.474213 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be9012-cc87-4207-8bcf-d215612abf63 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:25.474492 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be9012-cc87-4207-8bcf-d215612abf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:25.474764 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be9012-cc87-4207-8bcf-d215612abf63 admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:25.475566 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be9012-cc87-4207-8bcf-d215612abf63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:25.477505 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be9012-cc87-4207-8bcf-d215612abf63 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:25.629743 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1377/2769] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:22:25 2022] POST /identity/v3/users => generated 293 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:22:25.634828 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97630545-439f-4ae3-9a3d-84dda30c8b7d admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:25.645647 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97630545-439f-4ae3-9a3d-84dda30c8b7d admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:25.651034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d36b3d-696f-4082-85e8-6c3a1ff3b413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:25.651611 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d36b3d-696f-4082-85e8-6c3a1ff3b413 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:25.651884 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d36b3d-696f-4082-85e8-6c3a1ff3b413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:25.652296 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d36b3d-696f-4082-85e8-6c3a1ff3b413 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:25.652960 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d36b3d-696f-4082-85e8-6c3a1ff3b413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:25.654576 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d36b3d-696f-4082-85e8-6c3a1ff3b413 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:25.672862 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1393/2770] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:22:25.677581 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be9012-cc87-4207-8bcf-d215612abf63 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:25.691208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be9012-cc87-4207-8bcf-d215612abf63 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:25.699467 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715361f1-470c-4b84-8c6b-d9cc7003d7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:25.700540 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715361f1-470c-4b84-8c6b-d9cc7003d7ec admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:25.701032 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715361f1-470c-4b84-8c6b-d9cc7003d7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:25.701509 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715361f1-470c-4b84-8c6b-d9cc7003d7ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:25.702785 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715361f1-470c-4b84-8c6b-d9cc7003d7ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:25.704693 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715361f1-470c-4b84-8c6b-d9cc7003d7ec admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:25.716677 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1378/2771] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:22:25.721081 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d36b3d-696f-4082-85e8-6c3a1ff3b413 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:25.732979 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d36b3d-696f-4082-85e8-6c3a1ff3b413 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:25.737738 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25479345-44fa-4d86-ab0d-5f2d47a06e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:25.738405 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25479345-44fa-4d86-ab0d-5f2d47a06e38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:25.738687 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25479345-44fa-4d86-ab0d-5f2d47a06e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:25.738965 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25479345-44fa-4d86-ab0d-5f2d47a06e38 admin admin] PATH_INFO: `/v3/projects/1a1c4dae9eb0436f90694e77bfafb5b2/users/5f6e33c12ae048118eac945324efaf0f/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:25.756471 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25479345-44fa-4d86-ab0d-5f2d47a06e38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a1c4dae9eb0436f90694e77bfafb5b2, user_id=5f6e33c12ae048118eac945324efaf0f, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:25.759536 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25479345-44fa-4d86-ab0d-5f2d47a06e38 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:25.835171 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1394/2772] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:22:25 2022] PUT /identity/v3/projects/1a1c4dae9eb0436f90694e77bfafb5b2/users/5f6e33c12ae048118eac945324efaf0f/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:22:25.845959 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b9789-5e1e-4e7f-ac2a-96bbf41a3f97 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:25.846330 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b9789-5e1e-4e7f-ac2a-96bbf41a3f97 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:25.846654 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b9789-5e1e-4e7f-ac2a-96bbf41a3f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:25.878230 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-624b9789-5e1e-4e7f-ac2a-96bbf41a3f97 None None] MFA Rules not processed for user `5f6e33c12ae048118eac945324efaf0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:22:25.879477 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-624b9789-5e1e-4e7f-ac2a-96bbf41a3f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:25.944967 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1379/2773] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:22:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:22:25.949454 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25479345-44fa-4d86-ab0d-5f2d47a06e38 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:25.969531 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:22:26.016116 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25479345-44fa-4d86-ab0d-5f2d47a06e38 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:26.022717 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50509ada-f10d-4cde-922b-2516a939e250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:26.023464 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50509ada-f10d-4cde-922b-2516a939e250 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:26.023754 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50509ada-f10d-4cde-922b-2516a939e250 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:26.024031 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50509ada-f10d-4cde-922b-2516a939e250 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:26.024678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50509ada-f10d-4cde-922b-2516a939e250 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:26.026715 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50509ada-f10d-4cde-922b-2516a939e250 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:26.139759 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1395/2774] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:22:25 2022] POST /identity/v3/projects => generated 385 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:22:26.144010 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b9789-5e1e-4e7f-ac2a-96bbf41a3f97 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:26.155655 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b9789-5e1e-4e7f-ac2a-96bbf41a3f97 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:26.214547 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503edac3-7a55-46fd-ab1e-1e9eeec91cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:26.215071 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503edac3-7a55-46fd-ab1e-1e9eeec91cae admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:26.215476 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503edac3-7a55-46fd-ab1e-1e9eeec91cae admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:26.215750 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503edac3-7a55-46fd-ab1e-1e9eeec91cae admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:26.216386 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503edac3-7a55-46fd-ab1e-1e9eeec91cae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:26.218461 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503edac3-7a55-46fd-ab1e-1e9eeec91cae admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:26.332106 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1380/2775] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:22:26 2022] POST /identity/v3/users => generated 299 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:22:26.337490 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50509ada-f10d-4cde-922b-2516a939e250 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:26.348236 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50509ada-f10d-4cde-922b-2516a939e250 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:26.352868 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1d541-91ea-49fb-a516-ea175b1c2405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:26.353624 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1d541-91ea-49fb-a516-ea175b1c2405 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:26.354136 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1d541-91ea-49fb-a516-ea175b1c2405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:26.354587 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1d541-91ea-49fb-a516-ea175b1c2405 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:26.355270 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1d541-91ea-49fb-a516-ea175b1c2405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:26.356857 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1d541-91ea-49fb-a516-ea175b1c2405 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:26.368312 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1396/2776] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:22:26.372954 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503edac3-7a55-46fd-ab1e-1e9eeec91cae admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:26.379579 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:22:26.383916 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503edac3-7a55-46fd-ab1e-1e9eeec91cae admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:26.388730 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbcec79-1789-4a9e-ac76-a30e0ceeca97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:26.389389 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcec79-1789-4a9e-ac76-a30e0ceeca97 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:26.389668 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcec79-1789-4a9e-ac76-a30e0ceeca97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:26.389941 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbcec79-1789-4a9e-ac76-a30e0ceeca97 admin admin] PATH_INFO: `/v3/projects/ec194b2fe6b44169ad2b4ef781384807/users/f97842fa6b7c4c9b9aa39304a79dd66d/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:26.406240 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbcec79-1789-4a9e-ac76-a30e0ceeca97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec194b2fe6b44169ad2b4ef781384807, user_id=f97842fa6b7c4c9b9aa39304a79dd66d, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:26.408982 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbcec79-1789-4a9e-ac76-a30e0ceeca97 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:26.520559 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1381/2777] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:22:26 2022] PUT /identity/v3/projects/ec194b2fe6b44169ad2b4ef781384807/users/f97842fa6b7c4c9b9aa39304a79dd66d/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:22:26.525394 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1d541-91ea-49fb-a516-ea175b1c2405 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:26.536012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1d541-91ea-49fb-a516-ea175b1c2405 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:26.595515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ff656-ed40-499f-8e38-43a5c0db2324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:26.596121 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ff656-ed40-499f-8e38-43a5c0db2324 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:26.596399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ff656-ed40-499f-8e38-43a5c0db2324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:26.596670 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ff656-ed40-499f-8e38-43a5c0db2324 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:26.597337 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ff656-ed40-499f-8e38-43a5c0db2324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:26.598932 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ff656-ed40-499f-8e38-43a5c0db2324 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:26.609597 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1397/2778] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:22:26.613852 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbcec79-1789-4a9e-ac76-a30e0ceeca97 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:26.625495 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbcec79-1789-4a9e-ac76-a30e0ceeca97 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:26.630333 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e586e-0b65-42a0-b374-1d3e7b13b92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:26.630987 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e586e-0b65-42a0-b374-1d3e7b13b92f admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:26.631389 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e586e-0b65-42a0-b374-1d3e7b13b92f admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:26.631797 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e586e-0b65-42a0-b374-1d3e7b13b92f admin admin] PATH_INFO: `/v3/projects/ec194b2fe6b44169ad2b4ef781384807/users/f97842fa6b7c4c9b9aa39304a79dd66d/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:26.633831 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e586e-0b65-42a0-b374-1d3e7b13b92f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec194b2fe6b44169ad2b4ef781384807, user_id=f97842fa6b7c4c9b9aa39304a79dd66d, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:26.636516 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e586e-0b65-42a0-b374-1d3e7b13b92f admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:26.647835 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1382/2779] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:22:26 2022] PUT /identity/v3/projects/ec194b2fe6b44169ad2b4ef781384807/users/f97842fa6b7c4c9b9aa39304a79dd66d/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:22:26.660090 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b8e10-503c-4c72-98ef-a2027a54ab79 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:26.660377 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b8e10-503c-4c72-98ef-a2027a54ab79 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:26.660653 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b8e10-503c-4c72-98ef-a2027a54ab79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:26.688953 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-090b8e10-503c-4c72-98ef-a2027a54ab79 None None] MFA Rules not processed for user `f97842fa6b7c4c9b9aa39304a79dd66d`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:22:26.690169 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-090b8e10-503c-4c72-98ef-a2027a54ab79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:26.759922 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1398/2780] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:22:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:22:26.771002 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e586e-0b65-42a0-b374-1d3e7b13b92f admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:26.773213 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-9b5e586e-0b65-42a0-b374-1d3e7b13b92f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:26.831834 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e586e-0b65-42a0-b374-1d3e7b13b92f admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:26.836285 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac9cd89-442d-4242-92a3-31908c78163e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:26.836901 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9cd89-442d-4242-92a3-31908c78163e service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:26.837183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9cd89-442d-4242-92a3-31908c78163e service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:26.837457 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac9cd89-442d-4242-92a3-31908c78163e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:26.847184 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9cd89-442d-4242-92a3-31908c78163e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:26.848635 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac9cd89-442d-4242-92a3-31908c78163e service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:26.859869 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1383/2781] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:22:26 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:22:28.016981 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b8e10-503c-4c72-98ef-a2027a54ab79 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:28.031475 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:22:28.085189 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b8e10-503c-4c72-98ef-a2027a54ab79 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:28.089765 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0f1bb-8c3b-4f51-8040-4863169fdd46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:28.090399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0f1bb-8c3b-4f51-8040-4863169fdd46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:28.090672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0f1bb-8c3b-4f51-8040-4863169fdd46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:28.090941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0f1bb-8c3b-4f51-8040-4863169fdd46 admin admin] PATH_INFO: `/v3/users/5f6e33c12ae048118eac945324efaf0f` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:28.092107 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0f1bb-8c3b-4f51-8040-4863169fdd46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f6e33c12ae048118eac945324efaf0f)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:28.094024 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf0f1bb-8c3b-4f51-8040-4863169fdd46 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:28.259885 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-7cf0f1bb-8c3b-4f51-8040-4863169fdd46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f6e33c12ae048118eac945324efaf0f'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:28.267282 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-7cf0f1bb-8c3b-4f51-8040-4863169fdd46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f6e33c12ae048118eac945324efaf0f'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:28.360483 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-7cf0f1bb-8c3b-4f51-8040-4863169fdd46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f6e33c12ae048118eac945324efaf0f'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:28.361187 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-7cf0f1bb-8c3b-4f51-8040-4863169fdd46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f6e33c12ae048118eac945324efaf0f'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:28.361902 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-7cf0f1bb-8c3b-4f51-8040-4863169fdd46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f6e33c12ae048118eac945324efaf0f'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:28.380949 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1399/2782] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:22:28 2022] DELETE /identity/v3/users/5f6e33c12ae048118eac945324efaf0f => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:22:28.385680 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb5366-f47b-4708-89d7-6311ed975b77 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:28.386157 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb5366-f47b-4708-89d7-6311ed975b77 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:28.386273 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb5366-f47b-4708-89d7-6311ed975b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:28.405546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-a0eb5366-f47b-4708-89d7-6311ed975b77 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:22:28.406732 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-a0eb5366-f47b-4708-89d7-6311ed975b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:28.468061 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1384/2783] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:22:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:22:28.478988 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0f1bb-8c3b-4f51-8040-4863169fdd46 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:28.480518 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-7cf0f1bb-8c3b-4f51-8040-4863169fdd46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:28.542554 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0f1bb-8c3b-4f51-8040-4863169fdd46 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:28.546209 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d58b4-2472-4e77-b4f2-5cb2ddf2a512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:28.546883 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d58b4-2472-4e77-b4f2-5cb2ddf2a512 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:28.547185 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d58b4-2472-4e77-b4f2-5cb2ddf2a512 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:28.547457 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d58b4-2472-4e77-b4f2-5cb2ddf2a512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:28.557652 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d58b4-2472-4e77-b4f2-5cb2ddf2a512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:28.559102 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d58b4-2472-4e77-b4f2-5cb2ddf2a512 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:28.570040 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1400/2784] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:22:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:22:29.042173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb5366-f47b-4708-89d7-6311ed975b77 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:29.043710 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-a0eb5366-f47b-4708-89d7-6311ed975b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:29.057788 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb5366-f47b-4708-89d7-6311ed975b77 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:29.067352 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e61375-151f-469b-8b43-545d07c2e629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:29.067352 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e61375-151f-469b-8b43-545d07c2e629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:29.067352 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e61375-151f-469b-8b43-545d07c2e629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:29.067352 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e61375-151f-469b-8b43-545d07c2e629 admin admin] PATH_INFO: `/v3/projects/1a1c4dae9eb0436f90694e77bfafb5b2` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:29.068142 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e61375-151f-469b-8b43-545d07c2e629 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a1c4dae9eb0436f90694e77bfafb5b2)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:29.068142 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e61375-151f-469b-8b43-545d07c2e629 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:29.226729 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-f9e61375-151f-469b-8b43-545d07c2e629 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a1c4dae9eb0436f90694e77bfafb5b2', 'request_id': 'req-f9e61375-151f-469b-8b43-545d07c2e629'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:29.233183 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-f9e61375-151f-469b-8b43-545d07c2e629 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a1c4dae9eb0436f90694e77bfafb5b2', 'request_id': 'req-f9e61375-151f-469b-8b43-545d07c2e629'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:29.240294 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-f9e61375-151f-469b-8b43-545d07c2e629 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a1c4dae9eb0436f90694e77bfafb5b2', 'request_id': 'req-f9e61375-151f-469b-8b43-545d07c2e629'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:29.244685 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:22:29.352065 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-f9e61375-151f-469b-8b43-545d07c2e629 admin admin] The token cache is being invalidate because project 1a1c4dae9eb0436f90694e77bfafb5b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:22:29.352493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-f9e61375-151f-469b-8b43-545d07c2e629 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:29.353618 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-f9e61375-151f-469b-8b43-545d07c2e629 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:29.356528 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1385/2785] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:22:29 2022] DELETE /identity/v3/projects/1a1c4dae9eb0436f90694e77bfafb5b2 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:22:29.362402 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d58b4-2472-4e77-b4f2-5cb2ddf2a512 service neutron] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:29.373977 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d58b4-2472-4e77-b4f2-5cb2ddf2a512 service neutron] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:29.409791 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:22:29.436741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5b662-f3c6-4efd-b546-c50610797408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:29.437371 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5b662-f3c6-4efd-b546-c50610797408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:29.437653 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5b662-f3c6-4efd-b546-c50610797408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:29.437925 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5b662-f3c6-4efd-b546-c50610797408 admin admin] PATH_INFO: `/v3/users/f97842fa6b7c4c9b9aa39304a79dd66d` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:29.440782 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5b662-f3c6-4efd-b546-c50610797408 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f97842fa6b7c4c9b9aa39304a79dd66d)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:29.442695 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5b662-f3c6-4efd-b546-c50610797408 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:29.873411 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-fbf5b662-f3c6-4efd-b546-c50610797408 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f97842fa6b7c4c9b9aa39304a79dd66d'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:29.881411 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-fbf5b662-f3c6-4efd-b546-c50610797408 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f97842fa6b7c4c9b9aa39304a79dd66d'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:29.954263 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-fbf5b662-f3c6-4efd-b546-c50610797408 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f97842fa6b7c4c9b9aa39304a79dd66d'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:29.955575 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-fbf5b662-f3c6-4efd-b546-c50610797408 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f97842fa6b7c4c9b9aa39304a79dd66d'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:29.956222 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-fbf5b662-f3c6-4efd-b546-c50610797408 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f97842fa6b7c4c9b9aa39304a79dd66d'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:29.977525 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1401/2786] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:22:29 2022] DELETE /identity/v3/users/f97842fa6b7c4c9b9aa39304a79dd66d => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:22:30.455300 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e61375-151f-469b-8b43-545d07c2e629 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:30.457557 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-f9e61375-151f-469b-8b43-545d07c2e629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:30.473861 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e61375-151f-469b-8b43-545d07c2e629 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:30.543988 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658f4d7-3938-4076-a621-55d3f02bec95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:30.544810 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658f4d7-3938-4076-a621-55d3f02bec95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:30.545191 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658f4d7-3938-4076-a621-55d3f02bec95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:30.545565 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658f4d7-3938-4076-a621-55d3f02bec95 admin admin] PATH_INFO: `/v3/projects/ec194b2fe6b44169ad2b4ef781384807` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:30.547244 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658f4d7-3938-4076-a621-55d3f02bec95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec194b2fe6b44169ad2b4ef781384807)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:30.549459 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658f4d7-3938-4076-a621-55d3f02bec95 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:30.667902 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-c658f4d7-3938-4076-a621-55d3f02bec95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec194b2fe6b44169ad2b4ef781384807', 'request_id': 'req-c658f4d7-3938-4076-a621-55d3f02bec95'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:30.674015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-c658f4d7-3938-4076-a621-55d3f02bec95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec194b2fe6b44169ad2b4ef781384807', 'request_id': 'req-c658f4d7-3938-4076-a621-55d3f02bec95'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:30.680792 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-c658f4d7-3938-4076-a621-55d3f02bec95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec194b2fe6b44169ad2b4ef781384807', 'request_id': 'req-c658f4d7-3938-4076-a621-55d3f02bec95'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:30.766526 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-c658f4d7-3938-4076-a621-55d3f02bec95 admin admin] The token cache is being invalidate because project ec194b2fe6b44169ad2b4ef781384807 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:22:30.766784 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-c658f4d7-3938-4076-a621-55d3f02bec95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:30.767422 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-c658f4d7-3938-4076-a621-55d3f02bec95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:30.768934 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1386/2787] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:22:30 2022] DELETE /identity/v3/projects/ec194b2fe6b44169ad2b4ef781384807 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:22:30.775311 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7b7a4-0f70-408a-aabe-ef38fd018a8f None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:30.775854 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7b7a4-0f70-408a-aabe-ef38fd018a8f None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:30.775966 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7b7a4-0f70-408a-aabe-ef38fd018a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:30.796762 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-7db7b7a4-0f70-408a-aabe-ef38fd018a8f None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:22:30.798005 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-7db7b7a4-0f70-408a-aabe-ef38fd018a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:30.865734 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1402/2788] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:22:30.874367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df872da3-37e7-4f3a-a894-23195296f086 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:30.874552 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df872da3-37e7-4f3a-a894-23195296f086 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:30.874831 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df872da3-37e7-4f3a-a894-23195296f086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:30.897637 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-df872da3-37e7-4f3a-a894-23195296f086 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:22:30.899535 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-df872da3-37e7-4f3a-a894-23195296f086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:30.913547 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1387/2789] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:22:30.918157 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7b7a4-0f70-408a-aabe-ef38fd018a8f None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:30.929761 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7b7a4-0f70-408a-aabe-ef38fd018a8f None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:30.934683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57049f-bb17-4cda-a589-9859da96e5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:30.935340 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57049f-bb17-4cda-a589-9859da96e5de admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:30.935616 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57049f-bb17-4cda-a589-9859da96e5de admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:30.935891 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57049f-bb17-4cda-a589-9859da96e5de admin admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:30.936553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57049f-bb17-4cda-a589-9859da96e5de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:22:30.936858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57049f-bb17-4cda-a589-9859da96e5de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:30.938492 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57049f-bb17-4cda-a589-9859da96e5de admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:30.952499 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1403/2790] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:22:30.957914 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df872da3-37e7-4f3a-a894-23195296f086 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:30.969093 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df872da3-37e7-4f3a-a894-23195296f086 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:30.973860 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac44ae-a1de-4b43-986a-03a95248169f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:30.974491 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac44ae-a1de-4b43-986a-03a95248169f admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:30.974771 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac44ae-a1de-4b43-986a-03a95248169f admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:30.975039 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac44ae-a1de-4b43-986a-03a95248169f admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:30.976084 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac44ae-a1de-4b43-986a-03a95248169f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:30.978033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac44ae-a1de-4b43-986a-03a95248169f admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:31.076905 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1388/2791] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:22:30 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:22:31.083464 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57049f-bb17-4cda-a589-9859da96e5de admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:31.096064 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57049f-bb17-4cda-a589-9859da96e5de admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:31.144913 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:22:31.162677 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80624c-3d02-46de-9d15-e2443ab45a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:31.163517 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80624c-3d02-46de-9d15-e2443ab45a62 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:31.163897 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80624c-3d02-46de-9d15-e2443ab45a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:31.164310 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f80624c-3d02-46de-9d15-e2443ab45a62 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:31.164942 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80624c-3d02-46de-9d15-e2443ab45a62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:31.166895 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f80624c-3d02-46de-9d15-e2443ab45a62 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:31.315730 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1404/2792] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:22:31 2022] POST /identity/v3/users => generated 290 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:22:31.320650 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac44ae-a1de-4b43-986a-03a95248169f admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:31.333313 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac44ae-a1de-4b43-986a-03a95248169f admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:31.336191 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507ebad-927f-48c2-a666-18e92570ade1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:31.336820 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507ebad-927f-48c2-a666-18e92570ade1 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:31.337114 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507ebad-927f-48c2-a666-18e92570ade1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:31.337381 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507ebad-927f-48c2-a666-18e92570ade1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:31.338032 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507ebad-927f-48c2-a666-18e92570ade1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:31.339837 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507ebad-927f-48c2-a666-18e92570ade1 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:31.351060 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1389/2793] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:22:31.355558 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80624c-3d02-46de-9d15-e2443ab45a62 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:31.366890 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f80624c-3d02-46de-9d15-e2443ab45a62 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:31.372395 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26ceee-4d53-452b-b2a3-e884a5f97dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:31.373021 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26ceee-4d53-452b-b2a3-e884a5f97dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:31.373295 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26ceee-4d53-452b-b2a3-e884a5f97dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:31.373581 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26ceee-4d53-452b-b2a3-e884a5f97dd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:31.374218 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26ceee-4d53-452b-b2a3-e884a5f97dd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:31.375885 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26ceee-4d53-452b-b2a3-e884a5f97dd5 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:31.388098 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1405/2794] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:22:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:22:31.393173 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507ebad-927f-48c2-a666-18e92570ade1 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:31.405578 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507ebad-927f-48c2-a666-18e92570ade1 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:31.410462 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531c288-7519-4116-82de-5ec72479015d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:31.411254 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531c288-7519-4116-82de-5ec72479015d admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:31.411537 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531c288-7519-4116-82de-5ec72479015d admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:31.411816 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531c288-7519-4116-82de-5ec72479015d admin admin] PATH_INFO: `/v3/projects/26156adc6607470d860e7740f2339e15/users/1636e1047d774588b6f807852a2134af/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:31.428428 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531c288-7519-4116-82de-5ec72479015d admin admin] RBAC: Authorizing `identity:create_grant(project_id=26156adc6607470d860e7740f2339e15, user_id=1636e1047d774588b6f807852a2134af, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:31.431179 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531c288-7519-4116-82de-5ec72479015d admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:31.526831 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1390/2795] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:22:31 2022] PUT /identity/v3/projects/26156adc6607470d860e7740f2339e15/users/1636e1047d774588b6f807852a2134af/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:22:31.539522 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb6c05-fbdc-4086-9a38-24d71b445cad None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:31.540294 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb6c05-fbdc-4086-9a38-24d71b445cad None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:31.540294 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb6c05-fbdc-4086-9a38-24d71b445cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:31.571843 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-3cbb6c05-fbdc-4086-9a38-24d71b445cad None None] MFA Rules not processed for user `1636e1047d774588b6f807852a2134af`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:22:31.573220 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-3cbb6c05-fbdc-4086-9a38-24d71b445cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:31.653002 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1406/2796] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:22:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:22:31.657767 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531c288-7519-4116-82de-5ec72479015d admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:31.680524 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:22:31.726193 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531c288-7519-4116-82de-5ec72479015d admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:31.732195 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679af86a-e707-4903-aae7-a796bbd7121f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:31.735293 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679af86a-e707-4903-aae7-a796bbd7121f admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:31.735293 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679af86a-e707-4903-aae7-a796bbd7121f admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:31.735293 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679af86a-e707-4903-aae7-a796bbd7121f admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:31.735293 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679af86a-e707-4903-aae7-a796bbd7121f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:31.735978 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679af86a-e707-4903-aae7-a796bbd7121f admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:31.837032 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1391/2797] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:22:31 2022] POST /identity/v3/projects => generated 381 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:22:31.841478 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb6c05-fbdc-4086-9a38-24d71b445cad None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:31.853462 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb6c05-fbdc-4086-9a38-24d71b445cad None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:31.926079 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145bb0e6-f711-4fb7-8e30-3456ea3aac8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:31.926659 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145bb0e6-f711-4fb7-8e30-3456ea3aac8a admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:31.926946 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145bb0e6-f711-4fb7-8e30-3456ea3aac8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:31.927320 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145bb0e6-f711-4fb7-8e30-3456ea3aac8a admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:31.928029 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145bb0e6-f711-4fb7-8e30-3456ea3aac8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:31.930649 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145bb0e6-f711-4fb7-8e30-3456ea3aac8a admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:32.012711 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1407/2798] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:22:31 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:22:32.016991 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679af86a-e707-4903-aae7-a796bbd7121f admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:32.028640 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679af86a-e707-4903-aae7-a796bbd7121f admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:32.033613 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9eaf9-e823-41a8-b42b-f744e908a7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:32.034268 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9eaf9-e823-41a8-b42b-f744e908a7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:32.034579 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9eaf9-e823-41a8-b42b-f744e908a7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:32.034856 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9eaf9-e823-41a8-b42b-f744e908a7b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:32.035553 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c9eaf9-e823-41a8-b42b-f744e908a7b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:32.037189 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c9eaf9-e823-41a8-b42b-f744e908a7b0 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:32.049414 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1392/2799] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:22:32.056208 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145bb0e6-f711-4fb7-8e30-3456ea3aac8a admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:32.066753 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145bb0e6-f711-4fb7-8e30-3456ea3aac8a admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:32.071693 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a76540-bbee-4d19-a83d-14854880b69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:32.072653 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a76540-bbee-4d19-a83d-14854880b69a admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:32.072931 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a76540-bbee-4d19-a83d-14854880b69a admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:32.073209 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a76540-bbee-4d19-a83d-14854880b69a admin admin] PATH_INFO: `/v3/projects/70cc4a1d3fb64dacad46ceb3d8a89d51/users/3d0d8b9f6222422eb5bb35d5facf5946/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:32.089533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a76540-bbee-4d19-a83d-14854880b69a admin admin] RBAC: Authorizing `identity:create_grant(project_id=70cc4a1d3fb64dacad46ceb3d8a89d51, user_id=3d0d8b9f6222422eb5bb35d5facf5946, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:32.092238 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a76540-bbee-4d19-a83d-14854880b69a admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:32.212444 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1408/2800] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:22:32 2022] PUT /identity/v3/projects/70cc4a1d3fb64dacad46ceb3d8a89d51/users/3d0d8b9f6222422eb5bb35d5facf5946/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:22:32.216764 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9eaf9-e823-41a8-b42b-f744e908a7b0 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:32.227909 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9eaf9-e823-41a8-b42b-f744e908a7b0 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:32.297996 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10165f8c-91ab-42b4-ac57-57d488bd49b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:32.298642 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10165f8c-91ab-42b4-ac57-57d488bd49b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:32.298921 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10165f8c-91ab-42b4-ac57-57d488bd49b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:32.299227 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10165f8c-91ab-42b4-ac57-57d488bd49b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:32.299883 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10165f8c-91ab-42b4-ac57-57d488bd49b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:32.301493 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10165f8c-91ab-42b4-ac57-57d488bd49b9 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:32.312455 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1393/2801] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:22:32.317518 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a76540-bbee-4d19-a83d-14854880b69a admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:32.328976 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a76540-bbee-4d19-a83d-14854880b69a admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:32.333568 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f6d78-6d7a-4f46-9cd3-8680c309f7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:32.334852 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f6d78-6d7a-4f46-9cd3-8680c309f7fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:32.335181 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f6d78-6d7a-4f46-9cd3-8680c309f7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:32.335449 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f6d78-6d7a-4f46-9cd3-8680c309f7fb admin admin] PATH_INFO: `/v3/projects/70cc4a1d3fb64dacad46ceb3d8a89d51/users/3d0d8b9f6222422eb5bb35d5facf5946/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:32.337399 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f6d78-6d7a-4f46-9cd3-8680c309f7fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=70cc4a1d3fb64dacad46ceb3d8a89d51, user_id=3d0d8b9f6222422eb5bb35d5facf5946, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:32.340086 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f6d78-6d7a-4f46-9cd3-8680c309f7fb admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:32.350792 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1409/2802] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:22:32 2022] PUT /identity/v3/projects/70cc4a1d3fb64dacad46ceb3d8a89d51/users/3d0d8b9f6222422eb5bb35d5facf5946/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:22:32.361103 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c2bf8-662d-428f-8f20-d291f0d844a2 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:32.361396 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c2bf8-662d-428f-8f20-d291f0d844a2 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:32.361679 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c2bf8-662d-428f-8f20-d291f0d844a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:32.390146 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-6f1c2bf8-662d-428f-8f20-d291f0d844a2 None None] MFA Rules not processed for user `3d0d8b9f6222422eb5bb35d5facf5946`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:22:32.391409 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-6f1c2bf8-662d-428f-8f20-d291f0d844a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:32.468422 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1394/2803] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:22:32 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:22:32.479439 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f6d78-6d7a-4f46-9cd3-8680c309f7fb admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:32.481180 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-4c3f6d78-6d7a-4f46-9cd3-8680c309f7fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:32.486504 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:22:32.548636 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f6d78-6d7a-4f46-9cd3-8680c309f7fb admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:32.552427 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe64c6-28dd-469c-ab56-2bbc0cdab537 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:32.553239 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe64c6-28dd-469c-ab56-2bbc0cdab537 service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:32.554029 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe64c6-28dd-469c-ab56-2bbc0cdab537 service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:32.554298 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe64c6-28dd-469c-ab56-2bbc0cdab537 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:32.564224 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe64c6-28dd-469c-ab56-2bbc0cdab537 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:32.565668 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe64c6-28dd-469c-ab56-2bbc0cdab537 service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:32.577722 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1410/2804] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:22:32 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:22:33.163682 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c2bf8-662d-428f-8f20-d291f0d844a2 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:33.182748 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:22:33.231139 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c2bf8-662d-428f-8f20-d291f0d844a2 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:33.235830 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114d673-68df-4a16-a5e6-5147105c630c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:33.236406 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114d673-68df-4a16-a5e6-5147105c630c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:33.236682 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114d673-68df-4a16-a5e6-5147105c630c admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:33.236954 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e114d673-68df-4a16-a5e6-5147105c630c admin admin] PATH_INFO: `/v3/users/1636e1047d774588b6f807852a2134af` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:33.238093 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e114d673-68df-4a16-a5e6-5147105c630c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1636e1047d774588b6f807852a2134af)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:33.240077 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e114d673-68df-4a16-a5e6-5147105c630c admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:33.443570 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-e114d673-68df-4a16-a5e6-5147105c630c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1636e1047d774588b6f807852a2134af'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:33.444376 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-e114d673-68df-4a16-a5e6-5147105c630c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1636e1047d774588b6f807852a2134af'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:33.453363 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-e114d673-68df-4a16-a5e6-5147105c630c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1636e1047d774588b6f807852a2134af'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:33.453829 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-e114d673-68df-4a16-a5e6-5147105c630c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1636e1047d774588b6f807852a2134af'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:33.543713 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-e114d673-68df-4a16-a5e6-5147105c630c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1636e1047d774588b6f807852a2134af'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:33.565939 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1395/2805] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:22:33 2022] DELETE /identity/v3/users/1636e1047d774588b6f807852a2134af => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:22:33.570920 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9dfd8-f24c-47dc-b456-744748bb644b None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:33.571583 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9dfd8-f24c-47dc-b456-744748bb644b None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:33.571583 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9dfd8-f24c-47dc-b456-744748bb644b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:33.596101 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-fee9dfd8-f24c-47dc-b456-744748bb644b None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:22:33.597710 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-fee9dfd8-f24c-47dc-b456-744748bb644b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:33.663883 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1411/2806] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:22:33.673814 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114d673-68df-4a16-a5e6-5147105c630c admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:33.675264 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-e114d673-68df-4a16-a5e6-5147105c630c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:33.743242 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e114d673-68df-4a16-a5e6-5147105c630c admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:33.747223 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b9e0d-d392-47c0-bb70-cd7cb7e5e705 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:33.747842 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b9e0d-d392-47c0-bb70-cd7cb7e5e705 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:33.748115 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b9e0d-d392-47c0-bb70-cd7cb7e5e705 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:33.748407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b9e0d-d392-47c0-bb70-cd7cb7e5e705 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:33.759583 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b9e0d-d392-47c0-bb70-cd7cb7e5e705 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:33.760927 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b9e0d-d392-47c0-bb70-cd7cb7e5e705 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:33.771276 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1396/2807] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:22:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:22:34.207731 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9dfd8-f24c-47dc-b456-744748bb644b None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:34.209639 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-fee9dfd8-f24c-47dc-b456-744748bb644b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:34.225487 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9dfd8-f24c-47dc-b456-744748bb644b None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:34.231368 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99f730-e973-431f-af37-bb5c1037bc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:34.232070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99f730-e973-431f-af37-bb5c1037bc4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:34.232685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99f730-e973-431f-af37-bb5c1037bc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:34.232685 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99f730-e973-431f-af37-bb5c1037bc4d admin admin] PATH_INFO: `/v3/projects/26156adc6607470d860e7740f2339e15` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:34.233798 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99f730-e973-431f-af37-bb5c1037bc4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=26156adc6607470d860e7740f2339e15)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:34.235810 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99f730-e973-431f-af37-bb5c1037bc4d admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:34.364102 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0a99f730-e973-431f-af37-bb5c1037bc4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26156adc6607470d860e7740f2339e15', 'request_id': 'req-0a99f730-e973-431f-af37-bb5c1037bc4d'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:34.372643 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0a99f730-e973-431f-af37-bb5c1037bc4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26156adc6607470d860e7740f2339e15', 'request_id': 'req-0a99f730-e973-431f-af37-bb5c1037bc4d'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:34.439780 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0a99f730-e973-431f-af37-bb5c1037bc4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26156adc6607470d860e7740f2339e15', 'request_id': 'req-0a99f730-e973-431f-af37-bb5c1037bc4d'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:34.454367 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0a99f730-e973-431f-af37-bb5c1037bc4d admin admin] The token cache is being invalidate because project 26156adc6607470d860e7740f2339e15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:22:34.454701 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0a99f730-e973-431f-af37-bb5c1037bc4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:34.455376 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-0a99f730-e973-431f-af37-bb5c1037bc4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:34.456881 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1412/2808] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:22:34 2022] DELETE /identity/v3/projects/26156adc6607470d860e7740f2339e15 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:22:34.461411 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b9e0d-d392-47c0-bb70-cd7cb7e5e705 service neutron] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:34.471498 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b9e0d-d392-47c0-bb70-cd7cb7e5e705 service neutron] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:34.526144 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:22:34.563836 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0510bef4-6d72-409a-9c09-c70e931e9862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:34.564742 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510bef4-6d72-409a-9c09-c70e931e9862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:34.565142 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510bef4-6d72-409a-9c09-c70e931e9862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:34.565517 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0510bef4-6d72-409a-9c09-c70e931e9862 admin admin] PATH_INFO: `/v3/users/3d0d8b9f6222422eb5bb35d5facf5946` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:34.566982 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510bef4-6d72-409a-9c09-c70e931e9862 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d0d8b9f6222422eb5bb35d5facf5946)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:34.569408 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0510bef4-6d72-409a-9c09-c70e931e9862 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:34.768214 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-0510bef4-6d72-409a-9c09-c70e931e9862 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d0d8b9f6222422eb5bb35d5facf5946'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:34.768892 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-0510bef4-6d72-409a-9c09-c70e931e9862 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d0d8b9f6222422eb5bb35d5facf5946'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:34.776367 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-0510bef4-6d72-409a-9c09-c70e931e9862 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d0d8b9f6222422eb5bb35d5facf5946'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:34.777068 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-0510bef4-6d72-409a-9c09-c70e931e9862 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d0d8b9f6222422eb5bb35d5facf5946'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:34.874331 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-0510bef4-6d72-409a-9c09-c70e931e9862 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d0d8b9f6222422eb5bb35d5facf5946'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:34.900566 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1397/2809] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:22:34 2022] DELETE /identity/v3/users/3d0d8b9f6222422eb5bb35d5facf5946 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:22:35.373218 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99f730-e973-431f-af37-bb5c1037bc4d admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:35.374684 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-0a99f730-e973-431f-af37-bb5c1037bc4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:35.389062 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99f730-e973-431f-af37-bb5c1037bc4d admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:35.419590 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:22:35.465463 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c8152-838b-4ad3-b27c-78cc2d73c89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:35.466436 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c8152-838b-4ad3-b27c-78cc2d73c89e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:35.468248 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c8152-838b-4ad3-b27c-78cc2d73c89e admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:35.468248 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c8152-838b-4ad3-b27c-78cc2d73c89e admin admin] PATH_INFO: `/v3/projects/70cc4a1d3fb64dacad46ceb3d8a89d51` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:35.468705 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c8152-838b-4ad3-b27c-78cc2d73c89e admin admin] RBAC: Authorizing `identity:delete_project(project_id=70cc4a1d3fb64dacad46ceb3d8a89d51)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:35.471170 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c8152-838b-4ad3-b27c-78cc2d73c89e admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:35.628581 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-687c8152-838b-4ad3-b27c-78cc2d73c89e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70cc4a1d3fb64dacad46ceb3d8a89d51', 'request_id': 'req-687c8152-838b-4ad3-b27c-78cc2d73c89e'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:35.633837 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-687c8152-838b-4ad3-b27c-78cc2d73c89e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70cc4a1d3fb64dacad46ceb3d8a89d51', 'request_id': 'req-687c8152-838b-4ad3-b27c-78cc2d73c89e'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:35.759867 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-687c8152-838b-4ad3-b27c-78cc2d73c89e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70cc4a1d3fb64dacad46ceb3d8a89d51', 'request_id': 'req-687c8152-838b-4ad3-b27c-78cc2d73c89e'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:35.772319 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-687c8152-838b-4ad3-b27c-78cc2d73c89e admin admin] The token cache is being invalidate because project 70cc4a1d3fb64dacad46ceb3d8a89d51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:22:35.772616 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-687c8152-838b-4ad3-b27c-78cc2d73c89e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:35.773356 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-687c8152-838b-4ad3-b27c-78cc2d73c89e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:35.774922 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1413/2810] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:22:35 2022] DELETE /identity/v3/projects/70cc4a1d3fb64dacad46ceb3d8a89d51 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:22:35.780038 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7995b75-0206-4160-97e8-ec38f968c34c None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:35.780562 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7995b75-0206-4160-97e8-ec38f968c34c None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:35.780562 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7995b75-0206-4160-97e8-ec38f968c34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:35.803767 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-c7995b75-0206-4160-97e8-ec38f968c34c None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:22:35.805212 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-c7995b75-0206-4160-97e8-ec38f968c34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:35.895040 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1398/2811] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:22:35.903926 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff918c57-1ea3-4af2-a74e-93dfbd1ea909 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:35.904196 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff918c57-1ea3-4af2-a74e-93dfbd1ea909 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:35.904473 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff918c57-1ea3-4af2-a74e-93dfbd1ea909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:35.926144 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-ff918c57-1ea3-4af2-a74e-93dfbd1ea909 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:22:35.927437 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-ff918c57-1ea3-4af2-a74e-93dfbd1ea909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:35.937587 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1414/2812] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:22:35.941983 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7995b75-0206-4160-97e8-ec38f968c34c None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:35.957348 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7995b75-0206-4160-97e8-ec38f968c34c None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:35.964025 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673550b-8213-424f-b85b-94af071fa59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:35.964654 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673550b-8213-424f-b85b-94af071fa59a admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:35.964932 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673550b-8213-424f-b85b-94af071fa59a admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:35.965354 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c673550b-8213-424f-b85b-94af071fa59a admin admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:35.966022 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673550b-8213-424f-b85b-94af071fa59a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:22:35.966325 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673550b-8213-424f-b85b-94af071fa59a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:35.967985 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c673550b-8213-424f-b85b-94af071fa59a admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:35.980871 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1399/2813] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:22:35.985344 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff918c57-1ea3-4af2-a74e-93dfbd1ea909 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:35.996497 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff918c57-1ea3-4af2-a74e-93dfbd1ea909 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:36.003171 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7bb0d-6496-4311-9f19-05b8b563e22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:36.004262 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7bb0d-6496-4311-9f19-05b8b563e22b admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:36.004745 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7bb0d-6496-4311-9f19-05b8b563e22b admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:36.005226 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7bb0d-6496-4311-9f19-05b8b563e22b admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:36.007760 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7bb0d-6496-4311-9f19-05b8b563e22b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:36.011511 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7bb0d-6496-4311-9f19-05b8b563e22b admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:36.127460 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1415/2814] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:22:35 2022] POST /identity/v3/projects => generated 381 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:22:36.131805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673550b-8213-424f-b85b-94af071fa59a admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:36.142025 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c673550b-8213-424f-b85b-94af071fa59a admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:36.189139 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:22:36.204679 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb632174-f3a7-4284-996b-82f0a6c3a6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:36.205292 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb632174-f3a7-4284-996b-82f0a6c3a6e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:36.205706 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb632174-f3a7-4284-996b-82f0a6c3a6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:36.205985 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb632174-f3a7-4284-996b-82f0a6c3a6e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:36.206614 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb632174-f3a7-4284-996b-82f0a6c3a6e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:36.208579 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb632174-f3a7-4284-996b-82f0a6c3a6e4 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:36.302133 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1400/2815] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:22:36 2022] POST /identity/v3/users => generated 291 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:22:36.307682 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7bb0d-6496-4311-9f19-05b8b563e22b admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:36.325120 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7bb0d-6496-4311-9f19-05b8b563e22b admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:36.333391 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab9a17-a394-4f90-9c5e-b7ebeb31ec7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:36.334577 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab9a17-a394-4f90-9c5e-b7ebeb31ec7d admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:36.335046 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab9a17-a394-4f90-9c5e-b7ebeb31ec7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:36.335623 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab9a17-a394-4f90-9c5e-b7ebeb31ec7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:36.336844 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab9a17-a394-4f90-9c5e-b7ebeb31ec7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:36.340032 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab9a17-a394-4f90-9c5e-b7ebeb31ec7d admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:36.356930 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1416/2816] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:22:36.361933 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb632174-f3a7-4284-996b-82f0a6c3a6e4 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:36.374391 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb632174-f3a7-4284-996b-82f0a6c3a6e4 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:36.379068 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ffe5f-8bdd-43d4-bc9c-166369ca34ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:36.379731 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ffe5f-8bdd-43d4-bc9c-166369ca34ef admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:36.380012 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ffe5f-8bdd-43d4-bc9c-166369ca34ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:36.380282 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ffe5f-8bdd-43d4-bc9c-166369ca34ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:36.380963 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ffe5f-8bdd-43d4-bc9c-166369ca34ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:36.383248 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ffe5f-8bdd-43d4-bc9c-166369ca34ef admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:36.394150 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1401/2817] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:22:36.399130 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab9a17-a394-4f90-9c5e-b7ebeb31ec7d admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:36.409273 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab9a17-a394-4f90-9c5e-b7ebeb31ec7d admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:36.414866 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40c14d-198d-4210-b6ee-69fb0c09d15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:36.415600 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40c14d-198d-4210-b6ee-69fb0c09d15c admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:36.415874 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40c14d-198d-4210-b6ee-69fb0c09d15c admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:36.416144 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40c14d-198d-4210-b6ee-69fb0c09d15c admin admin] PATH_INFO: `/v3/projects/b4e19bea170e4d459e783639b6636afc/users/ef2eec6e45074a11843dd070808100be/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:36.431528 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40c14d-198d-4210-b6ee-69fb0c09d15c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4e19bea170e4d459e783639b6636afc, user_id=ef2eec6e45074a11843dd070808100be, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:36.434248 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40c14d-198d-4210-b6ee-69fb0c09d15c admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:36.514713 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1417/2818] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:22:36 2022] PUT /identity/v3/projects/b4e19bea170e4d459e783639b6636afc/users/ef2eec6e45074a11843dd070808100be/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:22:36.527091 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccc9b5-c533-4c40-bd7a-45748a005a4d None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:36.527406 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccc9b5-c533-4c40-bd7a-45748a005a4d None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:36.527679 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccc9b5-c533-4c40-bd7a-45748a005a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:36.563325 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-fcccc9b5-c533-4c40-bd7a-45748a005a4d None None] MFA Rules not processed for user `ef2eec6e45074a11843dd070808100be`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:22:36.564603 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-fcccc9b5-c533-4c40-bd7a-45748a005a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:36.632482 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1402/2819] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:22:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:22:36.637127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40c14d-198d-4210-b6ee-69fb0c09d15c admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:36.697453 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:22:36.702151 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40c14d-198d-4210-b6ee-69fb0c09d15c admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:36.706988 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031631e2-9b26-4e3f-88df-6999751238a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:36.711329 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031631e2-9b26-4e3f-88df-6999751238a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:36.711329 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031631e2-9b26-4e3f-88df-6999751238a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:36.711329 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031631e2-9b26-4e3f-88df-6999751238a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:36.711329 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031631e2-9b26-4e3f-88df-6999751238a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:36.711329 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031631e2-9b26-4e3f-88df-6999751238a0 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:36.807871 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1418/2820] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:22:36 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:22:36.812422 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccc9b5-c533-4c40-bd7a-45748a005a4d None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:36.825403 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccc9b5-c533-4c40-bd7a-45748a005a4d None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:36.885284 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99271bb-ef91-48b9-b0b6-a46325a61a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:36.885891 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99271bb-ef91-48b9-b0b6-a46325a61a9d admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:36.886169 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99271bb-ef91-48b9-b0b6-a46325a61a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:36.886441 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99271bb-ef91-48b9-b0b6-a46325a61a9d admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:36.887068 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99271bb-ef91-48b9-b0b6-a46325a61a9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:36.889104 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99271bb-ef91-48b9-b0b6-a46325a61a9d admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:36.982946 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1403/2821] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:22:36 2022] POST /identity/v3/users => generated 299 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:22:36.987018 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031631e2-9b26-4e3f-88df-6999751238a0 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:36.998344 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031631e2-9b26-4e3f-88df-6999751238a0 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:37.003073 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76937b0c-6aea-4cea-8e8e-1300b92a27da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:37.003712 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76937b0c-6aea-4cea-8e8e-1300b92a27da admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:37.004004 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76937b0c-6aea-4cea-8e8e-1300b92a27da admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:37.004278 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76937b0c-6aea-4cea-8e8e-1300b92a27da admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:37.004910 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76937b0c-6aea-4cea-8e8e-1300b92a27da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:37.006992 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76937b0c-6aea-4cea-8e8e-1300b92a27da admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:37.017594 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1419/2822] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:22:37.022647 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99271bb-ef91-48b9-b0b6-a46325a61a9d admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:37.033753 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99271bb-ef91-48b9-b0b6-a46325a61a9d admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:37.038619 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea087d22-2eec-45a7-adcb-752ab3a16af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:37.039291 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea087d22-2eec-45a7-adcb-752ab3a16af4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:37.039574 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea087d22-2eec-45a7-adcb-752ab3a16af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:37.039853 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea087d22-2eec-45a7-adcb-752ab3a16af4 admin admin] PATH_INFO: `/v3/projects/fe0f39ebcd724cdab55f883975f055d6/users/a964366862dc412ebc7ab125c6c11aec/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:37.055819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea087d22-2eec-45a7-adcb-752ab3a16af4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe0f39ebcd724cdab55f883975f055d6, user_id=a964366862dc412ebc7ab125c6c11aec, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:37.058538 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea087d22-2eec-45a7-adcb-752ab3a16af4 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:37.150281 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1404/2823] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:22:37 2022] PUT /identity/v3/projects/fe0f39ebcd724cdab55f883975f055d6/users/a964366862dc412ebc7ab125c6c11aec/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:22:37.154535 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76937b0c-6aea-4cea-8e8e-1300b92a27da admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:37.165179 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76937b0c-6aea-4cea-8e8e-1300b92a27da admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:37.228142 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802cc19e-5f79-4920-a71c-a7dc078ee074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:37.228754 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cc19e-5f79-4920-a71c-a7dc078ee074 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:37.229034 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cc19e-5f79-4920-a71c-a7dc078ee074 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:37.229308 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802cc19e-5f79-4920-a71c-a7dc078ee074 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:37.229982 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802cc19e-5f79-4920-a71c-a7dc078ee074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:37.231619 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802cc19e-5f79-4920-a71c-a7dc078ee074 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:37.242490 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1420/2824] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:22:37 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:22:37.247007 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea087d22-2eec-45a7-adcb-752ab3a16af4 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:37.258458 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea087d22-2eec-45a7-adcb-752ab3a16af4 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:37.263243 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304e442-779e-42a9-844b-4d6a2e857ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:37.263892 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304e442-779e-42a9-844b-4d6a2e857ed8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:37.264164 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304e442-779e-42a9-844b-4d6a2e857ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:37.264432 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304e442-779e-42a9-844b-4d6a2e857ed8 admin admin] PATH_INFO: `/v3/projects/fe0f39ebcd724cdab55f883975f055d6/users/a964366862dc412ebc7ab125c6c11aec/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:37.266415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304e442-779e-42a9-844b-4d6a2e857ed8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe0f39ebcd724cdab55f883975f055d6, user_id=a964366862dc412ebc7ab125c6c11aec, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:37.269091 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3304e442-779e-42a9-844b-4d6a2e857ed8 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:37.281309 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1405/2825] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:22:37 2022] PUT /identity/v3/projects/fe0f39ebcd724cdab55f883975f055d6/users/a964366862dc412ebc7ab125c6c11aec/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:22:37.293283 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1bd67e-c5cd-4507-b977-723a79540a64 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:37.293564 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1bd67e-c5cd-4507-b977-723a79540a64 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:37.293840 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1bd67e-c5cd-4507-b977-723a79540a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:37.326804 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-cd1bd67e-c5cd-4507-b977-723a79540a64 None None] MFA Rules not processed for user `a964366862dc412ebc7ab125c6c11aec`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:22:37.327949 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-cd1bd67e-c5cd-4507-b977-723a79540a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:37.419199 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1421/2826] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:22:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:22:37.432271 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304e442-779e-42a9-844b-4d6a2e857ed8 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:37.434507 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-3304e442-779e-42a9-844b-4d6a2e857ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:37.442620 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:22:37.501230 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304e442-779e-42a9-844b-4d6a2e857ed8 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:37.504294 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56f804-c2b0-4ffa-adf7-00e2fb674928 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:37.504906 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56f804-c2b0-4ffa-adf7-00e2fb674928 service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:37.505180 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56f804-c2b0-4ffa-adf7-00e2fb674928 service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:37.505448 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f56f804-c2b0-4ffa-adf7-00e2fb674928 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:37.577666 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f56f804-c2b0-4ffa-adf7-00e2fb674928 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:37.579163 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f56f804-c2b0-4ffa-adf7-00e2fb674928 service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:37.589086 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1406/2827] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:22:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:22:42.965055 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1bd67e-c5cd-4507-b977-723a79540a64 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:42.966558 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-cd1bd67e-c5cd-4507-b977-723a79540a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:42.979424 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1bd67e-c5cd-4507-b977-723a79540a64 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:42.983144 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051d636b-d646-4aae-9f03-f2902b1373fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:42.983772 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d636b-d646-4aae-9f03-f2902b1373fd service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:42.984053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d636b-d646-4aae-9f03-f2902b1373fd service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:42.984325 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051d636b-d646-4aae-9f03-f2902b1373fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:42.994140 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d636b-d646-4aae-9f03-f2902b1373fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:42.995849 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051d636b-d646-4aae-9f03-f2902b1373fd service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:43.005407 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1422/2828] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:22:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:22:47.639977 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=46 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:22:48.919765 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56f804-c2b0-4ffa-adf7-00e2fb674928 service cinder] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:48.983092 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f56f804-c2b0-4ffa-adf7-00e2fb674928 service cinder] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:48.987771 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff054b47-3c22-4895-afd0-7d356b112d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:48.988404 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff054b47-3c22-4895-afd0-7d356b112d44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:48.988686 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff054b47-3c22-4895-afd0-7d356b112d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:48.988961 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff054b47-3c22-4895-afd0-7d356b112d44 admin admin] PATH_INFO: `/v3/users/ef2eec6e45074a11843dd070808100be` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:48.990089 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff054b47-3c22-4895-afd0-7d356b112d44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef2eec6e45074a11843dd070808100be)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:48.992716 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff054b47-3c22-4895-afd0-7d356b112d44 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:49.149813 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-ff054b47-3c22-4895-afd0-7d356b112d44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef2eec6e45074a11843dd070808100be'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:49.150407 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-ff054b47-3c22-4895-afd0-7d356b112d44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef2eec6e45074a11843dd070808100be'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:49.157252 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-ff054b47-3c22-4895-afd0-7d356b112d44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef2eec6e45074a11843dd070808100be'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:49.157900 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-ff054b47-3c22-4895-afd0-7d356b112d44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef2eec6e45074a11843dd070808100be'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:49.216286 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-ff054b47-3c22-4895-afd0-7d356b112d44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef2eec6e45074a11843dd070808100be'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:49.242303 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1407/2829] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:22:48 2022] DELETE /identity/v3/users/ef2eec6e45074a11843dd070808100be => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:22:49.247417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d4ccf-fd6f-4028-be01-65beea1d8d64 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:49.247899 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d4ccf-fd6f-4028-be01-65beea1d8d64 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:49.247985 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d4ccf-fd6f-4028-be01-65beea1d8d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:49.268091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-e37d4ccf-fd6f-4028-be01-65beea1d8d64 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:22:49.269360 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-e37d4ccf-fd6f-4028-be01-65beea1d8d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:49.306746 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:22:49.333890 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1423/2830] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:22:49.344476 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff054b47-3c22-4895-afd0-7d356b112d44 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:49.345910 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-ff054b47-3c22-4895-afd0-7d356b112d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:49.407969 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff054b47-3c22-4895-afd0-7d356b112d44 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:49.411606 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eed7e3-b351-44fe-bb2e-dbe5a9ad3574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:49.412217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eed7e3-b351-44fe-bb2e-dbe5a9ad3574 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:49.412491 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eed7e3-b351-44fe-bb2e-dbe5a9ad3574 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:49.413418 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eed7e3-b351-44fe-bb2e-dbe5a9ad3574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:49.423139 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eed7e3-b351-44fe-bb2e-dbe5a9ad3574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:49.424581 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eed7e3-b351-44fe-bb2e-dbe5a9ad3574 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:49.435179 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1408/2831] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:22:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:22:49.842537 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d4ccf-fd6f-4028-be01-65beea1d8d64 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:49.843672 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-e37d4ccf-fd6f-4028-be01-65beea1d8d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:49.856742 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d4ccf-fd6f-4028-be01-65beea1d8d64 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:49.862816 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9a2ab-8886-4714-b86c-43ef5c637ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:49.863483 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9a2ab-8886-4714-b86c-43ef5c637ae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:49.863762 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9a2ab-8886-4714-b86c-43ef5c637ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:49.864036 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a9a2ab-8886-4714-b86c-43ef5c637ae4 admin admin] PATH_INFO: `/v3/projects/b4e19bea170e4d459e783639b6636afc` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:49.865268 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9a2ab-8886-4714-b86c-43ef5c637ae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4e19bea170e4d459e783639b6636afc)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:49.868366 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a9a2ab-8886-4714-b86c-43ef5c637ae4 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:50.011414 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-45a9a2ab-8886-4714-b86c-43ef5c637ae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4e19bea170e4d459e783639b6636afc', 'request_id': 'req-45a9a2ab-8886-4714-b86c-43ef5c637ae4'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:50.017524 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-45a9a2ab-8886-4714-b86c-43ef5c637ae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4e19bea170e4d459e783639b6636afc', 'request_id': 'req-45a9a2ab-8886-4714-b86c-43ef5c637ae4'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:50.107886 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-45a9a2ab-8886-4714-b86c-43ef5c637ae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4e19bea170e4d459e783639b6636afc', 'request_id': 'req-45a9a2ab-8886-4714-b86c-43ef5c637ae4'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:50.121316 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-45a9a2ab-8886-4714-b86c-43ef5c637ae4 admin admin] The token cache is being invalidate because project b4e19bea170e4d459e783639b6636afc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:22:50.121600 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-45a9a2ab-8886-4714-b86c-43ef5c637ae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:50.122246 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-45a9a2ab-8886-4714-b86c-43ef5c637ae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:50.124029 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1424/2832] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:22:49 2022] DELETE /identity/v3/projects/b4e19bea170e4d459e783639b6636afc => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:22:50.128095 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eed7e3-b351-44fe-bb2e-dbe5a9ad3574 service neutron] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:50.139354 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eed7e3-b351-44fe-bb2e-dbe5a9ad3574 service neutron] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:50.158592 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:22:50.197312 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31a12b-f843-4d8b-92bf-bcfc80cc1626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:50.197943 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31a12b-f843-4d8b-92bf-bcfc80cc1626 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:50.198218 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31a12b-f843-4d8b-92bf-bcfc80cc1626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:50.198491 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31a12b-f843-4d8b-92bf-bcfc80cc1626 admin admin] PATH_INFO: `/v3/users/a964366862dc412ebc7ab125c6c11aec` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:50.199636 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31a12b-f843-4d8b-92bf-bcfc80cc1626 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a964366862dc412ebc7ab125c6c11aec)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:50.201550 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31a12b-f843-4d8b-92bf-bcfc80cc1626 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:50.470699 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-5e31a12b-f843-4d8b-92bf-bcfc80cc1626 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a964366862dc412ebc7ab125c6c11aec'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:50.471404 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-5e31a12b-f843-4d8b-92bf-bcfc80cc1626 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a964366862dc412ebc7ab125c6c11aec'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:50.479033 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-5e31a12b-f843-4d8b-92bf-bcfc80cc1626 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a964366862dc412ebc7ab125c6c11aec'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:50.479690 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-5e31a12b-f843-4d8b-92bf-bcfc80cc1626 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a964366862dc412ebc7ab125c6c11aec'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:50.559254 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-5e31a12b-f843-4d8b-92bf-bcfc80cc1626 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a964366862dc412ebc7ab125c6c11aec'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:50.579015 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1409/2833] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:22:50 2022] DELETE /identity/v3/users/a964366862dc412ebc7ab125c6c11aec => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:22:51.177862 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9a2ab-8886-4714-b86c-43ef5c637ae4 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:51.179517 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-45a9a2ab-8886-4714-b86c-43ef5c637ae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:51.194953 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a9a2ab-8886-4714-b86c-43ef5c637ae4 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:51.253277 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227fba8-b091-4da0-9e4d-ea6b9e534487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:51.254030 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227fba8-b091-4da0-9e4d-ea6b9e534487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:51.254309 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227fba8-b091-4da0-9e4d-ea6b9e534487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:51.254580 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227fba8-b091-4da0-9e4d-ea6b9e534487 admin admin] PATH_INFO: `/v3/projects/fe0f39ebcd724cdab55f883975f055d6` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:51.255722 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7227fba8-b091-4da0-9e4d-ea6b9e534487 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe0f39ebcd724cdab55f883975f055d6)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:51.258216 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7227fba8-b091-4da0-9e4d-ea6b9e534487 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:51.411247 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-7227fba8-b091-4da0-9e4d-ea6b9e534487 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe0f39ebcd724cdab55f883975f055d6', 'request_id': 'req-7227fba8-b091-4da0-9e4d-ea6b9e534487'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:51.416995 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-7227fba8-b091-4da0-9e4d-ea6b9e534487 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe0f39ebcd724cdab55f883975f055d6', 'request_id': 'req-7227fba8-b091-4da0-9e4d-ea6b9e534487'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:51.420625 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:22:51.495741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-7227fba8-b091-4da0-9e4d-ea6b9e534487 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe0f39ebcd724cdab55f883975f055d6', 'request_id': 'req-7227fba8-b091-4da0-9e4d-ea6b9e534487'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:51.508441 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-7227fba8-b091-4da0-9e4d-ea6b9e534487 admin admin] The token cache is being invalidate because project fe0f39ebcd724cdab55f883975f055d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:22:51.508732 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-7227fba8-b091-4da0-9e4d-ea6b9e534487 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:51.509383 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-7227fba8-b091-4da0-9e4d-ea6b9e534487 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:51.510886 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1425/2834] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:22:51 2022] DELETE /identity/v3/projects/fe0f39ebcd724cdab55f883975f055d6 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:22:51.517237 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647156f-654f-4107-a232-8156031a54d6 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:51.517879 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647156f-654f-4107-a232-8156031a54d6 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:51.517879 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647156f-654f-4107-a232-8156031a54d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:51.539431 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-e647156f-654f-4107-a232-8156031a54d6 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:22:51.540659 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-e647156f-654f-4107-a232-8156031a54d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:51.601058 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1410/2835] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:22:51.610687 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1a65e-ec66-4cd0-8dc2-2c77ccf889dd None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:51.610972 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1a65e-ec66-4cd0-8dc2-2c77ccf889dd None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:51.611284 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf1a65e-ec66-4cd0-8dc2-2c77ccf889dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:51.632908 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-4bf1a65e-ec66-4cd0-8dc2-2c77ccf889dd None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:22:51.634277 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-4bf1a65e-ec66-4cd0-8dc2-2c77ccf889dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:51.642269 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1426/2836] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:22:51.646569 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647156f-654f-4107-a232-8156031a54d6 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:51.657897 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647156f-654f-4107-a232-8156031a54d6 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:51.663737 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca4dc1-9b14-4d3c-9ffc-b06a396d7b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:51.664360 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca4dc1-9b14-4d3c-9ffc-b06a396d7b18 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:51.664643 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca4dc1-9b14-4d3c-9ffc-b06a396d7b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:51.664910 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cca4dc1-9b14-4d3c-9ffc-b06a396d7b18 admin admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:51.665561 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca4dc1-9b14-4d3c-9ffc-b06a396d7b18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:22:51.665863 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca4dc1-9b14-4d3c-9ffc-b06a396d7b18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:51.667580 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cca4dc1-9b14-4d3c-9ffc-b06a396d7b18 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:51.680622 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1411/2837] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:22:51.685642 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf1a65e-ec66-4cd0-8dc2-2c77ccf889dd None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:51.695835 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf1a65e-ec66-4cd0-8dc2-2c77ccf889dd None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:51.700856 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a8e52-7a68-4b90-a8b9-023420d8171c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:51.701572 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a8e52-7a68-4b90-a8b9-023420d8171c admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:51.701860 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a8e52-7a68-4b90-a8b9-023420d8171c admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:51.702133 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00a8e52-7a68-4b90-a8b9-023420d8171c admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:51.702758 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a8e52-7a68-4b90-a8b9-023420d8171c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:51.704746 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00a8e52-7a68-4b90-a8b9-023420d8171c admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:51.789571 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1427/2838] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:22:51 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:22:51.794332 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca4dc1-9b14-4d3c-9ffc-b06a396d7b18 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:51.804657 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cca4dc1-9b14-4d3c-9ffc-b06a396d7b18 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:51.831876 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:22:51.870101 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414ef87-6f7a-4c57-8c08-795687d723b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:51.871762 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414ef87-6f7a-4c57-8c08-795687d723b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:51.871762 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414ef87-6f7a-4c57-8c08-795687d723b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:51.871762 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414ef87-6f7a-4c57-8c08-795687d723b1 admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:51.872070 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414ef87-6f7a-4c57-8c08-795687d723b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:51.873969 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414ef87-6f7a-4c57-8c08-795687d723b1 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:51.993835 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1412/2839] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:22:51 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:22:51.998506 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a8e52-7a68-4b90-a8b9-023420d8171c admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:52.009447 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00a8e52-7a68-4b90-a8b9-023420d8171c admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:52.014064 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d5b21-df01-4593-b333-531a08c17c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:52.014659 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d5b21-df01-4593-b333-531a08c17c3d admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:52.014935 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d5b21-df01-4593-b333-531a08c17c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:52.015249 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d5b21-df01-4593-b333-531a08c17c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:52.015891 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48d5b21-df01-4593-b333-531a08c17c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:52.017483 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48d5b21-df01-4593-b333-531a08c17c3d admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:52.028331 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1428/2840] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:22:52.032361 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414ef87-6f7a-4c57-8c08-795687d723b1 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:52.042661 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414ef87-6f7a-4c57-8c08-795687d723b1 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:52.047669 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc199f-f84c-4599-8842-516805d5a8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:52.048172 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc199f-f84c-4599-8842-516805d5a8ab admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:52.048448 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc199f-f84c-4599-8842-516805d5a8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:52.048716 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc199f-f84c-4599-8842-516805d5a8ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:52.049354 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc199f-f84c-4599-8842-516805d5a8ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:52.050941 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc199f-f84c-4599-8842-516805d5a8ab admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:52.061373 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1413/2841] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:22:52.066395 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d5b21-df01-4593-b333-531a08c17c3d admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:52.076223 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d5b21-df01-4593-b333-531a08c17c3d admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:52.080871 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904be3d8-4e37-4f54-afb0-4efacd55e930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:52.081529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904be3d8-4e37-4f54-afb0-4efacd55e930 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:52.081807 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904be3d8-4e37-4f54-afb0-4efacd55e930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:52.082080 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904be3d8-4e37-4f54-afb0-4efacd55e930 admin admin] PATH_INFO: `/v3/projects/ce4c2736bfda47b19ff964f55b970b8d/users/afa2f90137874a348d5cb0632da135c7/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:52.098347 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904be3d8-4e37-4f54-afb0-4efacd55e930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce4c2736bfda47b19ff964f55b970b8d, user_id=afa2f90137874a348d5cb0632da135c7, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:52.101412 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904be3d8-4e37-4f54-afb0-4efacd55e930 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:52.171063 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1429/2842] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:22:52 2022] PUT /identity/v3/projects/ce4c2736bfda47b19ff964f55b970b8d/users/afa2f90137874a348d5cb0632da135c7/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:22:52.244277 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6306c-176e-4aa5-ab41-5b873ecdb107 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:52.244494 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6306c-176e-4aa5-ab41-5b873ecdb107 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:52.244733 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff6306c-176e-4aa5-ab41-5b873ecdb107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:52.274403 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-7ff6306c-176e-4aa5-ab41-5b873ecdb107 None None] MFA Rules not processed for user `afa2f90137874a348d5cb0632da135c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:22:52.275669 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-7ff6306c-176e-4aa5-ab41-5b873ecdb107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:52.341436 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1414/2843] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:22:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:22:52.353536 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904be3d8-4e37-4f54-afb0-4efacd55e930 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:52.355345 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-904be3d8-4e37-4f54-afb0-4efacd55e930 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:52.413545 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904be3d8-4e37-4f54-afb0-4efacd55e930 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:52.417234 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d63b58-e940-4cdc-9bac-5e8057a47204 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:52.417841 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d63b58-e940-4cdc-9bac-5e8057a47204 service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:52.418117 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d63b58-e940-4cdc-9bac-5e8057a47204 service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:52.418444 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d63b58-e940-4cdc-9bac-5e8057a47204 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:52.426777 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d63b58-e940-4cdc-9bac-5e8057a47204 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:52.428737 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d63b58-e940-4cdc-9bac-5e8057a47204 service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:52.437674 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1430/2844] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:22:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:22:52.461909 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6306c-176e-4aa5-ab41-5b873ecdb107 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:52.523885 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff6306c-176e-4aa5-ab41-5b873ecdb107 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:52.528618 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e730297-aa99-48c8-a491-af69e1efe380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:52.529244 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e730297-aa99-48c8-a491-af69e1efe380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:52.529521 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e730297-aa99-48c8-a491-af69e1efe380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:52.529792 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e730297-aa99-48c8-a491-af69e1efe380 admin admin] PATH_INFO: `/v3/users/afa2f90137874a348d5cb0632da135c7` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:52.530924 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e730297-aa99-48c8-a491-af69e1efe380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afa2f90137874a348d5cb0632da135c7)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:52.532870 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e730297-aa99-48c8-a491-af69e1efe380 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:52.710354 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:22:52.716025 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-3e730297-aa99-48c8-a491-af69e1efe380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afa2f90137874a348d5cb0632da135c7'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:52.723646 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-3e730297-aa99-48c8-a491-af69e1efe380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afa2f90137874a348d5cb0632da135c7'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:52.723646 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-3e730297-aa99-48c8-a491-af69e1efe380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afa2f90137874a348d5cb0632da135c7'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:52.724096 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-3e730297-aa99-48c8-a491-af69e1efe380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afa2f90137874a348d5cb0632da135c7'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:52.770310 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-3e730297-aa99-48c8-a491-af69e1efe380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afa2f90137874a348d5cb0632da135c7'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:52.790225 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1415/2845] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:22:52 2022] DELETE /identity/v3/users/afa2f90137874a348d5cb0632da135c7 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:22:52.794701 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b5edf-d2ad-45af-8446-aad2e1d548e4 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:52.794988 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b5edf-d2ad-45af-8446-aad2e1d548e4 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:52.795293 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b5edf-d2ad-45af-8446-aad2e1d548e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:52.816147 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-b91b5edf-d2ad-45af-8446-aad2e1d548e4 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:22:52.817386 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-b91b5edf-d2ad-45af-8446-aad2e1d548e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:52.880526 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1431/2846] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:22:52.890782 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e730297-aa99-48c8-a491-af69e1efe380 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:52.892657 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-3e730297-aa99-48c8-a491-af69e1efe380 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:52.962298 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e730297-aa99-48c8-a491-af69e1efe380 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:52.965907 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f5fcb-d645-4f62-ac16-32224679d7bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:52.966513 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f5fcb-d645-4f62-ac16-32224679d7bb service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:52.966788 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f5fcb-d645-4f62-ac16-32224679d7bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:52.967055 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f5fcb-d645-4f62-ac16-32224679d7bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:52.977095 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f5fcb-d645-4f62-ac16-32224679d7bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:52.978547 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f5fcb-d645-4f62-ac16-32224679d7bb service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:52.988495 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1416/2847] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:22:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:22:53.401297 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b5edf-d2ad-45af-8446-aad2e1d548e4 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:53.402980 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-b91b5edf-d2ad-45af-8446-aad2e1d548e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:53.415556 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b5edf-d2ad-45af-8446-aad2e1d548e4 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:53.420635 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb846f3-e57e-4a30-9c9c-b2f11022a584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:53.421309 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb846f3-e57e-4a30-9c9c-b2f11022a584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:53.421591 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb846f3-e57e-4a30-9c9c-b2f11022a584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:53.421856 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb846f3-e57e-4a30-9c9c-b2f11022a584 admin admin] PATH_INFO: `/v3/projects/ce4c2736bfda47b19ff964f55b970b8d` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:53.423045 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb846f3-e57e-4a30-9c9c-b2f11022a584 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce4c2736bfda47b19ff964f55b970b8d)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:53.425636 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb846f3-e57e-4a30-9c9c-b2f11022a584 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:53.520578 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:22:53.542083 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-2bb846f3-e57e-4a30-9c9c-b2f11022a584 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce4c2736bfda47b19ff964f55b970b8d', 'request_id': 'req-2bb846f3-e57e-4a30-9c9c-b2f11022a584'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:53.550117 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-2bb846f3-e57e-4a30-9c9c-b2f11022a584 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce4c2736bfda47b19ff964f55b970b8d', 'request_id': 'req-2bb846f3-e57e-4a30-9c9c-b2f11022a584'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:53.617402 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-2bb846f3-e57e-4a30-9c9c-b2f11022a584 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce4c2736bfda47b19ff964f55b970b8d', 'request_id': 'req-2bb846f3-e57e-4a30-9c9c-b2f11022a584'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:53.630869 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-2bb846f3-e57e-4a30-9c9c-b2f11022a584 admin admin] The token cache is being invalidate because project ce4c2736bfda47b19ff964f55b970b8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:22:53.631844 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-2bb846f3-e57e-4a30-9c9c-b2f11022a584 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:53.632593 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-2bb846f3-e57e-4a30-9c9c-b2f11022a584 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:22:53.634095 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1432/2848] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:22:53 2022] DELETE /identity/v3/projects/ce4c2736bfda47b19ff964f55b970b8d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:22:53.639170 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14371dcf-be84-453b-8bcf-b4ce82d45019 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:53.639632 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14371dcf-be84-453b-8bcf-b4ce82d45019 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:53.639746 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14371dcf-be84-453b-8bcf-b4ce82d45019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:53.659661 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-14371dcf-be84-453b-8bcf-b4ce82d45019 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:22:53.660952 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-14371dcf-be84-453b-8bcf-b4ce82d45019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:53.722453 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1417/2849] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:22:53.730634 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2d2f0-d0fc-487a-b026-3d70cc309337 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:53.730917 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2d2f0-d0fc-487a-b026-3d70cc309337 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:53.731213 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2d2f0-d0fc-487a-b026-3d70cc309337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:53.751546 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-b6b2d2f0-d0fc-487a-b026-3d70cc309337 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:22:53.752774 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-b6b2d2f0-d0fc-487a-b026-3d70cc309337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:53.761225 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1433/2850] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:22:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:22:53.765499 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14371dcf-be84-453b-8bcf-b4ce82d45019 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:53.775668 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14371dcf-be84-453b-8bcf-b4ce82d45019 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:53.780740 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eda4a1-b6d8-479d-b6d1-93de0e209239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:53.781436 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eda4a1-b6d8-479d-b6d1-93de0e209239 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:53.781888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eda4a1-b6d8-479d-b6d1-93de0e209239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:53.782172 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eda4a1-b6d8-479d-b6d1-93de0e209239 admin admin] PATH_INFO: `/v3/domains` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:53.785862 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eda4a1-b6d8-479d-b6d1-93de0e209239 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81760) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:22:53.785862 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eda4a1-b6d8-479d-b6d1-93de0e209239 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:53.785862 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eda4a1-b6d8-479d-b6d1-93de0e209239 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:53.799560 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1418/2851] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:22:53.805075 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2d2f0-d0fc-487a-b026-3d70cc309337 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:53.814678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2d2f0-d0fc-487a-b026-3d70cc309337 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:53.820653 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce4c08-0229-46b0-af7d-142a80b37092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:53.821262 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce4c08-0229-46b0-af7d-142a80b37092 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:53.821540 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce4c08-0229-46b0-af7d-142a80b37092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:53.821814 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccce4c08-0229-46b0-af7d-142a80b37092 admin admin] PATH_INFO: `/v3/projects` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:53.822449 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce4c08-0229-46b0-af7d-142a80b37092 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:53.824392 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccce4c08-0229-46b0-af7d-142a80b37092 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:53.909074 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1434/2852] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:22:53 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:22:53.913386 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eda4a1-b6d8-479d-b6d1-93de0e209239 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:53.924018 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eda4a1-b6d8-479d-b6d1-93de0e209239 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:53.971892 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:22:53.985494 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf610f-8aff-45be-b860-19827e7f7744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:53.986301 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf610f-8aff-45be-b860-19827e7f7744 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:53.986581 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf610f-8aff-45be-b860-19827e7f7744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:53.986852 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf610f-8aff-45be-b860-19827e7f7744 admin admin] PATH_INFO: `/v3/users` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:53.987537 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf610f-8aff-45be-b860-19827e7f7744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:53.989450 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecf610f-8aff-45be-b860-19827e7f7744 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:54.085491 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1419/2853] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:22:53 2022] POST /identity/v3/users => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 17:22:54.089817 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce4c08-0229-46b0-af7d-142a80b37092 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:54.100641 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccce4c08-0229-46b0-af7d-142a80b37092 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:54.105372 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99af53b-5c2a-4459-a0de-723b46e976cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:54.105978 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99af53b-5c2a-4459-a0de-723b46e976cd admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:54.106253 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99af53b-5c2a-4459-a0de-723b46e976cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:54.106530 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99af53b-5c2a-4459-a0de-723b46e976cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:54.107201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99af53b-5c2a-4459-a0de-723b46e976cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:54.108806 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99af53b-5c2a-4459-a0de-723b46e976cd admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:54.120614 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1435/2854] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:22:54.130395 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf610f-8aff-45be-b860-19827e7f7744 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:54.141172 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecf610f-8aff-45be-b860-19827e7f7744 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:54.145750 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f7689-443b-4289-afd3-b189635a821d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:54.146352 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f7689-443b-4289-afd3-b189635a821d admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:54.146625 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f7689-443b-4289-afd3-b189635a821d admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:54.147055 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f7689-443b-4289-afd3-b189635a821d admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:54.147786 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f7689-443b-4289-afd3-b189635a821d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:54.149378 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0f7689-443b-4289-afd3-b189635a821d admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:54.161127 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1420/2855] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:22:54.165900 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99af53b-5c2a-4459-a0de-723b46e976cd admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:54.175920 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99af53b-5c2a-4459-a0de-723b46e976cd admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:54.181162 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb0d50-f873-4205-9c69-91e254fada56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:54.181829 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb0d50-f873-4205-9c69-91e254fada56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:54.182096 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb0d50-f873-4205-9c69-91e254fada56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:54.182390 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbb0d50-f873-4205-9c69-91e254fada56 admin admin] PATH_INFO: `/v3/projects/d2dd1fee94994a4cbd28e749b5dabba3/users/1cd74fb2401941deac53e8cc86210296/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:54.197187 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb0d50-f873-4205-9c69-91e254fada56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2dd1fee94994a4cbd28e749b5dabba3, user_id=1cd74fb2401941deac53e8cc86210296, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:54.199915 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbb0d50-f873-4205-9c69-91e254fada56 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:54.275135 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1436/2856] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:22:54 2022] PUT /identity/v3/projects/d2dd1fee94994a4cbd28e749b5dabba3/users/1cd74fb2401941deac53e8cc86210296/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:22:54.280541 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139da7bf-9b15-493e-9794-4bfead048ea8 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:54.280878 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139da7bf-9b15-493e-9794-4bfead048ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:54.281151 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139da7bf-9b15-493e-9794-4bfead048ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:54.301876 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-139da7bf-9b15-493e-9794-4bfead048ea8 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:22:54.303730 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-139da7bf-9b15-493e-9794-4bfead048ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:54.363607 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1421/2857] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:22:54.374165 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb0d50-f873-4205-9c69-91e254fada56 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:54.375922 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-4fbb0d50-f873-4205-9c69-91e254fada56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:54.435091 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbb0d50-f873-4205-9c69-91e254fada56 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:54.438830 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae375525-7883-4a75-bfb4-e9d7a9ee8f1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:54.439471 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae375525-7883-4a75-bfb4-e9d7a9ee8f1f service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:54.439752 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae375525-7883-4a75-bfb4-e9d7a9ee8f1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:54.440026 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae375525-7883-4a75-bfb4-e9d7a9ee8f1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:54.451996 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae375525-7883-4a75-bfb4-e9d7a9ee8f1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:54.453442 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae375525-7883-4a75-bfb4-e9d7a9ee8f1f service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:54.464858 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1437/2858] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:22:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:22:55.935989 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5594026-bd63-4c79-8d17-14d71ad2d761 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:55.936675 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5594026-bd63-4c79-8d17-14d71ad2d761 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:55.937189 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5594026-bd63-4c79-8d17-14d71ad2d761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:55.978496 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-a5594026-bd63-4c79-8d17-14d71ad2d761 None None] MFA Rules not processed for user `1cd74fb2401941deac53e8cc86210296`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:22:55.979788 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-a5594026-bd63-4c79-8d17-14d71ad2d761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:56.067337 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1422/2859] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:22:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:22:56.080031 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae375525-7883-4a75-bfb4-e9d7a9ee8f1f service neutron] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:56.082378 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-ae375525-7883-4a75-bfb4-e9d7a9ee8f1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:56.164735 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae375525-7883-4a75-bfb4-e9d7a9ee8f1f service neutron] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:56.169476 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8961b2-d531-4671-a039-0bf5bd6ccd0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:56.170515 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8961b2-d531-4671-a039-0bf5bd6ccd0b service cinder] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:56.171061 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8961b2-d531-4671-a039-0bf5bd6ccd0b service cinder] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:56.172891 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8961b2-d531-4671-a039-0bf5bd6ccd0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:56.181615 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:22:56.185133 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8961b2-d531-4671-a039-0bf5bd6ccd0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:56.186607 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8961b2-d531-4671-a039-0bf5bd6ccd0b service cinder] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:56.197976 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1438/2860] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:22:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:22:57.904827 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a4336-349f-4117-854e-07ba6d739ae1 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:57.905419 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a4336-349f-4117-854e-07ba6d739ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:57.905419 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a4336-349f-4117-854e-07ba6d739ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:57.925257 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-155a4336-349f-4117-854e-07ba6d739ae1 None None] MFA Rules not processed for user `1cd74fb2401941deac53e8cc86210296`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:22:57.926484 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-155a4336-349f-4117-854e-07ba6d739ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:57.934423 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1423/2861] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:22:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:22:58.178726 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8961b2-d531-4671-a039-0bf5bd6ccd0b service cinder] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:58.180269 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-7c8961b2-d531-4671-a039-0bf5bd6ccd0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:58.200340 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8961b2-d531-4671-a039-0bf5bd6ccd0b service cinder] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:58.206356 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1270f2-8f3e-4120-a419-5d368e570a8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:58.207454 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1270f2-8f3e-4120-a419-5d368e570a8b service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:58.207959 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1270f2-8f3e-4120-a419-5d368e570a8b service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:58.208454 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1270f2-8f3e-4120-a419-5d368e570a8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:58.211520 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-7c1270f2-8f3e-4120-a419-5d368e570a8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:58.222342 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1270f2-8f3e-4120-a419-5d368e570a8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:58.223819 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1270f2-8f3e-4120-a419-5d368e570a8b service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:58.233538 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1439/2862] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:22:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:22:58.936623 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a4336-349f-4117-854e-07ba6d739ae1 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:22:58.938195 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-155a4336-349f-4117-854e-07ba6d739ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:58.997942 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:22:59.020740 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a4336-349f-4117-854e-07ba6d739ae1 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:22:59.026805 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7442038-52f2-41f1-8d5d-e6648b13a9cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ef97356edf406aad9ab5f502bdb0af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:22:59.027456 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7442038-52f2-41f1-8d5d-e6648b13a9cf service placement] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:22:59.027732 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7442038-52f2-41f1-8d5d-e6648b13a9cf service placement] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:22:59.027998 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7442038-52f2-41f1-8d5d-e6648b13a9cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:22:59.029744 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-e7442038-52f2-41f1-8d5d-e6648b13a9cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:22:59.044545 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7442038-52f2-41f1-8d5d-e6648b13a9cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:22:59.046155 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7442038-52f2-41f1-8d5d-e6648b13a9cf service placement] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:22:59.057750 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1424/2863] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:22:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:23:08.229209 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=8 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:23:08.317127 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1270f2-8f3e-4120-a419-5d368e570a8b service neutron] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:08.318523 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-7c1270f2-8f3e-4120-a419-5d368e570a8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:23:08.394212 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1270f2-8f3e-4120-a419-5d368e570a8b service neutron] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:08.400429 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d6097-1f6b-42ce-afdb-49f72cdc7f7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:08.401050 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d6097-1f6b-42ce-afdb-49f72cdc7f7f service nova] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:08.401338 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d6097-1f6b-42ce-afdb-49f72cdc7f7f service nova] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:08.401604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d6097-1f6b-42ce-afdb-49f72cdc7f7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:08.403489 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-9e6d6097-1f6b-42ce-afdb-49f72cdc7f7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:23:08.418267 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6d6097-1f6b-42ce-afdb-49f72cdc7f7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:08.419911 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6d6097-1f6b-42ce-afdb-49f72cdc7f7f service nova] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:08.432292 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1440/2864] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:23:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:23:09.124325 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=10 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:23:16.401829 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ef2be-e536-4792-8a4e-1ac199fd84dc None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:16.402546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ef2be-e536-4792-8a4e-1ac199fd84dc None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:16.402546 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ef2be-e536-4792-8a4e-1ac199fd84dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:16.422241 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-569ef2be-e536-4792-8a4e-1ac199fd84dc None None] MFA Rules not processed for user `1cd74fb2401941deac53e8cc86210296`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:23:16.423479 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-569ef2be-e536-4792-8a4e-1ac199fd84dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:23:16.430378 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1425/2865] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:23:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:23:16.665295 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d6097-1f6b-42ce-afdb-49f72cdc7f7f service nova] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:16.674948 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d6097-1f6b-42ce-afdb-49f72cdc7f7f service nova] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:16.678667 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd3591-2591-41ef-b9f7-129b2464bfbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:16.679302 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd3591-2591-41ef-b9f7-129b2464bfbb service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:16.679581 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd3591-2591-41ef-b9f7-129b2464bfbb service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:16.679853 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cd3591-2591-41ef-b9f7-129b2464bfbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:16.681579 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-70cd3591-2591-41ef-b9f7-129b2464bfbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:23:16.691378 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd3591-2591-41ef-b9f7-129b2464bfbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:16.693972 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cd3591-2591-41ef-b9f7-129b2464bfbb service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:16.702207 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1441/2866] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:23:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:23:26.416628 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=3 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:23:26.698582 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=40 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:23:36.267600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17988c11-8339-446c-81d6-868da60c6725 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:36.268181 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17988c11-8339-446c-81d6-868da60c6725 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:36.268181 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17988c11-8339-446c-81d6-868da60c6725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:36.336298 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-17988c11-8339-446c-81d6-868da60c6725 None None] MFA Rules not processed for user `ae9fc5f06a0441da80e656fa1e88db5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:23:36.337528 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-17988c11-8339-446c-81d6-868da60c6725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:23:36.406170 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1426/2867] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Aug 24 17:23:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:23:36.586199 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd3591-2591-41ef-b9f7-129b2464bfbb service neutron] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:36.589650 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-70cd3591-2591-41ef-b9f7-129b2464bfbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:23:36.688627 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cd3591-2591-41ef-b9f7-129b2464bfbb service neutron] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:36.695525 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec920a39-3e0d-42a0-bc7d-016e662f9694 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c067bc2d84b741d08ac47e40adae4b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:36.696256 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec920a39-3e0d-42a0-bc7d-016e662f9694 service swift] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:36.696544 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec920a39-3e0d-42a0-bc7d-016e662f9694 service swift] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:36.696818 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec920a39-3e0d-42a0-bc7d-016e662f9694 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:36.706040 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec920a39-3e0d-42a0-bc7d-016e662f9694 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:36.707655 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec920a39-3e0d-42a0-bc7d-016e662f9694 service swift] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:36.716878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1442/2868] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Aug 24 17:23:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:23:46.403122 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=44 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:23:46.712889 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=41 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:23:55.089217 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f39769-6585-4d3b-b296-7ce8950720d8 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:55.090091 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f39769-6585-4d3b-b296-7ce8950720d8 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:55.090273 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f39769-6585-4d3b-b296-7ce8950720d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:55.111048 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-a5f39769-6585-4d3b-b296-7ce8950720d8 None None] MFA Rules not processed for user `ae9fc5f06a0441da80e656fa1e88db5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:23:55.112371 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-a5f39769-6585-4d3b-b296-7ce8950720d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:23:55.121005 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1427/2869] 10.222.0.55 () {58 vars in 967 bytes} [Wed Aug 24 17:23:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:23:55.137514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec920a39-3e0d-42a0-bc7d-016e662f9694 service swift] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:55.149682 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec920a39-3e0d-42a0-bc7d-016e662f9694 service swift] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:55.155010 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63df40-3c17-49ba-8e90-e86e4d187eef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c067bc2d84b741d08ac47e40adae4b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:55.155653 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63df40-3c17-49ba-8e90-e86e4d187eef service swift] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:55.155968 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63df40-3c17-49ba-8e90-e86e4d187eef service swift] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:55.156249 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63df40-3c17-49ba-8e90-e86e4d187eef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:55.165812 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63df40-3c17-49ba-8e90-e86e4d187eef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:55.167453 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63df40-3c17-49ba-8e90-e86e4d187eef service swift] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:55.178012 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1443/2870] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Aug 24 17:23:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 17:23:58.296955 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f39769-6585-4d3b-b296-7ce8950720d8 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:58.298443 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-a5f39769-6585-4d3b-b296-7ce8950720d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:23:58.314928 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f39769-6585-4d3b-b296-7ce8950720d8 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:58.321359 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110210e-1826-45a0-a324-ada7b8ef4ef1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ef97356edf406aad9ab5f502bdb0af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:58.322396 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110210e-1826-45a0-a324-ada7b8ef4ef1 service placement] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:58.322902 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110210e-1826-45a0-a324-ada7b8ef4ef1 service placement] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:58.323307 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110210e-1826-45a0-a324-ada7b8ef4ef1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:58.325075 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-c110210e-1826-45a0-a324-ada7b8ef4ef1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:23:58.340611 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110210e-1826-45a0-a324-ada7b8ef4ef1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:58.342340 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110210e-1826-45a0-a324-ada7b8ef4ef1 service placement] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:58.354538 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1428/2871] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:23:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:23:58.428132 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63df40-3c17-49ba-8e90-e86e4d187eef service swift] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:58.440763 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63df40-3c17-49ba-8e90-e86e4d187eef service swift] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:58.447171 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4089ffd-1363-4fba-a765-5e5a0fae5d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:58.447848 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4089ffd-1363-4fba-a765-5e5a0fae5d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:58.448135 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4089ffd-1363-4fba-a765-5e5a0fae5d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:58.448403 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4089ffd-1363-4fba-a765-5e5a0fae5d4a admin admin] PATH_INFO: `/v3/users/1cd74fb2401941deac53e8cc86210296` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:58.449548 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4089ffd-1363-4fba-a765-5e5a0fae5d4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cd74fb2401941deac53e8cc86210296)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:58.451512 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4089ffd-1363-4fba-a765-5e5a0fae5d4a admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:58.663847 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-a4089ffd-1363-4fba-a765-5e5a0fae5d4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cd74fb2401941deac53e8cc86210296'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:58.674228 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-a4089ffd-1363-4fba-a765-5e5a0fae5d4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cd74fb2401941deac53e8cc86210296'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:58.814038 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-a4089ffd-1363-4fba-a765-5e5a0fae5d4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cd74fb2401941deac53e8cc86210296'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:58.814665 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-a4089ffd-1363-4fba-a765-5e5a0fae5d4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cd74fb2401941deac53e8cc86210296'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:58.815316 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-a4089ffd-1363-4fba-a765-5e5a0fae5d4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cd74fb2401941deac53e8cc86210296'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:58.834378 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1444/2872] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:23:58 2022] DELETE /identity/v3/users/1cd74fb2401941deac53e8cc86210296 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:23:59.141644 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110210e-1826-45a0-a324-ada7b8ef4ef1 service placement] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:59.152816 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110210e-1826-45a0-a324-ada7b8ef4ef1 service placement] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:59.213539 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598049a6-fbd7-4402-92e1-9d815802f6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:59.214076 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598049a6-fbd7-4402-92e1-9d815802f6a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:59.214353 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598049a6-fbd7-4402-92e1-9d815802f6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:59.214640 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598049a6-fbd7-4402-92e1-9d815802f6a3 admin admin] PATH_INFO: `/v3/projects/d2dd1fee94994a4cbd28e749b5dabba3` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:59.215770 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598049a6-fbd7-4402-92e1-9d815802f6a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2dd1fee94994a4cbd28e749b5dabba3)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:59.217700 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598049a6-fbd7-4402-92e1-9d815802f6a3 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:59.329096 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-598049a6-fbd7-4402-92e1-9d815802f6a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2dd1fee94994a4cbd28e749b5dabba3', 'request_id': 'req-598049a6-fbd7-4402-92e1-9d815802f6a3'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:59.334730 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-598049a6-fbd7-4402-92e1-9d815802f6a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2dd1fee94994a4cbd28e749b5dabba3', 'request_id': 'req-598049a6-fbd7-4402-92e1-9d815802f6a3'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:59.341172 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-598049a6-fbd7-4402-92e1-9d815802f6a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2dd1fee94994a4cbd28e749b5dabba3', 'request_id': 'req-598049a6-fbd7-4402-92e1-9d815802f6a3'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:59.448443 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-598049a6-fbd7-4402-92e1-9d815802f6a3 admin admin] The token cache is being invalidate because project d2dd1fee94994a4cbd28e749b5dabba3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:23:59.448733 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-598049a6-fbd7-4402-92e1-9d815802f6a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:59.449507 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-598049a6-fbd7-4402-92e1-9d815802f6a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:23:59.451006 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1429/2873] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:23:59 2022] DELETE /identity/v3/projects/d2dd1fee94994a4cbd28e749b5dabba3 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:23:59.456193 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4247cf3-b52e-4b07-a2c1-c247ecd5ad07 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:59.460504 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4247cf3-b52e-4b07-a2c1-c247ecd5ad07 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:59.460504 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4247cf3-b52e-4b07-a2c1-c247ecd5ad07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:59.480968 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-f4247cf3-b52e-4b07-a2c1-c247ecd5ad07 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:23:59.482109 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-f4247cf3-b52e-4b07-a2c1-c247ecd5ad07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:23:59.545607 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1445/2874] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:23:59.554421 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7799c-8037-4659-80b8-cc03f1cbcfda None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:59.554706 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7799c-8037-4659-80b8-cc03f1cbcfda None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:59.554986 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7799c-8037-4659-80b8-cc03f1cbcfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:59.576891 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-37f7799c-8037-4659-80b8-cc03f1cbcfda None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:23:59.578112 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-37f7799c-8037-4659-80b8-cc03f1cbcfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:23:59.587088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1430/2875] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:23:59.591544 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4247cf3-b52e-4b07-a2c1-c247ecd5ad07 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:59.602373 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4247cf3-b52e-4b07-a2c1-c247ecd5ad07 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:59.606978 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4c092-17bc-4457-bd16-806e3e073569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:59.607629 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4c092-17bc-4457-bd16-806e3e073569 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:59.607934 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4c092-17bc-4457-bd16-806e3e073569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:59.608203 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d4c092-17bc-4457-bd16-806e3e073569 admin admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:59.608841 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4c092-17bc-4457-bd16-806e3e073569 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:23:59.609139 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4c092-17bc-4457-bd16-806e3e073569 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:59.610722 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d4c092-17bc-4457-bd16-806e3e073569 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:59.622705 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1446/2876] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:23:59.627219 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7799c-8037-4659-80b8-cc03f1cbcfda None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:59.637100 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7799c-8037-4659-80b8-cc03f1cbcfda None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:59.641979 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c502eaf-c900-4bf7-944e-a3f1ad8197d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:59.642590 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c502eaf-c900-4bf7-944e-a3f1ad8197d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:59.642872 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c502eaf-c900-4bf7-944e-a3f1ad8197d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:59.643176 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c502eaf-c900-4bf7-944e-a3f1ad8197d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:59.643812 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c502eaf-c900-4bf7-944e-a3f1ad8197d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:59.646325 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c502eaf-c900-4bf7-944e-a3f1ad8197d9 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:59.753080 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1431/2877] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:23:59 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:23:59.757445 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4c092-17bc-4457-bd16-806e3e073569 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:59.768020 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d4c092-17bc-4457-bd16-806e3e073569 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:59.813053 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:23:59.825317 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a8bff-e303-4d14-873b-77ba75b095b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:59.825915 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a8bff-e303-4d14-873b-77ba75b095b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:59.826196 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a8bff-e303-4d14-873b-77ba75b095b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:59.826459 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a8bff-e303-4d14-873b-77ba75b095b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:59.827090 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a8bff-e303-4d14-873b-77ba75b095b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:59.829024 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a8bff-e303-4d14-873b-77ba75b095b7 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:59.904854 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1447/2878] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:23:59 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:23:59.909151 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c502eaf-c900-4bf7-944e-a3f1ad8197d9 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:59.920838 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c502eaf-c900-4bf7-944e-a3f1ad8197d9 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:59.925539 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7126d-299c-4284-a1af-e203b49f1957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:59.926302 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7126d-299c-4284-a1af-e203b49f1957 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:59.926666 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7126d-299c-4284-a1af-e203b49f1957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:59.926886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7126d-299c-4284-a1af-e203b49f1957 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:59.927574 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7126d-299c-4284-a1af-e203b49f1957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:59.929186 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7126d-299c-4284-a1af-e203b49f1957 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:59.939833 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1432/2879] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:23:59.945167 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a8bff-e303-4d14-873b-77ba75b095b7 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:23:59.963907 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a8bff-e303-4d14-873b-77ba75b095b7 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:23:59.968924 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfe2f0-5653-4f42-98da-8886745e4d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:23:59.969543 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfe2f0-5653-4f42-98da-8886745e4d37 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:23:59.971479 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfe2f0-5653-4f42-98da-8886745e4d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:23:59.971479 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfe2f0-5653-4f42-98da-8886745e4d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:23:59.971479 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfe2f0-5653-4f42-98da-8886745e4d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:23:59.972387 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfe2f0-5653-4f42-98da-8886745e4d37 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:23:59.985044 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1448/2880] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:23:59.989886 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7126d-299c-4284-a1af-e203b49f1957 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:00.000417 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7126d-299c-4284-a1af-e203b49f1957 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:00.009458 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e1d5e-dd64-414c-ba33-26c201d4e307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:00.010060 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e1d5e-dd64-414c-ba33-26c201d4e307 admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:00.010364 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e1d5e-dd64-414c-ba33-26c201d4e307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:00.010734 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e1d5e-dd64-414c-ba33-26c201d4e307 admin admin] PATH_INFO: `/v3/projects/1bb4f35878a04b1ba27c92f340b8e26d/users/5f13131354c047639878752e25ec159b/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:00.027595 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e1d5e-dd64-414c-ba33-26c201d4e307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bb4f35878a04b1ba27c92f340b8e26d, user_id=5f13131354c047639878752e25ec159b, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:00.030534 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e1d5e-dd64-414c-ba33-26c201d4e307 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:00.117921 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1433/2881] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:23:59 2022] PUT /identity/v3/projects/1bb4f35878a04b1ba27c92f340b8e26d/users/5f13131354c047639878752e25ec159b/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:24:00.128317 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a84ec7-c9f6-4a00-af76-4879046adfad None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:00.128604 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a84ec7-c9f6-4a00-af76-4879046adfad None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:00.129480 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a84ec7-c9f6-4a00-af76-4879046adfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:00.157332 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-20a84ec7-c9f6-4a00-af76-4879046adfad None None] MFA Rules not processed for user `5f13131354c047639878752e25ec159b`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:00.158562 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-20a84ec7-c9f6-4a00-af76-4879046adfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:00.222411 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1449/2882] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:24:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:24:00.233928 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e1d5e-dd64-414c-ba33-26c201d4e307 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:00.235646 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-b37e1d5e-dd64-414c-ba33-26c201d4e307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:00.247835 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:00.296769 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e1d5e-dd64-414c-ba33-26c201d4e307 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:00.301535 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28b22ca-6369-4c0b-9862-08d02f09bb17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eb911b8748844a6488811ca03cb8d344', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:00.302138 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b22ca-6369-4c0b-9862-08d02f09bb17 service cinder] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:00.302411 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b22ca-6369-4c0b-9862-08d02f09bb17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:00.302678 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28b22ca-6369-4c0b-9862-08d02f09bb17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:00.311665 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b22ca-6369-4c0b-9862-08d02f09bb17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:00.317076 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28b22ca-6369-4c0b-9862-08d02f09bb17 service cinder] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:00.322686 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1434/2883] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:24:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:24:00.347350 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a84ec7-c9f6-4a00-af76-4879046adfad None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:00.412514 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a84ec7-c9f6-4a00-af76-4879046adfad None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:00.418079 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e692d4-7810-4ce9-bda8-a2ecf42a55fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:00.418937 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e692d4-7810-4ce9-bda8-a2ecf42a55fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:00.419417 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e692d4-7810-4ce9-bda8-a2ecf42a55fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:00.419814 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e692d4-7810-4ce9-bda8-a2ecf42a55fe admin admin] PATH_INFO: `/v3/users/5f13131354c047639878752e25ec159b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:00.420994 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e692d4-7810-4ce9-bda8-a2ecf42a55fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f13131354c047639878752e25ec159b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:00.423932 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e692d4-7810-4ce9-bda8-a2ecf42a55fe admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:00.611914 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-92e692d4-7810-4ce9-bda8-a2ecf42a55fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f13131354c047639878752e25ec159b'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:24:00.621448 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-92e692d4-7810-4ce9-bda8-a2ecf42a55fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f13131354c047639878752e25ec159b'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:24:00.623200 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:00.700075 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-92e692d4-7810-4ce9-bda8-a2ecf42a55fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f13131354c047639878752e25ec159b'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:24:00.700705 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-92e692d4-7810-4ce9-bda8-a2ecf42a55fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f13131354c047639878752e25ec159b'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:24:00.701335 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-92e692d4-7810-4ce9-bda8-a2ecf42a55fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f13131354c047639878752e25ec159b'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:24:00.720495 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1450/2884] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:24:00 2022] DELETE /identity/v3/users/5f13131354c047639878752e25ec159b => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 17:24:00.725934 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d6c39-dc55-4173-bfed-2ececc6d08cc None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:00.726455 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d6c39-dc55-4173-bfed-2ececc6d08cc None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:00.726455 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d6c39-dc55-4173-bfed-2ececc6d08cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:00.747226 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-0c4d6c39-dc55-4173-bfed-2ececc6d08cc None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:00.748451 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-0c4d6c39-dc55-4173-bfed-2ececc6d08cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:00.810323 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1435/2885] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:24:00.820557 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e692d4-7810-4ce9-bda8-a2ecf42a55fe admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:00.821970 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-92e692d4-7810-4ce9-bda8-a2ecf42a55fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:00.889167 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e692d4-7810-4ce9-bda8-a2ecf42a55fe admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:00.892620 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1b7de4-bd85-486a-99eb-80f109d3d984 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:00.893224 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b7de4-bd85-486a-99eb-80f109d3d984 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:00.893502 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b7de4-bd85-486a-99eb-80f109d3d984 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:00.893766 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1b7de4-bd85-486a-99eb-80f109d3d984 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:00.903612 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b7de4-bd85-486a-99eb-80f109d3d984 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:00.904999 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1b7de4-bd85-486a-99eb-80f109d3d984 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:00.915941 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1451/2886] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:24:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:24:01.339078 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d6c39-dc55-4173-bfed-2ececc6d08cc None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:01.340626 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-0c4d6c39-dc55-4173-bfed-2ececc6d08cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:01.355359 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d6c39-dc55-4173-bfed-2ececc6d08cc None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:01.363861 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da994515-331f-440e-8e55-a28a6583cfe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:01.364649 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da994515-331f-440e-8e55-a28a6583cfe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:01.371884 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da994515-331f-440e-8e55-a28a6583cfe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:01.371884 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da994515-331f-440e-8e55-a28a6583cfe1 admin admin] PATH_INFO: `/v3/projects/1bb4f35878a04b1ba27c92f340b8e26d` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:01.371884 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da994515-331f-440e-8e55-a28a6583cfe1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bb4f35878a04b1ba27c92f340b8e26d)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:01.371884 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da994515-331f-440e-8e55-a28a6583cfe1 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:01.508749 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-da994515-331f-440e-8e55-a28a6583cfe1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bb4f35878a04b1ba27c92f340b8e26d', 'request_id': 'req-da994515-331f-440e-8e55-a28a6583cfe1'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:24:01.514109 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-da994515-331f-440e-8e55-a28a6583cfe1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bb4f35878a04b1ba27c92f340b8e26d', 'request_id': 'req-da994515-331f-440e-8e55-a28a6583cfe1'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:24:01.521027 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-da994515-331f-440e-8e55-a28a6583cfe1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bb4f35878a04b1ba27c92f340b8e26d', 'request_id': 'req-da994515-331f-440e-8e55-a28a6583cfe1'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:24:01.603251 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-da994515-331f-440e-8e55-a28a6583cfe1 admin admin] The token cache is being invalidate because project 1bb4f35878a04b1ba27c92f340b8e26d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81760) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:24:01.603574 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-da994515-331f-440e-8e55-a28a6583cfe1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:24:01.604197 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-da994515-331f-440e-8e55-a28a6583cfe1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:24:01.605682 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1436/2887] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:24:01 2022] DELETE /identity/v3/projects/1bb4f35878a04b1ba27c92f340b8e26d => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:24:01.610821 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574f57e-95a4-40be-8455-a87502279ec7 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:01.611152 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574f57e-95a4-40be-8455-a87502279ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:01.611433 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574f57e-95a4-40be-8455-a87502279ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:01.632924 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-5574f57e-95a4-40be-8455-a87502279ec7 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:01.641003 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-5574f57e-95a4-40be-8455-a87502279ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:01.702823 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1452/2888] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:24:01.712266 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a102e-23dc-4dcf-9830-99a8bbe27830 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:01.712579 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a102e-23dc-4dcf-9830-99a8bbe27830 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:01.712846 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a102e-23dc-4dcf-9830-99a8bbe27830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:01.733175 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-b88a102e-23dc-4dcf-9830-99a8bbe27830 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:01.739017 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-b88a102e-23dc-4dcf-9830-99a8bbe27830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:01.743204 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1437/2889] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:24:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:24:01.747528 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574f57e-95a4-40be-8455-a87502279ec7 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:01.760251 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574f57e-95a4-40be-8455-a87502279ec7 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:01.765016 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf643d-4a92-49f5-bb1f-7d54a5bed6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:01.765627 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf643d-4a92-49f5-bb1f-7d54a5bed6df admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:01.765910 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf643d-4a92-49f5-bb1f-7d54a5bed6df admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:01.766183 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf643d-4a92-49f5-bb1f-7d54a5bed6df admin admin] PATH_INFO: `/v3/domains` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:01.766833 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf643d-4a92-49f5-bb1f-7d54a5bed6df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81761) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 17:24:01.767171 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf643d-4a92-49f5-bb1f-7d54a5bed6df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:01.768770 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faf643d-4a92-49f5-bb1f-7d54a5bed6df admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:01.781320 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1453/2890] 10.222.0.55 () {58 vars in 1153 bytes} [Wed Aug 24 17:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 17:24:01.785561 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a102e-23dc-4dcf-9830-99a8bbe27830 None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:01.795164 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a102e-23dc-4dcf-9830-99a8bbe27830 None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:01.799833 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428e987-d78f-4c36-92a3-74417eeb4dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:01.800451 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428e987-d78f-4c36-92a3-74417eeb4dc5 admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:01.801338 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428e987-d78f-4c36-92a3-74417eeb4dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:01.801614 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c428e987-d78f-4c36-92a3-74417eeb4dc5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:01.802350 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428e987-d78f-4c36-92a3-74417eeb4dc5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:01.804296 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c428e987-d78f-4c36-92a3-74417eeb4dc5 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:02.078518 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1438/2891] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:24:01 2022] POST /identity/v3/projects => generated 385 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:24:02.087697 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf643d-4a92-49f5-bb1f-7d54a5bed6df admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:02.092947 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf643d-4a92-49f5-bb1f-7d54a5bed6df admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:02.151797 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f885c-9b91-433a-afee-024d708b6ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:02.152400 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f885c-9b91-433a-afee-024d708b6ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:02.152678 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f885c-9b91-433a-afee-024d708b6ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:02.152950 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f885c-9b91-433a-afee-024d708b6ec5 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:02.153601 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f885c-9b91-433a-afee-024d708b6ec5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:02.155542 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f885c-9b91-433a-afee-024d708b6ec5 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:02.165957 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:02.357210 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1454/2892] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:24:02 2022] POST /identity/v3/users => generated 293 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:24:02.361687 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428e987-d78f-4c36-92a3-74417eeb4dc5 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:02.369208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:02.374277 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c428e987-d78f-4c36-92a3-74417eeb4dc5 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:02.379208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83ef82-2b3d-4a40-9f3a-e0e4114f0c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:02.379819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83ef82-2b3d-4a40-9f3a-e0e4114f0c89 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:02.380098 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83ef82-2b3d-4a40-9f3a-e0e4114f0c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:02.381594 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83ef82-2b3d-4a40-9f3a-e0e4114f0c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:02.382250 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83ef82-2b3d-4a40-9f3a-e0e4114f0c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:02.383940 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83ef82-2b3d-4a40-9f3a-e0e4114f0c89 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:02.394392 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1439/2893] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:24:02.405015 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f885c-9b91-433a-afee-024d708b6ec5 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:02.415422 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f885c-9b91-433a-afee-024d708b6ec5 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:02.420033 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906de3a-3825-4e99-ad60-c03b71fe8c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:02.420643 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906de3a-3825-4e99-ad60-c03b71fe8c30 admin admin] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:02.420898 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906de3a-3825-4e99-ad60-c03b71fe8c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:02.421166 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906de3a-3825-4e99-ad60-c03b71fe8c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:02.421803 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906de3a-3825-4e99-ad60-c03b71fe8c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:02.423425 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906de3a-3825-4e99-ad60-c03b71fe8c30 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:02.434493 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1455/2894] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:24:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:24:02.438913 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83ef82-2b3d-4a40-9f3a-e0e4114f0c89 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:02.450145 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83ef82-2b3d-4a40-9f3a-e0e4114f0c89 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:02.455022 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9a039-cfc5-4f1d-86ce-2a242043d2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:02.455722 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9a039-cfc5-4f1d-86ce-2a242043d2cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:02.455999 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9a039-cfc5-4f1d-86ce-2a242043d2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:02.456274 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee9a039-cfc5-4f1d-86ce-2a242043d2cf admin admin] PATH_INFO: `/v3/projects/cf3d0ccab3dd40e7b5bce40ee7f98cf8/users/d302486e019449f7b360f1bfd020756a/roles/d886d117c82147e6a6488228fee2ac8b` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:02.471691 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9a039-cfc5-4f1d-86ce-2a242043d2cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf3d0ccab3dd40e7b5bce40ee7f98cf8, user_id=d302486e019449f7b360f1bfd020756a, role_id=d886d117c82147e6a6488228fee2ac8b)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:02.474343 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee9a039-cfc5-4f1d-86ce-2a242043d2cf admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:02.568994 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1440/2895] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:24:02 2022] PUT /identity/v3/projects/cf3d0ccab3dd40e7b5bce40ee7f98cf8/users/d302486e019449f7b360f1bfd020756a/roles/d886d117c82147e6a6488228fee2ac8b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:24:02.574411 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27157008-b042-4301-b534-90def0ad6074 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:02.574695 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27157008-b042-4301-b534-90def0ad6074 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:02.574967 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27157008-b042-4301-b534-90def0ad6074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:02.595351 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-27157008-b042-4301-b534-90def0ad6074 None None] MFA Rules not processed for user `7d59f8996a11403d9a7359000be8b8ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:02.596576 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-27157008-b042-4301-b534-90def0ad6074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:02.658525 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1456/2896] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:24:02.669007 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9a039-cfc5-4f1d-86ce-2a242043d2cf admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:02.670823 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-8ee9a039-cfc5-4f1d-86ce-2a242043d2cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:02.729877 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee9a039-cfc5-4f1d-86ce-2a242043d2cf admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:02.733686 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73bef6-5d12-4b84-b7e3-bcd4e50358de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:02.734283 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73bef6-5d12-4b84-b7e3-bcd4e50358de service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:02.734556 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73bef6-5d12-4b84-b7e3-bcd4e50358de service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:02.734822 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73bef6-5d12-4b84-b7e3-bcd4e50358de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:02.745454 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73bef6-5d12-4b84-b7e3-bcd4e50358de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:02.746917 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73bef6-5d12-4b84-b7e3-bcd4e50358de service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:02.757830 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1441/2897] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:24:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:24:08.662794 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022329e9-8493-41f6-921c-58a6ff828363 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:08.666141 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022329e9-8493-41f6-921c-58a6ff828363 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:08.666141 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022329e9-8493-41f6-921c-58a6ff828363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:08.694553 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-022329e9-8493-41f6-921c-58a6ff828363 None None] MFA Rules not processed for user `d302486e019449f7b360f1bfd020756a`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:08.700683 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-022329e9-8493-41f6-921c-58a6ff828363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:08.771571 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1457/2898] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:24:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:24:08.776370 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73bef6-5d12-4b84-b7e3-bcd4e50358de service neutron] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:08.786817 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73bef6-5d12-4b84-b7e3-bcd4e50358de service neutron] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:08.792225 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc8596-5c0f-481d-b671-f916257cd7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:08.792831 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc8596-5c0f-481d-b671-f916257cd7fe admin admin] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:08.793106 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc8596-5c0f-481d-b671-f916257cd7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:08.793376 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc8596-5c0f-481d-b671-f916257cd7fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:08.793997 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc8596-5c0f-481d-b671-f916257cd7fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:08.796005 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc8596-5c0f-481d-b671-f916257cd7fe admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:08.885615 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1442/2899] 10.222.0.55 () {60 vars in 1153 bytes} [Wed Aug 24 17:24:08 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:24:08.889847 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022329e9-8493-41f6-921c-58a6ff828363 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:08.902223 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022329e9-8493-41f6-921c-58a6ff828363 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:08.962679 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abad8a-fb9b-4b40-9dfb-c15be82faeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:08.963340 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abad8a-fb9b-4b40-9dfb-c15be82faeb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:08.963619 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abad8a-fb9b-4b40-9dfb-c15be82faeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:08.963891 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52abad8a-fb9b-4b40-9dfb-c15be82faeb6 admin admin] PATH_INFO: `/v3/users` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:08.964529 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abad8a-fb9b-4b40-9dfb-c15be82faeb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:08.966495 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52abad8a-fb9b-4b40-9dfb-c15be82faeb6 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:09.065673 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1458/2900] 10.222.0.55 () {60 vars in 1144 bytes} [Wed Aug 24 17:24:08 2022] POST /identity/v3/users => generated 299 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 17:24:09.072205 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc8596-5c0f-481d-b671-f916257cd7fe admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:09.083037 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc8596-5c0f-481d-b671-f916257cd7fe admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:09.088021 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22fcdd-3683-42ee-ae69-777a0f7acb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:09.088637 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22fcdd-3683-42ee-ae69-777a0f7acb07 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:09.088920 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22fcdd-3683-42ee-ae69-777a0f7acb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:09.089195 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b22fcdd-3683-42ee-ae69-777a0f7acb07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:09.089844 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b22fcdd-3683-42ee-ae69-777a0f7acb07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:09.091578 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b22fcdd-3683-42ee-ae69-777a0f7acb07 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:09.102720 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1443/2901] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 17:24:09.106910 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abad8a-fb9b-4b40-9dfb-c15be82faeb6 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:09.112090 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:09.118830 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52abad8a-fb9b-4b40-9dfb-c15be82faeb6 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:09.123741 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e19d4-a457-45b1-a6c7-b5632db2b7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:09.124394 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e19d4-a457-45b1-a6c7-b5632db2b7ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:09.124674 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e19d4-a457-45b1-a6c7-b5632db2b7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:09.124948 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e19d4-a457-45b1-a6c7-b5632db2b7ab admin admin] PATH_INFO: `/v3/projects/9d6e7e6a584f45968990ff36364413f8/users/0b5342488b7d4417ba3b1d39b871b520/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:09.140680 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e19d4-a457-45b1-a6c7-b5632db2b7ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d6e7e6a584f45968990ff36364413f8, user_id=0b5342488b7d4417ba3b1d39b871b520, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:09.143375 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e19d4-a457-45b1-a6c7-b5632db2b7ab admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:09.214640 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1459/2902] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:24:09 2022] PUT /identity/v3/projects/9d6e7e6a584f45968990ff36364413f8/users/0b5342488b7d4417ba3b1d39b871b520/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:24:09.218723 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22fcdd-3683-42ee-ae69-777a0f7acb07 admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:09.229157 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b22fcdd-3683-42ee-ae69-777a0f7acb07 admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:09.305375 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461166df-8fc0-433c-a970-8aad125a2669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:09.306010 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461166df-8fc0-433c-a970-8aad125a2669 admin admin] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:09.306289 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461166df-8fc0-433c-a970-8aad125a2669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:09.306560 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461166df-8fc0-433c-a970-8aad125a2669 admin admin] PATH_INFO: `/v3/roles` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:09.307235 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461166df-8fc0-433c-a970-8aad125a2669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:09.308865 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461166df-8fc0-433c-a970-8aad125a2669 admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:09.323141 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1444/2903] 10.222.0.55 () {58 vars in 1122 bytes} [Wed Aug 24 17:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 17:24:09.325375 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e19d4-a457-45b1-a6c7-b5632db2b7ab admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:09.336117 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e19d4-a457-45b1-a6c7-b5632db2b7ab admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:09.340783 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2174d4-f6d0-4567-839d-3dc878a73b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:09.341435 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2174d4-f6d0-4567-839d-3dc878a73b40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:09.341707 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2174d4-f6d0-4567-839d-3dc878a73b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:09.341975 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2174d4-f6d0-4567-839d-3dc878a73b40 admin admin] PATH_INFO: `/v3/projects/9d6e7e6a584f45968990ff36364413f8/users/0b5342488b7d4417ba3b1d39b871b520/roles/99f0ace9fc4d4d028ca52fa9730cab4b` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:09.343891 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2174d4-f6d0-4567-839d-3dc878a73b40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d6e7e6a584f45968990ff36364413f8, user_id=0b5342488b7d4417ba3b1d39b871b520, role_id=99f0ace9fc4d4d028ca52fa9730cab4b)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:09.346491 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2174d4-f6d0-4567-839d-3dc878a73b40 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:09.358210 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1460/2904] 10.222.0.55 () {60 vars in 1483 bytes} [Wed Aug 24 17:24:09 2022] PUT /identity/v3/projects/9d6e7e6a584f45968990ff36364413f8/users/0b5342488b7d4417ba3b1d39b871b520/roles/99f0ace9fc4d4d028ca52fa9730cab4b => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:24:14.926970 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7293907-356a-4eb4-8c9e-2a123d4402a2 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:14.926970 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7293907-356a-4eb4-8c9e-2a123d4402a2 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:14.926970 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7293907-356a-4eb4-8c9e-2a123d4402a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:14.964660 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-b7293907-356a-4eb4-8c9e-2a123d4402a2 None None] MFA Rules not processed for user `0b5342488b7d4417ba3b1d39b871b520`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:14.966195 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-b7293907-356a-4eb4-8c9e-2a123d4402a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:14.995711 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:15.048788 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1445/2905] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:24:14 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:24:15.063908 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2174d4-f6d0-4567-839d-3dc878a73b40 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:15.072588 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-2d2174d4-f6d0-4567-839d-3dc878a73b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:15.160227 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2174d4-f6d0-4567-839d-3dc878a73b40 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:15.164723 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca2c01-9c9d-43ca-87a0-6dec95c6ad22 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a6aad0e9f5f4a0b9578a31082e726cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:15.165387 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca2c01-9c9d-43ca-87a0-6dec95c6ad22 service glance] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:15.165658 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca2c01-9c9d-43ca-87a0-6dec95c6ad22 service glance] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:15.165923 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ca2c01-9c9d-43ca-87a0-6dec95c6ad22 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:15.232471 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca2c01-9c9d-43ca-87a0-6dec95c6ad22 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:15.233951 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ca2c01-9c9d-43ca-87a0-6dec95c6ad22 service glance] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:15.244361 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1461/2906] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:24:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:24:15.569310 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5159f-4fc3-49c3-8d04-cfa553d5f342 None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:15.569599 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5159f-4fc3-49c3-8d04-cfa553d5f342 None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:15.569877 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa5159f-4fc3-49c3-8d04-cfa553d5f342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:15.593215 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-1aa5159f-4fc3-49c3-8d04-cfa553d5f342 None None] MFA Rules not processed for user `ae9fc5f06a0441da80e656fa1e88db5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:15.594462 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-1aa5159f-4fc3-49c3-8d04-cfa553d5f342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:15.662166 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1446/2907] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Aug 24 17:24:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:24:15.675241 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca2c01-9c9d-43ca-87a0-6dec95c6ad22 service glance] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:15.677402 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-51ca2c01-9c9d-43ca-87a0-6dec95c6ad22 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:15.759072 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:15.765578 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ca2c01-9c9d-43ca-87a0-6dec95c6ad22 service glance] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:15.771408 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a22d01-7916-4e33-9feb-07d2d65a4199 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c067bc2d84b741d08ac47e40adae4b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:15.772248 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a22d01-7916-4e33-9feb-07d2d65a4199 service swift] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:15.772533 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a22d01-7916-4e33-9feb-07d2d65a4199 service swift] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:15.772805 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a22d01-7916-4e33-9feb-07d2d65a4199 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:15.781478 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a22d01-7916-4e33-9feb-07d2d65a4199 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:15.783142 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a22d01-7916-4e33-9feb-07d2d65a4199 service swift] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:15.792072 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1462/2908] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Aug 24 17:24:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:24:25.606154 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da91f0-691a-417c-bde3-a76b15cdcfad None None] REQUEST_METHOD: `POST` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:25.606698 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da91f0-691a-417c-bde3-a76b15cdcfad None None] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:25.606698 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da91f0-691a-417c-bde3-a76b15cdcfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:25.625847 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.auth.core [None req-99da91f0-691a-417c-bde3-a76b15cdcfad None None] MFA Rules not processed for user `d302486e019449f7b360f1bfd020756a`. Rule list: `[]` (Enabled: `True`). {{(pid=81760) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:25.627048 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-99da91f0-691a-417c-bde3-a76b15cdcfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:25.634120 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1447/2909] 10.222.0.55 () {58 vars in 958 bytes} [Wed Aug 24 17:24:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:24:25.842031 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=5 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:29.456682 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa518087-2ea3-4db2-b92a-e0b88cf2c808 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:29.457322 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa518087-2ea3-4db2-b92a-e0b88cf2c808 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:29.457322 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa518087-2ea3-4db2-b92a-e0b88cf2c808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:29.478064 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-fa518087-2ea3-4db2-b92a-e0b88cf2c808 None None] MFA Rules not processed for user `ae9fc5f06a0441da80e656fa1e88db5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:24:29.479315 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-fa518087-2ea3-4db2-b92a-e0b88cf2c808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:29.486781 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1463/2910] 10.222.0.55 () {58 vars in 1009 bytes} [Wed Aug 24 17:24:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 17:24:29.502666 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da91f0-691a-417c-bde3-a76b15cdcfad None None] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:29.516126 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da91f0-691a-417c-bde3-a76b15cdcfad None None] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:29.521358 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997a6cb-37d0-4716-9b1c-a8567fa14c34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c067bc2d84b741d08ac47e40adae4b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:29.522131 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997a6cb-37d0-4716-9b1c-a8567fa14c34 service swift] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:29.522472 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997a6cb-37d0-4716-9b1c-a8567fa14c34 service swift] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:29.522748 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997a6cb-37d0-4716-9b1c-a8567fa14c34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:29.532876 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997a6cb-37d0-4716-9b1c-a8567fa14c34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:29.535196 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997a6cb-37d0-4716-9b1c-a8567fa14c34 service swift] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:29.544512 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1448/2911] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Aug 24 17:24:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:24:38.388477 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa518087-2ea3-4db2-b92a-e0b88cf2c808 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:38.388477 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-fa518087-2ea3-4db2-b92a-e0b88cf2c808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:38.462070 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa518087-2ea3-4db2-b92a-e0b88cf2c808 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:38.468707 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369bee8-97d3-491d-a27d-ad4c98417e94 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ef97356edf406aad9ab5f502bdb0af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:38.469430 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369bee8-97d3-491d-a27d-ad4c98417e94 service placement] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:38.469777 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369bee8-97d3-491d-a27d-ad4c98417e94 service placement] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:38.470117 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3369bee8-97d3-491d-a27d-ad4c98417e94 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:38.472462 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-3369bee8-97d3-491d-a27d-ad4c98417e94 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:24:38.487133 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369bee8-97d3-491d-a27d-ad4c98417e94 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:38.488769 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3369bee8-97d3-491d-a27d-ad4c98417e94 service placement] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:38.500867 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1464/2912] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:24:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:24:39.540426 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=52 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:48.495530 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=35 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:24:53.143219 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997a6cb-37d0-4716-9b1c-a8567fa14c34 service swift] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:24:53.206764 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997a6cb-37d0-4716-9b1c-a8567fa14c34 service swift] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:24:53.211334 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0142308-ab01-4f9e-b25e-e3a8542c3d2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:24:53.211952 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0142308-ab01-4f9e-b25e-e3a8542c3d2d service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:24:53.212228 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0142308-ab01-4f9e-b25e-e3a8542c3d2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:24:53.212496 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0142308-ab01-4f9e-b25e-e3a8542c3d2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:24:53.222327 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0142308-ab01-4f9e-b25e-e3a8542c3d2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:24:53.223819 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0142308-ab01-4f9e-b25e-e3a8542c3d2d service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:24:53.234123 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1449/2913] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:24:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:25:03.229600 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=26 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:13.404549 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369bee8-97d3-491d-a27d-ad4c98417e94 service placement] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:13.414161 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3369bee8-97d3-491d-a27d-ad4c98417e94 service placement] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:13.419079 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e455e4b-999b-4ebe-9d44-6fd4d4e551ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:13.419705 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e455e4b-999b-4ebe-9d44-6fd4d4e551ac service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:13.419984 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e455e4b-999b-4ebe-9d44-6fd4d4e551ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:13.420257 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e455e4b-999b-4ebe-9d44-6fd4d4e551ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:13.422005 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-0e455e4b-999b-4ebe-9d44-6fd4d4e551ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:13.496819 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e455e4b-999b-4ebe-9d44-6fd4d4e551ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:13.498261 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e455e4b-999b-4ebe-9d44-6fd4d4e551ac service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:13.510589 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1465/2914] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:26:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 17:26:14.031693 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0142308-ab01-4f9e-b25e-e3a8542c3d2d service neutron] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:14.033753 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-e0142308-ab01-4f9e-b25e-e3a8542c3d2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:14.061824 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0142308-ab01-4f9e-b25e-e3a8542c3d2d service neutron] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:14.070415 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21aa3da-e9c3-470e-8360-f10c734bbcf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28a1c617fc264b118e61f2a97ecb3f39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:14.071555 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21aa3da-e9c3-470e-8360-f10c734bbcf2 service nova] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:14.071869 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21aa3da-e9c3-470e-8360-f10c734bbcf2 service nova] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:14.072260 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21aa3da-e9c3-470e-8360-f10c734bbcf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:14.074594 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-d21aa3da-e9c3-470e-8360-f10c734bbcf2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:14.092562 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21aa3da-e9c3-470e-8360-f10c734bbcf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:14.094604 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21aa3da-e9c3-470e-8360-f10c734bbcf2 service nova] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:14.118593 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1450/2915] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:26:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:26:14.193149 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e455e4b-999b-4ebe-9d44-6fd4d4e551ac service neutron] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:14.194989 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-0e455e4b-999b-4ebe-9d44-6fd4d4e551ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:14.207196 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e455e4b-999b-4ebe-9d44-6fd4d4e551ac service neutron] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:14.212266 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66393ac-7289-4284-a456-46c8d2d8eea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:14.212842 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66393ac-7289-4284-a456-46c8d2d8eea9 service neutron] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:14.213244 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66393ac-7289-4284-a456-46c8d2d8eea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:14.213523 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66393ac-7289-4284-a456-46c8d2d8eea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:14.215469 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-d66393ac-7289-4284-a456-46c8d2d8eea9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:14.227035 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66393ac-7289-4284-a456-46c8d2d8eea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:14.229693 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66393ac-7289-4284-a456-46c8d2d8eea9 service neutron] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:14.240851 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1466/2916] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:26:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:26:20.246844 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21aa3da-e9c3-470e-8360-f10c734bbcf2 service nova] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:20.258001 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21aa3da-e9c3-470e-8360-f10c734bbcf2 service nova] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:20.261849 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86895681-907b-469a-988d-54dd0c54be80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '88ce8df89a96460ca046f2972321bceb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:20.262455 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86895681-907b-469a-988d-54dd0c54be80 service neutron] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:20.262735 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86895681-907b-469a-988d-54dd0c54be80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:20.265909 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86895681-907b-469a-988d-54dd0c54be80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:20.265909 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-86895681-907b-469a-988d-54dd0c54be80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:20.282721 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86895681-907b-469a-988d-54dd0c54be80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:20.284383 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86895681-907b-469a-988d-54dd0c54be80 service neutron] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:20.297609 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1451/2917] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:26:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:26:23.865293 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a459411-3e0c-4686-abf2-24f5b71701f2 None None] REQUEST_METHOD: `POST` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:23.865898 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a459411-3e0c-4686-abf2-24f5b71701f2 None None] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:23.866013 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a459411-3e0c-4686-abf2-24f5b71701f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:23.886538 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.auth.core [None req-8a459411-3e0c-4686-abf2-24f5b71701f2 None None] MFA Rules not processed for user `ae9fc5f06a0441da80e656fa1e88db5d`. Rule list: `[]` (Enabled: `True`). {{(pid=81761) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 17:26:23.888334 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-8a459411-3e0c-4686-abf2-24f5b71701f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:23.895648 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1467/2918] 10.222.0.55 () {58 vars in 967 bytes} [Wed Aug 24 17:26:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 17:26:23.938319 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86895681-907b-469a-988d-54dd0c54be80 service neutron] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:23.950356 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86895681-907b-469a-988d-54dd0c54be80 service neutron] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:23.955573 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5ed55-8187-4252-856f-857bed7b1e85 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c067bc2d84b741d08ac47e40adae4b4f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:23.956191 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5ed55-8187-4252-856f-857bed7b1e85 service swift] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:23.956473 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5ed55-8187-4252-856f-857bed7b1e85 service swift] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:23.956746 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5ed55-8187-4252-856f-857bed7b1e85 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:23.966402 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5ed55-8187-4252-856f-857bed7b1e85 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:23.968073 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5ed55-8187-4252-856f-857bed7b1e85 service swift] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:23.976679 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1452/2919] 10.222.0.55 () {60 vars in 1384 bytes} [Wed Aug 24 17:26:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 17:26:28.471339 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a459411-3e0c-4686-abf2-24f5b71701f2 None None] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:28.472878 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-8a459411-3e0c-4686-abf2-24f5b71701f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:28.490130 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a459411-3e0c-4686-abf2-24f5b71701f2 None None] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:28.496657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfffe5-1b09-41d4-ba48-970a6a1eaaf6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ef97356edf406aad9ab5f502bdb0af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:28.496657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfffe5-1b09-41d4-ba48-970a6a1eaaf6 service placement] REQUEST_METHOD: `GET` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:28.496657 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfffe5-1b09-41d4-ba48-970a6a1eaaf6 service placement] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:28.497246 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cfffe5-1b09-41d4-ba48-970a6a1eaaf6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:28.498900 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-a4cfffe5-1b09-41d4-ba48-970a6a1eaaf6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:28.511562 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfffe5-1b09-41d4-ba48-970a6a1eaaf6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:28.513596 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cfffe5-1b09-41d4-ba48-970a6a1eaaf6 service placement] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:28.525201 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1468/2920] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:26:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:26:32.897116 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5ed55-8187-4252-856f-857bed7b1e85 service swift] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:32.964261 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5ed55-8187-4252-856f-857bed7b1e85 service swift] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:32.968745 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9dc56-d733-450c-b1db-797bffd2418f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:32.969370 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9dc56-d733-450c-b1db-797bffd2418f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:32.969646 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9dc56-d733-450c-b1db-797bffd2418f admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:32.969913 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9dc56-d733-450c-b1db-797bffd2418f admin admin] PATH_INFO: `/v3/users/d302486e019449f7b360f1bfd020756a` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:32.971058 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9dc56-d733-450c-b1db-797bffd2418f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d302486e019449f7b360f1bfd020756a)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:32.973057 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9dc56-d733-450c-b1db-797bffd2418f admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:33.135481 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-c9b9dc56-d733-450c-b1db-797bffd2418f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd302486e019449f7b360f1bfd020756a'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:33.135713 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-c9b9dc56-d733-450c-b1db-797bffd2418f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd302486e019449f7b360f1bfd020756a'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:33.144098 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-c9b9dc56-d733-450c-b1db-797bffd2418f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd302486e019449f7b360f1bfd020756a'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:33.144791 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-c9b9dc56-d733-450c-b1db-797bffd2418f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd302486e019449f7b360f1bfd020756a'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:33.211643 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-c9b9dc56-d733-450c-b1db-797bffd2418f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd302486e019449f7b360f1bfd020756a'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:33.230778 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1453/2921] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:26:32 2022] DELETE /identity/v3/users/d302486e019449f7b360f1bfd020756a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:33.508394 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfffe5-1b09-41d4-ba48-970a6a1eaaf6 service placement] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:33.522507 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cfffe5-1b09-41d4-ba48-970a6a1eaaf6 service placement] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:33.589816 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa2165-8142-4dfa-979d-49f83eff5898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:33.591198 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa2165-8142-4dfa-979d-49f83eff5898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:33.591487 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa2165-8142-4dfa-979d-49f83eff5898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:33.591831 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa2165-8142-4dfa-979d-49f83eff5898 admin admin] PATH_INFO: `/v3/projects/cf3d0ccab3dd40e7b5bce40ee7f98cf8` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:33.592974 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa2165-8142-4dfa-979d-49f83eff5898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf3d0ccab3dd40e7b5bce40ee7f98cf8)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:33.594905 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa2165-8142-4dfa-979d-49f83eff5898 admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:33.720211 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-91fa2165-8142-4dfa-979d-49f83eff5898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf3d0ccab3dd40e7b5bce40ee7f98cf8', 'request_id': 'req-91fa2165-8142-4dfa-979d-49f83eff5898'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:33.724579 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:33.726799 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-91fa2165-8142-4dfa-979d-49f83eff5898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf3d0ccab3dd40e7b5bce40ee7f98cf8', 'request_id': 'req-91fa2165-8142-4dfa-979d-49f83eff5898'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:33.822342 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-91fa2165-8142-4dfa-979d-49f83eff5898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf3d0ccab3dd40e7b5bce40ee7f98cf8', 'request_id': 'req-91fa2165-8142-4dfa-979d-49f83eff5898'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:33.834447 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-91fa2165-8142-4dfa-979d-49f83eff5898 admin admin] The token cache is being invalidate because project cf3d0ccab3dd40e7b5bce40ee7f98cf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:26:33.834736 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-91fa2165-8142-4dfa-979d-49f83eff5898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:33.835396 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-91fa2165-8142-4dfa-979d-49f83eff5898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:33.836879 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1469/2922] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:26:33 2022] DELETE /identity/v3/projects/cf3d0ccab3dd40e7b5bce40ee7f98cf8 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:33.841672 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9dc56-d733-450c-b1db-797bffd2418f admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:33.843092 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-c9b9dc56-d733-450c-b1db-797bffd2418f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:33.856879 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9dc56-d733-450c-b1db-797bffd2418f admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:33.910011 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:33.933572 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7ba2f-0924-48f7-9a39-c61629e76abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:33.935009 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7ba2f-0924-48f7-9a39-c61629e76abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:33.935387 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7ba2f-0924-48f7-9a39-c61629e76abc admin admin] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:33.935664 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7ba2f-0924-48f7-9a39-c61629e76abc admin admin] PATH_INFO: `/v3/users/0b5342488b7d4417ba3b1d39b871b520` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:33.937022 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b7ba2f-0924-48f7-9a39-c61629e76abc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b5342488b7d4417ba3b1d39b871b520)` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:33.939584 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b7ba2f-0924-48f7-9a39-c61629e76abc admin admin] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:34.170508 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-77b7ba2f-0924-48f7-9a39-c61629e76abc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b5342488b7d4417ba3b1d39b871b520'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:34.171242 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-77b7ba2f-0924-48f7-9a39-c61629e76abc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b5342488b7d4417ba3b1d39b871b520'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:34.179927 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-77b7ba2f-0924-48f7-9a39-c61629e76abc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b5342488b7d4417ba3b1d39b871b520'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:34.180656 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-77b7ba2f-0924-48f7-9a39-c61629e76abc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b5342488b7d4417ba3b1d39b871b520'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:34.251387 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.notifications [None req-77b7ba2f-0924-48f7-9a39-c61629e76abc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b5342488b7d4417ba3b1d39b871b520'} {{(pid=81760) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:34.271888 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1454/2923] 10.222.0.55 () {58 vars in 1224 bytes} [Wed Aug 24 17:26:33 2022] DELETE /identity/v3/users/0b5342488b7d4417ba3b1d39b871b520 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:34.557300 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa2165-8142-4dfa-979d-49f83eff5898 admin admin] Authenticating user token {{(pid=81761) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:26:34.558800 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.fernet_utils [None req-91fa2165-8142-4dfa-979d-49f83eff5898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81761) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:26:34.573382 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa2165-8142-4dfa-979d-49f83eff5898 admin admin] Validating token access rules against request {{(pid=81761) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:26:34.642910 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9194b0-64f9-4834-be1e-f2e0e956d2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d59f8996a11403d9a7359000be8b8ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f322c406251a41cbaa75ad5201783a99', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81761) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:26:34.643596 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9194b0-64f9-4834-be1e-f2e0e956d2ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:26:34.643870 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9194b0-64f9-4834-be1e-f2e0e956d2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:26:34.644139 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9194b0-64f9-4834-be1e-f2e0e956d2ff admin admin] PATH_INFO: `/v3/projects/9d6e7e6a584f45968990ff36364413f8` {{(pid=81761) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:26:34.645267 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9194b0-64f9-4834-be1e-f2e0e956d2ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d6e7e6a584f45968990ff36364413f8)` {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:26:34.647543 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9194b0-64f9-4834-be1e-f2e0e956d2ff admin admin] RBAC: Authorization granted {{(pid=81761) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:26:34.763142 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-5c9194b0-64f9-4834-be1e-f2e0e956d2ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d6e7e6a584f45968990ff36364413f8', 'request_id': 'req-5c9194b0-64f9-4834-be1e-f2e0e956d2ff'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:34.770051 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-5c9194b0-64f9-4834-be1e-f2e0e956d2ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d6e7e6a584f45968990ff36364413f8', 'request_id': 'req-5c9194b0-64f9-4834-be1e-f2e0e956d2ff'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:34.868395 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-5c9194b0-64f9-4834-be1e-f2e0e956d2ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d6e7e6a584f45968990ff36364413f8', 'request_id': 'req-5c9194b0-64f9-4834-be1e-f2e0e956d2ff'} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:34.881895 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-5c9194b0-64f9-4834-be1e-f2e0e956d2ff admin admin] The token cache is being invalidate because project 9d6e7e6a584f45968990ff36364413f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81761) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 17:26:34.882189 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-5c9194b0-64f9-4834-be1e-f2e0e956d2ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:34.882852 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG keystone.notifications [None req-5c9194b0-64f9-4834-be1e-f2e0e956d2ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81761) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 17:26:34.884732 dv-cinder-779578-5-smb devstack@keystone.service[81761]: [pid: 81761|app: 0|req: 1470/2924] 10.222.0.55 () {58 vars in 1233 bytes} [Wed Aug 24 17:26:34 2022] DELETE /identity/v3/projects/9d6e7e6a584f45968990ff36364413f8 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 17:26:44.268100 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=35,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:26:44.878433 dv-cinder-779578-5-smb devstack@keystone.service[81761]: DEBUG dbcounter [-] [81761] Writing DB stats keystone:DELETE=9,keystone:SELECT=56,keystone:INSERT=2 {{(pid=81761) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 17:29:42.548476 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7ba2f-0924-48f7-9a39-c61629e76abc admin admin] Authenticating user token {{(pid=81760) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 17:29:42.549986 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-77b7ba2f-0924-48f7-9a39-c61629e76abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:29:42.693867 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7ba2f-0924-48f7-9a39-c61629e76abc admin admin] Validating token access rules against request {{(pid=81760) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 17:29:42.753330 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d34cd-6dc2-4ad9-9430-f089dadf6cf1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '32ef97356edf406aad9ab5f502bdb0af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ebae6aa9c60343e6ba0ff1cd62619642', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81760) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 17:29:42.753937 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d34cd-6dc2-4ad9-9430-f089dadf6cf1 service placement] REQUEST_METHOD: `GET` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 17:29:42.754208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d34cd-6dc2-4ad9-9430-f089dadf6cf1 service placement] SCRIPT_NAME: `/identity` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 17:29:42.754474 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d34cd-6dc2-4ad9-9430-f089dadf6cf1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81760) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 17:29:42.756208 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.fernet_utils [None req-fc7d34cd-6dc2-4ad9-9430-f089dadf6cf1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81760) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 17:29:42.768522 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d34cd-6dc2-4ad9-9430-f089dadf6cf1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 17:29:42.770088 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d34cd-6dc2-4ad9-9430-f089dadf6cf1 service placement] RBAC: Authorization granted {{(pid=81760) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 17:29:42.780275 dv-cinder-779578-5-smb devstack@keystone.service[81760]: [pid: 81760|app: 0|req: 1455/2925] 10.222.0.55 () {60 vars in 1365 bytes} [Wed Aug 24 17:29:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 17:29:52.776048 dv-cinder-779578-5-smb devstack@keystone.service[81760]: DEBUG dbcounter [-] [81760] Writing DB stats keystone:SELECT=89 {{(pid=81760) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}